-- Logs begin at Sat 2022-03-05 20:01:15 UTC, end at Sat 2022-03-05 22:06:03 UTC. -- Mar 05 20:39:37.675964 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Mar 05 20:39:40.956430 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=134576) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 20:39:40.956990 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=134576) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 20:39:41.325951 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_db.sqlalchemy.engines [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134576) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:39:41.649975 ncdv-master-1 cinder-volume[134576]: INFO cinder.rpc [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Mar 05 20:39:41.660097 ncdv-master-1 cinder-volume[134576]: INFO cinder.rpc [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Mar 05 20:39:41.663531 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_db.sqlalchemy.engines [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134576) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:39:41.741151 ncdv-master-1 cinder-volume[134576]: INFO cinder.volume.manager [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Determined volume DB was empty at startup. Mar 05 20:39:41.741880 ncdv-master-1 cinder-volume[134576]: DEBUG cinder.volume.manager [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=134576) __init__ /opt/stack/cinder/cinder/volume/manager.py:286}} Mar 05 20:39:41.749920 ncdv-master-1 cinder-volume[134576]: INFO cinder.volume.manager [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Service not found for updating active_backend_id, assuming default for driver init. Mar 05 20:39:41.750699 ncdv-master-1 cinder-volume[134576]: WARNING stevedore.named [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:39:41.751130 ncdv-master-1 cinder-volume[134576]: WARNING castellan.key_manager [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:39:41.752254 ncdv-master-1 cinder-volume[134576]: WARNING cinder.keymgr.conf_key_mgr [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:39:41.767584 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_db.sqlalchemy.engines [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134576) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:39:41.772530 ncdv-master-1 cinder-volume[134576]: INFO cinder.rpc [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Mar 05 20:39:41.776604 ncdv-master-1 cinder-volume[134576]: INFO cinder.rpc [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Mar 05 20:39:41.777264 ncdv-master-1 cinder-volume[134576]: WARNING stevedore.named [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:39:41.777662 ncdv-master-1 cinder-volume[134576]: WARNING castellan.key_manager [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:39:41.779401 ncdv-master-1 cinder-volume[134576]: INFO cinder.volume.manager [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Image-volume cache enabled for host ncdv-master-1@ceph. Mar 05 20:39:41.784937 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_db.sqlalchemy.engines [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134576) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:39:41.807079 ncdv-master-1 cinder-volume[134576]: INFO oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Starting 1 workers Mar 05 20:39:41.812129 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Started child 134747 {{(pid=134576) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Mar 05 20:39:41.813479 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Full set of CONF: {{(pid=134576) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Mar 05 20:39:41.813943 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ******************************************************************************** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 05 20:39:41.814356 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] Configuration options gathered from: {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 05 20:39:41.814850 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 05 20:39:41.815601 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 05 20:39:41.816020 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ================================================================================ {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 05 20:39:41.816863 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] allow_availability_zone_fallback = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.817367 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] allow_compression_on_image_upload = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.818718 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] allowed_direct_url_schemes = [] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.819228 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] api_rate_limit = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.819869 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] auth_strategy = keystone {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.820563 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] az_cache_duration = 3600 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.821172 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_availability_zone = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.821900 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_host = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.822526 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_name = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.823125 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_stats_polling_interval = 60 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.823737 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backup_api_class = cinder.backup.api.API {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.824309 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.824934 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backup_name_template = backup-%s {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.825680 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backup_use_same_host = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.826067 ncdv-master-1 cinder-volume[134747]: INFO cinder.service [-] Starting cinder-volume node (version 19.1.0) Mar 05 20:39:41.826940 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backup_use_temp_snapshot = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.827543 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] chap_password = **** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.828307 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] chap_username = {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.828964 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.829591 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cinder_internal_tenant_project_id = 87292ea496944da4a7e67ecf8e0eaa0c {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.830225 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cinder_internal_tenant_user_id = 2cb0fb16af604f8cb64089e3a17a244b {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.830824 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cloned_volume_same_az = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.831409 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cluster = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.832043 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] compression_format = gzip {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.832669 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] compute_api_class = cinder.compute.nova.API {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.836581 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] config_dir = [] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.837187 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.851881 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] config_source = [] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.856071 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.856811 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] control_exchange = openstack {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.857483 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] debug = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.858063 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] default_availability_zone = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.858633 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] default_group_type = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.859515 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.860169 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] default_volume_type = ceph {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.860740 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] driver_client_cert = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.861337 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] driver_client_cert_key = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.861917 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] driver_data_namespace = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.862487 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] driver_ssl_cert_path = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.863049 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] driver_ssl_cert_verify = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.863652 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] driver_use_ssl = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.864325 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] enable_force_upload = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.865538 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] enable_new_services = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.866163 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] enable_unsupported_driver = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.866781 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] enabled_backends = ['ceph'] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.867351 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] enforce_multipath_for_image_xfer = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:41.868617 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] filter_function = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.075806 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] glance_api_insecure = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.075806 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] glance_api_servers = ['http://10.222.0.15/image'] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.075806 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] glance_api_ssl_compression = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.075806 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] glance_ca_certificates_file = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.075806 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] glance_catalog_info = image:glance:publicURL {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.075806 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] glance_certfile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.076602 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.076602 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] glance_keyfile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.076602 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] glance_num_retries = 3 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.076602 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] glance_request_timeout = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.076602 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] goodness_function = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.076602 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] graceful_shutdown_timeout = 5 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.076982 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] group_api_class = cinder.group.api.API {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.076982 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] host = ncdv-master-1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.076982 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] iet_conf = /etc/iet/ietd.conf {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.076982 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] image_compress_on_upload = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.076982 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] image_conversion_address_space_limit = 1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.076982 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] image_conversion_cpu_limit = 60 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.077368 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.077368 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] image_upload_use_cinder_backend = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.077368 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] image_upload_use_internal_tenant = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.077368 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] image_volume_cache_enabled = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.077368 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] image_volume_cache_max_count = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.077368 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] image_volume_cache_max_size_gb = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.077368 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] init_host_max_objects_retrieval = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.077784 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] Starting volume driver RBDDriver (1.2.0) Mar 05 20:39:42.077857 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] instance_format = [instance: %(uuid)s] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.077857 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.077857 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] iscsi_iotype = fileio {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.077857 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] iscsi_secondary_ip_addresses = [] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.078133 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:39:42.078205 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] iscsi_target_flags = {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.078205 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] iscsi_write_cache = on {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.078205 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] iser_helper = tgtadm {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.078205 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] iser_ip_address = 10.222.0.15 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.078205 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] iser_port = 3260 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.078205 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.078205 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] log_config_append = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.078634 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.078634 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] log_dir = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.078634 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] log_file = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.078634 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] log_options = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.078634 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] log_rotate_interval = 1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.078634 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] log_rotate_interval_type = days {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.078634 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] log_rotation_type = none {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.079082 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.079082 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.079082 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.079082 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.079082 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.079397 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] max_age = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.079397 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] max_logfile_count = 30 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.079397 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] max_logfile_size_mb = 200 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.079397 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] max_over_subscription_ratio = 20.0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.079397 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] message_reap_interval = 86400 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.079397 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] message_ttl = 2592000 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.079397 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] migration_create_volume_timeout_secs = 300 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.080066 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] monkey_patch = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.080066 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] monkey_patch_modules = [] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.080066 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] my_ip = 10.222.0.15 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.080066 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] no_snapshot_gb_quota = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.080066 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] num_iser_scan_tries = 3 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.080066 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] num_shell_tries = 3 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.080066 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] num_volume_device_scan_tries = 3 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081083 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] nvmet_ns_id = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081083 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] nvmet_port_id = 1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081083 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] osapi_max_limit = 1000 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081083 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] osapi_volume_ext_list = [] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081083 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081083 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] osapi_volume_listen = 0.0.0.0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081469 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] osapi_volume_listen_port = 8776 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081469 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] osapi_volume_use_ssl = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081469 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] osapi_volume_workers = 2 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081469 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] per_volume_size_limit = -1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081469 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] periodic_fuzzy_delay = 60 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081469 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] periodic_interval = 60 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081469 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] project_id_regex = [0-9a-f\-]+ {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081910 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] public_endpoint = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081910 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] publish_errors = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081910 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] quota_backup_gigabytes = 1000 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081910 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] quota_backups = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081910 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] quota_consistencygroups = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081910 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.081910 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] quota_gigabytes = 1000 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.082348 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] quota_groups = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.082348 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] quota_snapshots = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.082348 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] quota_volumes = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.082348 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] rate_limit_burst = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.082348 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] rate_limit_except_level = CRITICAL {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.082348 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] rate_limit_interval = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.082348 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] reinit_driver_count = 3 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.082806 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] replication_device = **** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.082806 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] report_discard_supported = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.082806 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] report_interval = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.082806 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] reservation_clean_interval = 86400 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.082806 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] reservation_expire = 86400 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.082806 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] reserved_percentage = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.082806 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.083252 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.083252 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] rpc_response_timeout = 120 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.083252 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] run_external_periodic_tasks = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.083252 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.083252 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] scst_target_driver = iscsi {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.083252 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] scst_target_iqn_name = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.083624 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] service_down_time = 60 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.083624 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] snapshot_name_template = snapshot-%s {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.083624 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] snapshot_same_host = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.083624 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] split_loggers = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.083624 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] state_path = /opt/stack/data/cinder {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.083624 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] storage_availability_zone = nova {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.083624 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] storage_protocol = iscsi {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.084146 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] syslog_log_facility = LOG_USER {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.084146 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] target_helper = lioadm {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.084146 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] target_ip_address = 10.222.0.15 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.084146 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] target_port = 3260 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.084146 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.084146 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] target_protocol = iscsi {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.084635 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] trace_flags = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.084635 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] transfer_api_class = cinder.transfer.api.API {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.084635 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] transport_url = **** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.084635 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] until_refresh = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.084635 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] use_chap_auth = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.084635 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] use_default_quota_class = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.084635 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] use_eventlog = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.085777 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] use_journal = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.085777 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] use_json = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.085777 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] use_multipath_for_image_xfer = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.085777 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] use_stderr = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.085777 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] use_syslog = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.085777 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] verify_glance_signatures = enabled {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.085777 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] volume_api_class = cinder.volume.api.API {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.086218 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] volume_backend_name = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.086218 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] volume_clear = zero {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.086218 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] volume_clear_ionice = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.086218 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] volume_clear_size = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.086218 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.086218 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] volume_copy_bps_limit = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.086218 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] volume_dd_blocksize = 1M {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.086694 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.086694 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] volume_name_template = volume-%s {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.086694 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] volume_service_inithost_offload = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.086694 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] volume_usage_audit_period = month {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.087255 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:39:42.087339 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.087339 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] watch_log_file = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.087339 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] zoning_mode = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:39:42.087339 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.087339 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.087339 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_policy.enforce_new_defaults = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.087978 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_policy.enforce_scope = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.087978 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_policy.policy_default_rule = default {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.087978 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.087978 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_policy.policy_file = policy.yaml {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.087978 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.087978 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.088418 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.088418 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.088418 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.088418 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_concurrency.disable_process_locking = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.088418 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.088418 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.admin_password = **** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.088925 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.088925 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.admin_token = **** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.088925 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.admin_user = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.088925 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.auth_admin_prefix = {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.088925 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.088925 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.auth_port = 35357 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.088925 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.auth_protocol = https {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.089529 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.auth_section = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.089529 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.auth_type = password {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.089529 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.auth_uri = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.089529 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.auth_version = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.089529 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.cache = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.089529 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.089529 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.certfile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090021 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.delay_auth_decision = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090021 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090021 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.http_connect_timeout = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090021 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090021 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.identity_uri = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090021 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.include_service_catalog = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090488 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.insecure = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090488 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.interface = public {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090488 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.keyfile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090488 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090488 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090488 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090917 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090917 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090917 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090917 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090917 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.090917 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.091341 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.region_name = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.091341 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.091341 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.service_token_roles_required = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.091341 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.service_type = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.091341 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.token_cache_time = 300 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.091341 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] keystone_authtoken.www_authenticate_uri = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.092109 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.backend = dogpile.cache.null {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.092109 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.backend_argument = **** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.092109 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.config_prefix = cache.oslo {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.092109 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.dead_timeout = 60.0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.092109 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.debug_cache_backend = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.092109 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.enable_retry_client = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.092109 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.enable_socket_keepalive = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.092801 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.enabled = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.092801 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.expiration_time = 600 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.092801 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.hashclient_retry_attempts = 2 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.092801 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.hashclient_retry_delay = 1.0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.092801 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.memcache_dead_retry = 300 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.092801 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.092801 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.093480 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.memcache_pool_maxsize = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.093480 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.093480 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.093480 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.memcache_socket_timeout = 1.0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.093480 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.proxies = [] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.093480 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.retry_attempts = 2 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.093480 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.retry_delay = 0.0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.094064 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.socket_keepalive_count = 1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.094064 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.socket_keepalive_idle = 1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.094064 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.socket_keepalive_interval = 1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.094064 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.tls_allowed_ciphers = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.094064 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.tls_cafile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.094064 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.tls_certfile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.094064 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.tls_enabled = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.094699 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cache.tls_keyfile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.094819 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:39:42.095562 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] coordination.backend_url = etcd3+http://10.222.0.15:2379 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.095562 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.backend = sqlalchemy {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.095562 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.connection = **** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.095562 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.connection_debug = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.095562 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.connection_parameters = {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.095562 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.connection_recycle_time = 3600 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.095562 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.connection_trace = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.096300 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.db_inc_retry_interval = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.096300 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.db_max_retries = 20 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.096300 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.db_max_retry_interval = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.096300 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.db_retry_interval = 1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.096300 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.max_overflow = 50 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.096300 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.max_pool_size = 5 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.096300 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.max_retries = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.097024 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.mysql_enable_ndb = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.097024 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.097024 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.pool_timeout = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.097024 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.retry_interval = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.097024 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.slave_connection = **** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.097024 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.sqlite_synchronous = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.097024 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] database.use_db_reconnect = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.097669 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.097669 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.097669 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.097669 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.097669 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.097669 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] profiler.connection_string = messaging:// {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.104242 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] profiler.enabled = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.104242 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] profiler.es_doc_type = notification {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.104242 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] profiler.es_scroll_size = 10000 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.104242 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] profiler.es_scroll_time = 2m {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.104242 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] profiler.filter_error_trace = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.104242 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] profiler.hmac_keys = SECRET_KEY {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.104242 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] profiler.sentinel_service_name = mymaster {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.104857 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] profiler.socket_timeout = 0.1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.104857 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] profiler.trace_sqlalchemy = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.104857 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] privsep_osbrick.capabilities = [21] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.104857 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] privsep_osbrick.group = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.104857 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] privsep_osbrick.helper_command = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.104857 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.104857 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.105443 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] privsep_osbrick.user = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.105443 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.105443 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cinder_sys_admin.group = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.105443 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cinder_sys_admin.helper_command = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.105443 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.105443 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.105443 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] cinder_sys_admin.user = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.106053 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] service_user.auth_section = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.106053 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] service_user.auth_type = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.106053 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] service_user.cafile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.106053 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] service_user.certfile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.106053 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] service_user.collect_timing = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.106053 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] service_user.insecure = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.106053 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] service_user.keyfile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.106671 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] service_user.send_service_user_token = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.106671 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] service_user.split_loggers = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.106671 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] service_user.timeout = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.106671 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.backend_availability_zone = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.106671 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.106671 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.107110 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.chap_password = **** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.107110 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.chap_username = {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.107110 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.107110 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.107110 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.107110 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.driver_client_cert = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.107541 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.driver_client_cert_key = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.107541 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.driver_data_namespace = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.107541 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.107541 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.107541 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.driver_use_ssl = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.107541 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.enable_deferred_deletion = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108073 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.enable_unsupported_driver = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108073 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108073 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.extra_capabilities = {} {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108073 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.filter_function = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108073 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.goodness_function = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108073 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108515 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108515 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108515 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108515 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108515 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108515 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.iscsi_iotype = fileio {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108947 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108947 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.iscsi_target_flags = {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108947 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.iscsi_write_cache = on {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108947 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.iser_helper = tgtadm {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108947 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.iser_ip_address = 10.222.0.15 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.108947 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.iser_port = 3260 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.109861 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.109861 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.109861 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.109861 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.num_shell_tries = 3 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.109861 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.109861 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.110566 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.nvmet_port_id = 1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.110566 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.rados_connect_timeout = -1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.110566 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.rados_connection_interval = 5 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.110566 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.rados_connection_retries = 3 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.110566 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.rbd_ceph_conf = {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.110566 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.rbd_cluster_name = ceph {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.110566 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.115421 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.115510 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.driver [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] Driver hasn't implemented _init_vendor_properties() Mar 05 20:39:42.115609 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.115609 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.rbd_pool = rbd {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.115835 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.driver [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2fe49187-130a-4cfa-a03a-392504363329:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134747) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:811}} Mar 05 20:39:42.115938 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.rbd_secret_uuid = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.115938 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.115938 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.rbd_user = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.115938 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.replication_connect_timeout = 5 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.115938 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.replication_device = **** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.115938 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.report_discard_supported = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.116430 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.116430 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.reserved_percentage = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.116430 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.scst_target_driver = iscsi {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.116430 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.scst_target_iqn_name = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.116430 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.storage_protocol = iscsi {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.116430 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.116870 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.target_helper = tgtadm {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.116870 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.target_ip_address = 10.222.0.15 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.116870 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.target_port = 3260 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.116870 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.116870 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.target_protocol = iscsi {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.116870 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.trace_flags = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.117294 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.unique_fqdn_network = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.117294 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.use_chap_auth = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.118009 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.118385 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:39:42.118670 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.volume_backend_name = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.119253 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.volume_clear = zero {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.119787 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.volume_clear_ionice = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.120559 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.volume_clear_size = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.120930 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.121310 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.122149 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.122514 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.122980 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.123388 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_reports.file_event_handler = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.123825 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.124192 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_reports.log_dir = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.124602 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.backend_availability_zone = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.124963 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.backend_host = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.125390 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.backend_native_threads_pool_size = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.125734 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.backup_use_temp_snapshot = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.126071 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.chap_password = **** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.126417 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.chap_username = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.126757 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.chiscsi_conf = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.127098 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.deferred_deletion_delay = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.127437 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.deferred_deletion_purge_interval = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.127799 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.driver_client_cert = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.128146 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.driver_client_cert_key = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.128489 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.driver_data_namespace = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.128829 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.driver_ssl_cert_path = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.129167 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.driver_ssl_cert_verify = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.129507 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.driver_use_ssl = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.129872 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.enable_deferred_deletion = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.130185 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.enable_unsupported_driver = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.130532 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.130869 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.extra_capabilities = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.131209 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.filter_function = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.131770 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.goodness_function = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.132241 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.iet_conf = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.132589 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.image_upload_use_cinder_backend = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.132928 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.image_upload_use_internal_tenant = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.133278 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.image_volume_cache_enabled = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.133619 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.image_volume_cache_max_count = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.133957 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.image_volume_cache_max_size_gb = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.134304 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.iscsi_iotype = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.134640 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.134986 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.iscsi_target_flags = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.135319 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.iscsi_write_cache = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.135657 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.iser_helper = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.136019 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.iser_ip_address = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.136357 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.iser_port = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.136694 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.iser_target_prefix = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.137030 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.max_over_subscription_ratio = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.137371 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.num_iser_scan_tries = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.137798 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.num_shell_tries = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.138143 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.num_volume_device_scan_tries = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.138815 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.nvmet_ns_id = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.138982 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.nvmet_port_id = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.139208 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.rados_connect_timeout = -1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.139528 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.rados_connection_interval = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.139902 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.rados_connection_retries = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.140252 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.140743 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.rbd_cluster_name = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.141083 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.141439 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.141975 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.rbd_max_clone_depth = 5 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.142469 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.rbd_pool = volumes {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.142824 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.rbd_secret_uuid = 8d87457b-6332-4760-a8de-c25b9c847a37 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.143175 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.rbd_store_chunk_size = 4 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.143523 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.rbd_user = cinder {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.143879 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.replication_connect_timeout = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.144225 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.replication_device = **** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.144559 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.report_discard_supported = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.144948 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.report_dynamic_total_capacity = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.145286 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.reserved_percentage = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.145624 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.scst_target_driver = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.145959 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.scst_target_iqn_name = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.146292 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.storage_protocol = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.146632 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.suppress_requests_ssl_warnings = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.146970 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.target_helper = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.147301 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.target_ip_address = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.147631 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.target_port = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.147985 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.target_prefix = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.148315 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.target_protocol = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.148649 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.trace_flags = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.148981 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.unique_fqdn_network = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.149319 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.use_chap_auth = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.149649 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.use_multipath_for_image_xfer = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.149996 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.volume_backend_name = ceph {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.150330 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.volume_clear = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.150665 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.volume_clear_ionice = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.150995 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.volume_clear_size = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.151329 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.151663 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.volume_copy_bps_limit = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.152197 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.volume_dd_blocksize = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.152951 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.153296 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ceph.volumes_dir = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.153727 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.154610 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.154610 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.154904 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.155197 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.155535 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.155923 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.156263 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.156602 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.156937 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.157328 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.157674 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.158046 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.158408 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.158747 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.159103 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.159444 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.159803 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.160145 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.160500 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.160852 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.161703 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.162296 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.ssl = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.162801 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.163182 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.163541 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.163954 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_rabbit.ssl_version = {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.164286 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_notifications.driver = [] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.164664 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_notifications.retry = -1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.165078 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.165682 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] oslo_messaging_notifications.transport_url = **** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.165917 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.166213 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] key_manager.fixed_key = **** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.166892 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.167453 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.barbican_api_version = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.167827 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.barbican_endpoint = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.168279 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.barbican_endpoint_type = public {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.168534 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.barbican_region_name = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.168878 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.cafile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.169216 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.certfile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.169594 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.collect_timing = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.169939 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.insecure = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.170272 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.keyfile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.170614 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.number_of_retries = 60 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.170953 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.retry_delay = 1 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.171295 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.send_service_user_token = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.171714 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.split_loggers = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.172294 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.timeout = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.172768 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.verify_ssl = True {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.173128 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican.verify_ssl_path = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.173470 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican_service_user.auth_section = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.173813 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican_service_user.auth_type = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.174151 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican_service_user.cafile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.174481 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican_service_user.certfile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.174839 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican_service_user.collect_timing = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.175199 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican_service_user.insecure = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.175548 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican_service_user.keyfile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.175937 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican_service_user.split_loggers = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.176270 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] barbican_service_user.timeout = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.176645 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.approle_role_id = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.177512 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.approle_secret_id = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.177846 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.cafile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.178178 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.certfile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.178514 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.collect_timing = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.178849 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.insecure = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.179182 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.keyfile = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.179552 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.kv_mountpoint = secret {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.184075 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.kv_version = 2 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.184075 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.namespace = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.184075 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.root_token_id = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.184075 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.split_loggers = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.184075 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.ssl_ca_crt_file = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.184075 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.timeout = None {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.184075 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.use_ssl = False {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.184798 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:39:42.184798 ncdv-master-1 cinder-volume[134576]: DEBUG oslo_service.service [None req-e4b2a3bf-131a-48a1-8376-0c9f8f34a36a None None] ******************************************************************************** {{(pid=134576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 05 20:39:42.199416 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.db.sqlalchemy.api [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] Building query based on filter {{(pid=134747) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3159}} Mar 05 20:39:42.218973 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.image_utils [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=134747) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Mar 05 20:39:42.226365 ncdv-master-1 cinder-volume[134747]: INFO cinder.keymgr.migration [None req-86e316e2-7942-4793-a892-5715ce0b857d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Mar 05 20:39:42.234327 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:39:42.281478 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:39:42.322106 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:39:42.360277 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] Driver initialization completed successfully. Mar 05 20:39:42.370578 ncdv-master-1 cinder-volume[134747]: INFO cinder.manager [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] Initiating service 3 cleanup Mar 05 20:39:42.377544 ncdv-master-1 cinder-volume[134747]: INFO cinder.manager [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] Service 3 cleanup completed. Mar 05 20:39:42.377883 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.service [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] Creating RPC server for service cinder-volume {{(pid=134747) start /opt/stack/cinder/cinder/service.py:231}} Mar 05 20:39:42.386313 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.service [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=134747) start /opt/stack/cinder/cinder/service.py:237}} Mar 05 20:39:42.453798 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Mar 05 20:39:42.454967 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:39:42.487596 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:39:42.532864 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-89aaab1d-0b73-4c62-8fb2-518ba2372e40 None None] Driver post RPC initialization completed successfully. Mar 05 20:40:45.536829 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:40:45.537636 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:40:45.559601 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:40:45.583740 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:41:45.538878 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:41:45.540229 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:41:45.567484 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:41:45.596929 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:42:45.542816 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:42:45.543523 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:42:45.566783 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:42:45.588799 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:43:45.544479 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:43:45.545187 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:43:45.566994 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:43:45.587994 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:44:45.542525 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:44:45.543215 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:44:45.564329 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:44:45.585592 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:45:45.540349 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:45:45.541036 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:45:45.563796 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:45:45.585847 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:46:45.540493 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:46:45.541187 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:46:45.579126 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:46:45.602948 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:48:45.538921 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:48:45.539577 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:48:45.636807 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:48:45.736862 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:49:45.541023 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:49:45.541023 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:49:45.627803 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:49:45.688255 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:50:45.538681 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:50:45.539401 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:50:45.631565 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:50:45.727930 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:51:07.672055 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:51:07.703757 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:51:07.720874 ncdv-master-1 cinder-volume[134747]: INFO cinder.rpc [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Mar 05 20:51:07.746009 ncdv-master-1 cinder-volume[134747]: INFO cinder.rpc [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Mar 05 20:51:07.752999 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:51:07.760181 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:51:07.906540 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Flow 'volume_create_manager' (22fb2547-79ad-4d6c-9afe-5ca20a72b7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:51:07.926241 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb87829f-1872-4623-9a43-20dafbd8ecfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:07.944937 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:51:08.088009 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb87829f-1872-4623-9a43-20dafbd8ecfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1944454127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7fab029c-6104-4f67-a93d-5c93dbea922a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff75cc228d249d1b12cd184ad1c4cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:51:08Z,use_quota=True,user_id='e33c3ba3d26c4664a622711cad0381a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:08.114389 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cb8d4d-bb6f-4b81-9fd4-383a4f07796d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:08.124683 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cb8d4d-bb6f-4b81-9fd4-383a4f07796d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:08.132871 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e67426-7d2e-432d-ba3d-6ac7cecf6cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:08.359245 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e67426-7d2e-432d-ba3d-6ac7cecf6cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7fab029c-6104-4f67-a93d-5c93dbea922a', 'volume_name': 'volume-7fab029c-6104-4f67-a93d-5c93dbea922a', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:08.374697 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abfe623d-2da5-4f3a-8d49-9b539d6c35b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:08.403771 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abfe623d-2da5-4f3a-8d49-9b539d6c35b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:08.428953 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f70212-1e05-4327-bddf-466eac522627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:08.430252 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Volume 7fab029c-6104-4f67-a93d-5c93dbea922a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7fab029c-6104-4f67-a93d-5c93dbea922a', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 20:51:08.430835 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Cloning 7fab029c-6104-4f67-a93d-5c93dbea922a from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 20:51:08.459325 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.027s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:51:08.482023 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Preparing cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 05 20:51:08.483435 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 20:51:27.636244 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.image_utils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph, size 616.00 MB, duration 19.13 sec {{(pid=134747) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Mar 05 20:51:27.636244 ncdv-master-1 cinder-volume[134747]: INFO cinder.image.image_utils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Image download 616.00 MB at 32.19 MB/s Mar 05 20:51:27.698016 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:51:27.941197 ncdv-master-1 sudo[144853]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph Mar 05 20:51:27.942214 ncdv-master-1 sudo[144853]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 05 20:51:30.101188 ncdv-master-1 sudo[144853]: pam_unix(sudo:session): session closed for user root Mar 05 20:51:30.105254 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph" returned: 0 in 2.407s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:51:30.112668 ncdv-master-1 cinder-volume[134747]: WARNING py.warnings [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Mar 05 20:51:30.112668 ncdv-master-1 cinder-volume[134747]: debtcollector.deprecate( Mar 05 20:51:30.112668 ncdv-master-1 cinder-volume[134747]: Mar 05 20:51:30.114320 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.image_utils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Temporary image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 is fetched for user e33c3ba3d26c4664a622711cad0381a9. {{(pid=134747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Mar 05 20:51:30.268116 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:51:30.566032 ncdv-master-1 sudo[144894]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph Mar 05 20:51:30.568045 ncdv-master-1 sudo[144894]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 05 20:51:31.055355 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:51:31.066914 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:51:31.069072 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:51:31.115654 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Flow 'volume_create_manager' (bcef9c7d-f857-4ac0-885d-b50ed5395fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:51:31.126150 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fec46f5-2b91-4bbc-bd26-fc7bd827735e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:31.136426 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:51:31.159514 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fec46f5-2b91-4bbc-bd26-fc7bd827735e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-775915645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0c57b554-8684-4f09-a946-2caa95d79937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde93d10dbea40429b16ffe4a6efce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:51:31Z,use_quota=True,user_id='7d38e7ad086f42abb908cdfd2e0ebd18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:31.172132 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d77ff25-93fa-40da-be88-3a254adec6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:31.187173 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d77ff25-93fa-40da-be88-3a254adec6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:31.193806 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f006819-1ceb-4ab0-86c8-c7a078e699ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:31.199187 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f006819-1ceb-4ab0-86c8-c7a078e699ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c57b554-8684-4f09-a946-2caa95d79937', 'volume_name': 'volume-0c57b554-8684-4f09-a946-2caa95d79937', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:31.206201 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df10df2e-d58c-4ec8-ad78-29815e212d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:31.222333 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df10df2e-d58c-4ec8-ad78-29815e212d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:31.227834 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d3f496-c465-4ef7-8582-76fa721b440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:31.229136 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Volume 0c57b554-8684-4f09-a946-2caa95d79937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c57b554-8684-4f09-a946-2caa95d79937', 'volume_size': 1} Mar 05 20:51:31.229563 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] creating volume 'volume-0c57b554-8684-4f09-a946-2caa95d79937' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:51:31.232423 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:31.461801 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:51:31.462059 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:51:31.466478 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d3f496-c465-4ef7-8582-76fa721b440d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c57b554-8684-4f09-a946-2caa95d79937', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:31.470816 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc823aa4-f162-443f-bffa-33e2f2d39a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:31.494925 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Volume volume-0c57b554-8684-4f09-a946-2caa95d79937 (0c57b554-8684-4f09-a946-2caa95d79937): created successfully Mar 05 20:51:31.502986 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc823aa4-f162-443f-bffa-33e2f2d39a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:31.514647 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Flow 'volume_create_manager' (bcef9c7d-f857-4ac0-885d-b50ed5395fb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:51:31.540975 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ab7e6fb6-e274-484a-94e3-f1d546b50239 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Created volume successfully. Mar 05 20:51:32.864435 ncdv-master-1 sudo[144894]: pam_unix(sudo:session): session closed for user root Mar 05 20:51:32.867017 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph" returned: 0 in 2.599s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:51:32.868302 ncdv-master-1 cinder-volume[134747]: WARNING py.warnings [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Mar 05 20:51:32.868302 ncdv-master-1 cinder-volume[134747]: debtcollector.deprecate( Mar 05 20:51:32.868302 ncdv-master-1 cinder-volume[134747]: Mar 05 20:51:32.868910 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] creating volume 'volume-7fab029c-6104-4f67-a93d-5c93dbea922a' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:51:32.869842 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:33.012365 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:51:33.013643 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:51:33.038319 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Attempting download of 81837c2f-28ec-46e4-b5d6-afa9c9233d80 ((None, None)) to volume 7fab029c-6104-4f67-a93d-5c93dbea922a. {{(pid=134747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Mar 05 20:51:33.119075 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_81837c2f-28ec-46e4-b5d6-afa9c9233d80_mlbj99r3 {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:51:33.248489 ncdv-master-1 sudo[144948]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_81837c2f-28ec-46e4-b5d6-afa9c9233d80_mlbj99r3 Mar 05 20:51:33.250093 ncdv-master-1 sudo[144948]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 05 20:51:33.519908 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-98a1ed23-3904-44a1-a960-cc21b41f837e req-30003ea5-5a49-4589-ac9a-15c27645b84a tempest-AttachSCSIVolumeTestJSON-1365107399 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:51:35.191359 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-98a1ed23-3904-44a1-a960-cc21b41f837e req-30003ea5-5a49-4589-ac9a-15c27645b84a tempest-AttachSCSIVolumeTestJSON-1365107399 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.671s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:51:35.192367 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-98a1ed23-3904-44a1-a960-cc21b41f837e req-30003ea5-5a49-4589-ac9a-15c27645b84a tempest-AttachSCSIVolumeTestJSON-1365107399 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0c57b554-8684-4f09-a946-2caa95d79937', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '0c57b554-8684-4f09-a946-2caa95d79937', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:51:35.301986 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-98a1ed23-3904-44a1-a960-cc21b41f837e req-30003ea5-5a49-4589-ac9a-15c27645b84a tempest-AttachSCSIVolumeTestJSON-1365107399 None] Connection info returned from driver {'name': 'volumes/volume-0c57b554-8684-4f09-a946-2caa95d79937', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0c57b554-8684-4f09-a946-2caa95d79937', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a24a8b4d-809c-41c4-90bd-dbe3d230d42f'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 20:51:35.302606 ncdv-master-1 sudo[144948]: pam_unix(sudo:session): session closed for user root Mar 05 20:51:35.306183 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_81837c2f-28ec-46e4-b5d6-afa9c9233d80_mlbj99r3" returned: 0 in 2.187s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:51:35.306829 ncdv-master-1 cinder-volume[134747]: WARNING py.warnings [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Mar 05 20:51:35.306829 ncdv-master-1 cinder-volume[134747]: debtcollector.deprecate( Mar 05 20:51:35.306829 ncdv-master-1 cinder-volume[134747]: Mar 05 20:51:35.307888 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:51:35.500118 ncdv-master-1 sudo[145015]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph Mar 05 20:51:35.501831 ncdv-master-1 sudo[145015]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 05 20:51:35.678386 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-98a1ed23-3904-44a1-a960-cc21b41f837e req-30003ea5-5a49-4589-ac9a-15c27645b84a tempest-AttachSCSIVolumeTestJSON-1365107399 None] attachment_update completed successfully. Mar 05 20:51:37.072284 ncdv-master-1 sudo[145015]: pam_unix(sudo:session): session closed for user root Mar 05 20:51:37.075298 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph" returned: 0 in 1.767s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:51:37.077557 ncdv-master-1 cinder-volume[134747]: WARNING py.warnings [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Mar 05 20:51:37.077557 ncdv-master-1 cinder-volume[134747]: debtcollector.deprecate( Mar 05 20:51:37.077557 ncdv-master-1 cinder-volume[134747]: Mar 05 20:51:37.078901 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.image_utils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] 81837c2f-28ec-46e4-b5d6-afa9c9233d80 was vhdx, converting to raw {{(pid=134747) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Mar 05 20:51:37.080809 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp8p1kzywj {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:51:37.108410 ncdv-master-1 sudo[145032]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp8p1kzywj Mar 05 20:51:37.109831 ncdv-master-1 sudo[145032]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 05 20:51:38.833619 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:51:38.845178 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:51:38.850042 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:51:38.923730 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Flow 'volume_create_manager' (8127ddf9-cc23-4bd9-a4b0-a284ce81a14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:51:38.942917 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c49c7f-61f8-4777-9fc5-88af74aa454d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:38.960504 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:51:38.998113 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c49c7f-61f8-4777-9fc5-88af74aa454d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-587182359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aca05eb4-9fe7-4bea-b42f-f6cab7112098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68ef6fdcc64421f8fb6f1d147edea70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:51:39Z,use_quota=True,user_id='f77d65eda4a24df3bc38b9920f99f2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:39.013971 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66219d1b-096c-4fc6-8db9-8b8b1da0377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:39.018805 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66219d1b-096c-4fc6-8db9-8b8b1da0377a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:39.024996 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56933f03-713c-4f26-bd37-c97bff525132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:39.030369 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56933f03-713c-4f26-bd37-c97bff525132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aca05eb4-9fe7-4bea-b42f-f6cab7112098', 'volume_name': 'volume-aca05eb4-9fe7-4bea-b42f-f6cab7112098', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:39.038364 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700e35af-f396-4978-9dbe-e4b03494e122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:39.043319 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700e35af-f396-4978-9dbe-e4b03494e122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:39.052500 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7decbd46-3b84-49a4-ad8e-a408a0569ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:39.060776 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Volume aca05eb4-9fe7-4bea-b42f-f6cab7112098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aca05eb4-9fe7-4bea-b42f-f6cab7112098', 'volume_size': 1} Mar 05 20:51:39.061658 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] creating volume 'volume-aca05eb4-9fe7-4bea-b42f-f6cab7112098' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:51:39.063075 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:39.199866 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:51:39.200584 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:51:39.205152 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7decbd46-3b84-49a4-ad8e-a408a0569ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aca05eb4-9fe7-4bea-b42f-f6cab7112098', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:39.215797 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3d20d6-2fb2-4847-bd7f-b6826f1b7070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:39.234939 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Volume volume-aca05eb4-9fe7-4bea-b42f-f6cab7112098 (aca05eb4-9fe7-4bea-b42f-f6cab7112098): created successfully Mar 05 20:51:39.239702 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3d20d6-2fb2-4847-bd7f-b6826f1b7070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:39.255269 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Flow 'volume_create_manager' (8127ddf9-cc23-4bd9-a4b0-a284ce81a14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:51:39.275932 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-e5d8837d-565c-4c0c-9839-bf07b3ffa628 tempest-VolumesAdminNegativeTest-945551508 None] Created volume successfully. Mar 05 20:51:40.823658 ncdv-master-1 sudo[145032]: pam_unix(sudo:session): session closed for user root Mar 05 20:51:40.826097 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp8p1kzywj" returned: 0 in 3.746s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:51:40.827208 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:51:41.189598 ncdv-master-1 sudo[145085]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph Mar 05 20:51:41.195933 ncdv-master-1 sudo[145085]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 05 20:51:41.448689 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-9f53e604-58b8-4b70-8c88-d489d5ed83b0 req-439133a3-fbbf-4540-b989-f8d4050154fd tempest-VolumesAdminNegativeTest-945551508 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:51:42.598425 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-fd9314d6-86af-40d1-a17f-a81d0e873b81 req-2e5a7dea-9b40-48ef-8605-4f111463ab08 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Terminate volume connection completed successfully. Mar 05 20:51:42.599032 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-fd9314d6-86af-40d1-a17f-a81d0e873b81 req-2e5a7dea-9b40-48ef-8605-4f111463ab08 tempest-AttachSCSIVolumeTestJSON-1365107399 None] Deleting attachment a24a8b4d-809c-41c4-90bd-dbe3d230d42f. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 20:51:42.949245 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-9f53e604-58b8-4b70-8c88-d489d5ed83b0 req-439133a3-fbbf-4540-b989-f8d4050154fd tempest-VolumesAdminNegativeTest-945551508 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.501s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:51:42.949931 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-9f53e604-58b8-4b70-8c88-d489d5ed83b0 req-439133a3-fbbf-4540-b989-f8d4050154fd tempest-VolumesAdminNegativeTest-945551508 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aca05eb4-9fe7-4bea-b42f-f6cab7112098', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'aca05eb4-9fe7-4bea-b42f-f6cab7112098', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:51:43.018643 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-9f53e604-58b8-4b70-8c88-d489d5ed83b0 req-439133a3-fbbf-4540-b989-f8d4050154fd tempest-VolumesAdminNegativeTest-945551508 None] Connection info returned from driver {'name': 'volumes/volume-aca05eb4-9fe7-4bea-b42f-f6cab7112098', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'aca05eb4-9fe7-4bea-b42f-f6cab7112098', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4afe6863-8204-40d6-a8c5-c75b7ae14a37'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 20:51:43.128643 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-9f53e604-58b8-4b70-8c88-d489d5ed83b0 req-439133a3-fbbf-4540-b989-f8d4050154fd tempest-VolumesAdminNegativeTest-945551508 None] attachment_update completed successfully. Mar 05 20:51:44.267146 ncdv-master-1 sudo[145085]: pam_unix(sudo:session): session closed for user root Mar 05 20:51:44.268920 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph" returned: 0 in 3.442s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:51:44.269744 ncdv-master-1 cinder-volume[134747]: WARNING py.warnings [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Mar 05 20:51:44.269744 ncdv-master-1 cinder-volume[134747]: debtcollector.deprecate( Mar 05 20:51:44.269744 ncdv-master-1 cinder-volume[134747]: Mar 05 20:51:44.271155 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.image_utils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_81837c2f-28ec-46e4-b5d6-afa9c9233d80_hfu8mugcncdv-master-1@ceph, size 700.00 MB, duration 3.75 sec, destination /opt/stack/data/cinder/conversion/tmp8p1kzywj {{(pid=134747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Mar 05 20:51:44.271856 ncdv-master-1 cinder-volume[134747]: INFO cinder.image.image_utils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Converted 700.00 MB image at 186.83 MB/s Mar 05 20:51:44.273478 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:44.390552 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:51:44.402423 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:51:44.421127 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] deleting rbd volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:51:44.937397 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp8p1kzywj volume-7fab029c-6104-4f67-a93d-5c93dbea922a --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:51:45.538986 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:51:45.541974 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:45.610049 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:45.713912 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:51:48.993926 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-41292ba0-c9f1-4330-b1c9-40f8aebdd0d3 req-59ebc2b8-7214-4061-ac78-f6f5395fab88 tempest-VolumesAdminNegativeTest-945551508 None] Terminate volume connection completed successfully. Mar 05 20:51:48.995377 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-41292ba0-c9f1-4330-b1c9-40f8aebdd0d3 req-59ebc2b8-7214-4061-ac78-f6f5395fab88 tempest-VolumesAdminNegativeTest-945551508 None] Deleting attachment 4afe6863-8204-40d6-a8c5-c75b7ae14a37. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 20:51:50.142825 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp8p1kzywj volume-7fab029c-6104-4f67-a93d-5c93dbea922a --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 5.205s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:51:50.402522 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:50.578280 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:51:50.578677 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:51:50.579126 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Downloaded image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 ((None, None)) to volume 7fab029c-6104-4f67-a93d-5c93dbea922a successfully. {{(pid=134747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1218}} Mar 05 20:51:50.741980 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.image_utils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Temporary image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 for user e33c3ba3d26c4664a622711cad0381a9 is deleted. {{(pid=134747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Mar 05 20:51:50.913742 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Mar 05 20:51:50.916902 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Mar 05 20:51:51.139237 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:51:51.145367 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:51:51.151092 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:51:51.205315 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Flow 'volume_create_manager' (72672b09-a272-4166-9455-4a58062bb7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:51:51.226661 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f9eb94-9c1b-400a-9551-e50215914ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:51.237162 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Created reservations ['57eaa6ab-e1b4-498c-9c9f-029ad85b386b', '1326b1af-47dd-4fd8-968e-7d7e724aa613', 'cdc8578f-bf37-4dd3-81db-496cf94a982c', '095d3639-e0f8-416e-82a0-969b1c2e8639'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:51:51.245138 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:51:51.304117 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f9eb94-9c1b-400a-9551-e50215914ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1275105678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=98bf6158-49f4-41f1-9680-d8c0ce09efcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68ef6fdcc64421f8fb6f1d147edea70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:51:51Z,use_quota=True,user_id='f77d65eda4a24df3bc38b9920f99f2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:51.342823 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51e0362-40e7-4469-997f-5dba16d4878d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:51.366005 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51e0362-40e7-4469-997f-5dba16d4878d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:51.401880 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c387fa-1ce1-480d-a2eb-ae41e49468c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:51.420903 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c387fa-1ce1-480d-a2eb-ae41e49468c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98bf6158-49f4-41f1-9680-d8c0ce09efcc', 'volume_name': 'volume-98bf6158-49f4-41f1-9680-d8c0ce09efcc', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:51.441818 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378f7a89-0646-4ce6-a549-a72450328a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:51.448804 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378f7a89-0646-4ce6-a549-a72450328a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:51.488434 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d045235-2df0-4f1d-9a1c-fe2a162c42c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:51.493278 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Volume 98bf6158-49f4-41f1-9680-d8c0ce09efcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98bf6158-49f4-41f1-9680-d8c0ce09efcc', 'volume_size': 1} Mar 05 20:51:51.498369 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] creating volume 'volume-98bf6158-49f4-41f1-9680-d8c0ce09efcc' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:51:51.502383 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:51.624885 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Creating image volume entry: {'provider_auth': None, 'deleted_at': None, 'metadata': {}, 'provider_location': None, 'volume_metadata': [], 'multiattach': False, 'terminated_at': None, 'updated_at': datetime.datetime(2022, 3, 5, 20, 51, 8, tzinfo=datetime.timezone.utc), 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'volume_type_id': 'ee328ec7-af7d-4a65-bc9b-e206ed8623bd', 'created_at': datetime.datetime(2022, 3, 5, 20, 51, 7, tzinfo=datetime.timezone.utc), 'cluster_name': None, 'availability_zone': 'nova', 'display_description': None, 'volume_admin_metadata': [], 'launched_at': None, 'scheduled_at': datetime.datetime(2022, 3, 5, 20, 51, 8, tzinfo=datetime.timezone.utc), 'previous_status': None, 'project_id': '87292ea496944da4a7e67ecf8e0eaa0c', 'replication_extended_status': None, 'display_name': 'image-81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'encryption_key_id': None, 'provider_geometry': None, 'replication_status': None, 'size': 1, 'shared_targets': True, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'host': 'ncdv-master-1@ceph#ceph', 'bootable': False, 'deleted': False, 'provider_id': None, 'consistencygroup_id': None, 'service_uuid': None, 'ec2_id': None, 'group_id': None, 'replication_driver_data': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '7fab029c-6104-4f67-a93d-5c93dbea922a'}. {{(pid=134747) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1614}} Mar 05 20:51:51.782279 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:51:51.782672 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:51:51.794857 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d045235-2df0-4f1d-9a1c-fe2a162c42c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98bf6158-49f4-41f1-9680-d8c0ce09efcc', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:51.812992 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c83375-e028-4b7c-a44d-cec4f54f4082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:51.863878 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Volume volume-98bf6158-49f4-41f1-9680-d8c0ce09efcc (98bf6158-49f4-41f1-9680-d8c0ce09efcc): created successfully Mar 05 20:51:51.875104 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c83375-e028-4b7c-a44d-cec4f54f4082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:51.903683 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Flow 'volume_create_manager' (72672b09-a272-4166-9455-4a58062bb7d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:51:51.930901 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Volume reschedule parameters: False retry: None {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:51:51.938054 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:51:51.938525 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:51:52.007562 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Flow 'volume_create_manager' (88ac6998-1b0b-41d1-b5b2-2fee1338d675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:51:52.023627 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb8f269-54f6-4a00-b6c1-be1bc67b4ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:52.037862 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6c5a263d-effd-4fbb-9e91-7478c9e4e21d tempest-VolumesAdminNegativeTest-945551508 None] Created volume successfully. Mar 05 20:51:52.069356 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-f0e23536-2155-48ba-bd89-c463f5a0896a tempest-AttachSCSIVolumeTestJSON-1365107399 None] Lock "b'cinder-0c57b554-8684-4f09-a946-2caa95d79937-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:51:52.082448 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:51:52.157018 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb8f269-54f6-4a00-b6c1-be1bc67b4ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='image-81837c2f-28ec-46e4-b5d6-afa9c9233d80',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=799c53fd-91d0-4ee8-90fa-05a07a3b1df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87292ea496944da4a7e67ecf8e0eaa0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7fab029c-6104-4f67-a93d-5c93dbea922a,status='creating',terminated_at=None,updated_at=2022-03-05T20:51:08Z,use_quota=True,user_id='e33c3ba3d26c4664a622711cad0381a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:52.172101 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb44913-7171-4cdc-8a11-cde261460266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:52.179585 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb44913-7171-4cdc-8a11-cde261460266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:52.198597 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab2769d-68a4-4bb4-af36-8b40a27c367b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:52.263038 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f0e23536-2155-48ba-bd89-c463f5a0896a tempest-AttachSCSIVolumeTestJSON-1365107399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:52.381270 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f0e23536-2155-48ba-bd89-c463f5a0896a tempest-AttachSCSIVolumeTestJSON-1365107399 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:51:52.382591 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f0e23536-2155-48ba-bd89-c463f5a0896a tempest-AttachSCSIVolumeTestJSON-1365107399 None] Volume volume-0c57b554-8684-4f09-a946-2caa95d79937 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:51:52.396287 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f0e23536-2155-48ba-bd89-c463f5a0896a tempest-AttachSCSIVolumeTestJSON-1365107399 None] deleting rbd volume volume-0c57b554-8684-4f09-a946-2caa95d79937 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:51:52.414365 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab2769d-68a4-4bb4-af36-8b40a27c367b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'volume_name': 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'volume_size': 1, 'source_volid': '7fab029c-6104-4f67-a93d-5c93dbea922a', 'source_volstatus': 'downloading'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:52.422447 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4784d2-4f37-4b9d-9850-ddfaf009a415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:52.427574 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4784d2-4f37-4b9d-9850-ddfaf009a415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:52.433240 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44aba12e-5ccd-4656-babd-64501c53ee07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:52.434798 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'volume_size': 1, 'source_volid': '7fab029c-6104-4f67-a93d-5c93dbea922a', 'source_volstatus': 'downloading'} Mar 05 20:51:52.478854 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:52.570916 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] creating snapshot='volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 20:51:53.681785 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] cloning 'volume-7fab029c-6104-4f67-a93d-5c93dbea922a@volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7.clone_snap' to 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 20:51:53.693286 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-f8dc8b20-cedf-4fe3-b109-080c41e84df9 tempest-VolumesAdminNegativeTest-945551508 None] Lock "b'cinder-98bf6158-49f4-41f1-9680-d8c0ce09efcc-delete_volume'" acquired by "delete_volume" :: waited 1.444s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:51:53.852026 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f8dc8b20-cedf-4fe3-b109-080c41e84df9 tempest-VolumesAdminNegativeTest-945551508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:53.958561 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f8dc8b20-cedf-4fe3-b109-080c41e84df9 tempest-VolumesAdminNegativeTest-945551508 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:51:53.964261 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f8dc8b20-cedf-4fe3-b109-080c41e84df9 tempest-VolumesAdminNegativeTest-945551508 None] Volume volume-98bf6158-49f4-41f1-9680-d8c0ce09efcc is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:51:53.972096 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f8dc8b20-cedf-4fe3-b109-080c41e84df9 tempest-VolumesAdminNegativeTest-945551508 None] deleting rbd volume volume-98bf6158-49f4-41f1-9680-d8c0ce09efcc {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:51:53.989208 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:51:53.990421 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:51:53.990896 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:51:54.020147 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 20:51:54.024968 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44aba12e-5ccd-4656-babd-64501c53ee07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'volume_size': 1, 'source_volid': '7fab029c-6104-4f67-a93d-5c93dbea922a', 'source_volstatus': 'downloading'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:54.036190 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eec7b81-a248-4aa9-84b0-ddcd276bb4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:54.053173 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Volume volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7 (799c53fd-91d0-4ee8-90fa-05a07a3b1df7): created successfully Mar 05 20:51:54.057246 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eec7b81-a248-4aa9-84b0-ddcd276bb4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:54.063970 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Flow 'volume_create_manager' (88ac6998-1b0b-41d1-b5b2-2fee1338d675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:51:54.081523 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Created volume successfully. Mar 05 20:51:54.088204 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-f0e23536-2155-48ba-bd89-c463f5a0896a tempest-AttachSCSIVolumeTestJSON-1365107399 None] Created reservations ['0059a0a1-08e0-423f-983b-675ebd1596ff', 'e06fe0da-9233-4439-8ea5-a3910215f61b', '538750db-f587-48c6-955f-7521aa34feca', '1eec59f1-7858-4e5e-a619-622dbce52305'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:51:54.189367 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Creating new image-volume cache entry for image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on ncdv-master-1@ceph#ceph {{(pid=134747) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Mar 05 20:51:54.203538 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] New image-volume cache entry created: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 20, 51, 54, 193193)}. {{(pid=134747) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Mar 05 20:51:54.217570 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 45.753s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:51:54.217570 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Marking volume 7fab029c-6104-4f67-a93d-5c93dbea922a as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 20:51:54.240979 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f0e23536-2155-48ba-bd89-c463f5a0896a tempest-AttachSCSIVolumeTestJSON-1365107399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:54.313453 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f0e23536-2155-48ba-bd89-c463f5a0896a tempest-AttachSCSIVolumeTestJSON-1365107399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:54.364368 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-f0e23536-2155-48ba-bd89-c463f5a0896a tempest-AttachSCSIVolumeTestJSON-1365107399 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:51:54.371978 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to 7fab029c-6104-4f67-a93d-5c93dbea922a. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 20:51:54.373830 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Creating volume glance metadata for volume 7fab029c-6104-4f67-a93d-5c93dbea922a backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 20:51:54.377262 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f0e23536-2155-48ba-bd89-c463f5a0896a tempest-AttachSCSIVolumeTestJSON-1365107399 None] Deleted volume successfully. Mar 05 20:51:54.424695 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-f0e23536-2155-48ba-bd89-c463f5a0896a tempest-AttachSCSIVolumeTestJSON-1365107399 None] Lock "b'cinder-0c57b554-8684-4f09-a946-2caa95d79937-delete_volume'" released by "delete_volume" :: held 2.358s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:51:54.468792 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-f8dc8b20-cedf-4fe3-b109-080c41e84df9 tempest-VolumesAdminNegativeTest-945551508 None] Created reservations ['8276204b-5bd2-4d42-8747-9112b45a60ae', '002837e6-6bcc-48f0-91f4-8a5d69af68a1', '19090d29-5a67-459a-a700-06b162179b0d', 'a3522d34-c1f7-4a5a-876f-c3cec209e02f'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:51:54.594280 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f8dc8b20-cedf-4fe3-b109-080c41e84df9 tempest-VolumesAdminNegativeTest-945551508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:54.647380 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f8dc8b20-cedf-4fe3-b109-080c41e84df9 tempest-VolumesAdminNegativeTest-945551508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:54.691585 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-f8dc8b20-cedf-4fe3-b109-080c41e84df9 tempest-VolumesAdminNegativeTest-945551508 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:51:54.697286 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f8dc8b20-cedf-4fe3-b109-080c41e84df9 tempest-VolumesAdminNegativeTest-945551508 None] Deleted volume successfully. Mar 05 20:51:54.719102 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f70212-1e05-4327-bddf-466eac522627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fab029c-6104-4f67-a93d-5c93dbea922a', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:54.724169 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c31e54-4f52-474a-9508-f4e363ecbb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:51:54.730234 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-f8dc8b20-cedf-4fe3-b109-080c41e84df9 tempest-VolumesAdminNegativeTest-945551508 None] Lock "b'cinder-98bf6158-49f4-41f1-9680-d8c0ce09efcc-delete_volume'" released by "delete_volume" :: held 1.046s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:51:54.739418 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a (7fab029c-6104-4f67-a93d-5c93dbea922a): created successfully Mar 05 20:51:54.744419 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c31e54-4f52-474a-9508-f4e363ecbb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:51:54.756736 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Flow 'volume_create_manager' (22fb2547-79ad-4d6c-9afe-5ca20a72b7c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:51:54.771174 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-e1043239-c8b0-4448-89ac-645da8f58a16 tempest-ServersTestBootFromVolume-72971512 None] Created volume successfully. Mar 05 20:51:55.616633 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-abdeef3a-9abf-4821-b0c4-b1ad78f19400 tempest-VolumesAdminNegativeTest-945551508 None] Lock "b'cinder-aca05eb4-9fe7-4bea-b42f-f6cab7112098-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:51:55.708959 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-abdeef3a-9abf-4821-b0c4-b1ad78f19400 tempest-VolumesAdminNegativeTest-945551508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:55.794061 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-abdeef3a-9abf-4821-b0c4-b1ad78f19400 tempest-VolumesAdminNegativeTest-945551508 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:51:55.794545 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-abdeef3a-9abf-4821-b0c4-b1ad78f19400 tempest-VolumesAdminNegativeTest-945551508 None] Volume volume-aca05eb4-9fe7-4bea-b42f-f6cab7112098 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:51:55.804650 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-abdeef3a-9abf-4821-b0c4-b1ad78f19400 tempest-VolumesAdminNegativeTest-945551508 None] deleting rbd volume volume-aca05eb4-9fe7-4bea-b42f-f6cab7112098 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:51:56.234195 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-abdeef3a-9abf-4821-b0c4-b1ad78f19400 tempest-VolumesAdminNegativeTest-945551508 None] Created reservations ['b8056376-0ddb-4582-8910-e13ff95170d4', '0d9db380-7b13-44ed-9b13-ffefba582155', '225165a6-7098-4512-a94f-587166f3f366', 'b9f9f6dc-4132-498f-93bf-fb1b85fb9deb'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:51:56.367653 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-abdeef3a-9abf-4821-b0c4-b1ad78f19400 tempest-VolumesAdminNegativeTest-945551508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:56.456719 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-abdeef3a-9abf-4821-b0c4-b1ad78f19400 tempest-VolumesAdminNegativeTest-945551508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:51:56.547189 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-abdeef3a-9abf-4821-b0c4-b1ad78f19400 tempest-VolumesAdminNegativeTest-945551508 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:51:56.552601 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-abdeef3a-9abf-4821-b0c4-b1ad78f19400 tempest-VolumesAdminNegativeTest-945551508 None] Deleted volume successfully. Mar 05 20:51:56.573477 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-abdeef3a-9abf-4821-b0c4-b1ad78f19400 tempest-VolumesAdminNegativeTest-945551508 None] Lock "b'cinder-aca05eb4-9fe7-4bea-b42f-f6cab7112098-delete_volume'" released by "delete_volume" :: held 0.958s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:52:01.166462 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-5e65a327-ee11-433a-8fcd-71baf57fc4bf req-cc3a4df0-fb57-4b56-9e5c-efff702a5030 tempest-ServersTestBootFromVolume-72971512 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:52:03.060973 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-5e65a327-ee11-433a-8fcd-71baf57fc4bf req-cc3a4df0-fb57-4b56-9e5c-efff702a5030 tempest-ServersTestBootFromVolume-72971512 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.894s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:52:03.062534 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-5e65a327-ee11-433a-8fcd-71baf57fc4bf req-cc3a4df0-fb57-4b56-9e5c-efff702a5030 tempest-ServersTestBootFromVolume-72971512 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7fab029c-6104-4f67-a93d-5c93dbea922a', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '7fab029c-6104-4f67-a93d-5c93dbea922a', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:52:03.110053 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-5e65a327-ee11-433a-8fcd-71baf57fc4bf req-cc3a4df0-fb57-4b56-9e5c-efff702a5030 tempest-ServersTestBootFromVolume-72971512 None] Connection info returned from driver {'name': 'volumes/volume-7fab029c-6104-4f67-a93d-5c93dbea922a', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7fab029c-6104-4f67-a93d-5c93dbea922a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9ad6f1a0-e736-4a91-b94f-55d6d58da0e5'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 20:52:03.270925 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-5e65a327-ee11-433a-8fcd-71baf57fc4bf req-cc3a4df0-fb57-4b56-9e5c-efff702a5030 tempest-ServersTestBootFromVolume-72971512 None] attachment_update completed successfully. Mar 05 20:52:45.540742 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:52:45.541633 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:52:45.591488 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:52:45.657584 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:52:49.604274 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:52:49.616690 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:52:49.617457 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:52:49.648657 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Flow 'volume_create_manager' (097b4385-a0cc-4c7f-bcde-929c1d73765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:52:49.660116 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec35f1e-4605-4092-9976-56a63cf9b4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:49.671563 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:52:49.690478 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec35f1e-4605-4092-9976-56a63cf9b4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1717533841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15a5d639338454c90a7ce959e996284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:52:50Z,use_quota=True,user_id='4028a85798ff4ea88a0aa32b944010a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:49.699743 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8743e8ff-8af0-4e0f-bdac-8b524611f622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:49.715295 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8743e8ff-8af0-4e0f-bdac-8b524611f622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:49.725016 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b221352-b61b-4070-bd98-20781863b243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:49.855294 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b221352-b61b-4070-bd98-20781863b243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e', 'volume_name': 'volume-f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:49.862989 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba2ee57-b6af-4ba3-ac66-e0accdd5c919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:49.869386 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba2ee57-b6af-4ba3-ac66-e0accdd5c919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:49.875256 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d251205-e118-4f45-8c2d-e544261f27e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:49.877891 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Volume f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 20:52:49.878774 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Cloning f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 20:52:49.895403 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:52:49.918421 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 20, 52, 49, 903039)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 20:52:49.919310 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 20:52:49.919768 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Found cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 05 20:52:49.935620 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 0.041s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:52:49.937813 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 20:52:49.956840 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 20, 52, 49, 951239)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 20:52:49.958875 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 20:52:49.961674 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Creating from source image-volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7 {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 05 20:52:49.977970 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:52:50.092699 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] creating snapshot='volume-f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 20:52:50.621599 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] cloning 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7@volume-f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e.clone_snap' to 'volume-f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 20:52:50.891088 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:52:50.892400 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:52:50.893087 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:52:50.972493 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 20:52:50.973149 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Marking volume f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 20:52:50.996879 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 20:52:50.997791 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Creating volume glance metadata for volume f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 20:52:51.093355 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d251205-e118-4f45-8c2d-e544261f27e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:51.111500 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea9b44e-75b0-4e3e-808e-9fffc77d4f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:51.130449 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Volume volume-f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e (f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e): created successfully Mar 05 20:52:51.135073 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea9b44e-75b0-4e3e-808e-9fffc77d4f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:51.144800 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Flow 'volume_create_manager' (097b4385-a0cc-4c7f-bcde-929c1d73765e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:52:51.176331 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-60f2951f-767b-4554-9672-ab4b189b791f tempest-TaggedBootDevicesTest-602522751 None] Created volume successfully. Mar 05 20:52:52.443426 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:52:52.449554 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:52:52.450470 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:52:52.472580 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Flow 'volume_create_manager' (b0dafc61-6f47-4de7-994a-a7b5bb5f4ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:52:52.480254 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38db642-8ede-4538-817a-997dadbcb8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:52.489822 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:52:52.510537 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38db642-8ede-4538-817a-997dadbcb8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1744629544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=218d7dc8-d08f-48dd-8791-4cb639216b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15a5d639338454c90a7ce959e996284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:52:52Z,use_quota=True,user_id='4028a85798ff4ea88a0aa32b944010a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:52.521558 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfd278a-f005-436a-9bef-4886cb1b80df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:52.533968 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfd278a-f005-436a-9bef-4886cb1b80df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:52.555475 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c73e874-b311-4634-842e-597647c8d26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:52.560591 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c73e874-b311-4634-842e-597647c8d26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '218d7dc8-d08f-48dd-8791-4cb639216b6b', 'volume_name': 'volume-218d7dc8-d08f-48dd-8791-4cb639216b6b', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:52.565652 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffde263f-53b3-4870-a300-9047059e66e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:52.569727 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffde263f-53b3-4870-a300-9047059e66e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:52.581471 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ccf3d6-e17b-4e2e-925e-12ab3d841a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:52.582882 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Volume 218d7dc8-d08f-48dd-8791-4cb639216b6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-218d7dc8-d08f-48dd-8791-4cb639216b6b', 'volume_size': 1} Mar 05 20:52:52.584390 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] creating volume 'volume-218d7dc8-d08f-48dd-8791-4cb639216b6b' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:52:52.585567 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:52:52.709924 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:52:52.711495 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:52:52.720722 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ccf3d6-e17b-4e2e-925e-12ab3d841a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-218d7dc8-d08f-48dd-8791-4cb639216b6b', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:52.728344 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5633f839-4717-4224-be72-3f4c2ec36d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:52.744116 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Volume volume-218d7dc8-d08f-48dd-8791-4cb639216b6b (218d7dc8-d08f-48dd-8791-4cb639216b6b): created successfully Mar 05 20:52:52.754944 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5633f839-4717-4224-be72-3f4c2ec36d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:52.772322 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Flow 'volume_create_manager' (b0dafc61-6f47-4de7-994a-a7b5bb5f4ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:52:52.787277 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c8226287-85be-41a9-b55d-4d1178df6dc1 tempest-TaggedBootDevicesTest-602522751 None] Created volume successfully. Mar 05 20:52:53.937496 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:52:53.952990 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:52:53.954461 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:52:53.981121 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Flow 'volume_create_manager' (502b389d-188e-4c7e-bfdd-2ac32348394f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:52:53.995849 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c104eaca-4c5d-4074-88cb-7db1823b1cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:54.007749 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:52:54.040900 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c104eaca-4c5d-4074-88cb-7db1823b1cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-649806385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8501e6cd-ef92-486c-9fd7-73be61906481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15a5d639338454c90a7ce959e996284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:52:54Z,use_quota=True,user_id='4028a85798ff4ea88a0aa32b944010a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:54.047507 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aebd0a1e-ecf9-4828-bb72-2f97e3da8756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:54.054755 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aebd0a1e-ecf9-4828-bb72-2f97e3da8756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:54.063982 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ddd8a0-89d1-4ab1-8e0f-75a9a7bbe2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:54.070649 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ddd8a0-89d1-4ab1-8e0f-75a9a7bbe2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8501e6cd-ef92-486c-9fd7-73be61906481', 'volume_name': 'volume-8501e6cd-ef92-486c-9fd7-73be61906481', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:54.084076 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3e4251-db14-4e2f-b162-722b4a82a093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:54.089138 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3e4251-db14-4e2f-b162-722b4a82a093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:54.097397 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6702f3c3-a7bd-42cd-9647-97bbddd0ffb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:54.098763 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Volume 8501e6cd-ef92-486c-9fd7-73be61906481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8501e6cd-ef92-486c-9fd7-73be61906481', 'volume_size': 1} Mar 05 20:52:54.105465 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] creating volume 'volume-8501e6cd-ef92-486c-9fd7-73be61906481' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:52:54.113272 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:52:54.242308 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:52:54.243390 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:52:54.249526 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6702f3c3-a7bd-42cd-9647-97bbddd0ffb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8501e6cd-ef92-486c-9fd7-73be61906481', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:54.263810 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e101f061-174a-4186-8afe-536382a0f610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:52:54.293193 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Volume volume-8501e6cd-ef92-486c-9fd7-73be61906481 (8501e6cd-ef92-486c-9fd7-73be61906481): created successfully Mar 05 20:52:54.299620 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e101f061-174a-4186-8afe-536382a0f610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:52:54.314302 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Flow 'volume_create_manager' (502b389d-188e-4c7e-bfdd-2ac32348394f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:52:54.342237 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ab41672c-93ba-4764-a569-114a24b03722 tempest-TaggedBootDevicesTest-602522751 None] Created volume successfully. Mar 05 20:53:26.111202 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d req-819d1a1a-46d5-4a4e-a5d7-972d940c30f0 tempest-TaggedBootDevicesTest-602522751 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:53:27.408760 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d req-819d1a1a-46d5-4a4e-a5d7-972d940c30f0 tempest-TaggedBootDevicesTest-602522751 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.297s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:53:27.410348 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d req-819d1a1a-46d5-4a4e-a5d7-972d940c30f0 tempest-TaggedBootDevicesTest-602522751 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:53:27.440266 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d req-819d1a1a-46d5-4a4e-a5d7-972d940c30f0 tempest-TaggedBootDevicesTest-602522751 None] Connection info returned from driver {'name': 'volumes/volume-f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e32b24e3-c109-4bd8-935d-8ebef4c0eb04'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 20:53:27.529225 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d req-819d1a1a-46d5-4a4e-a5d7-972d940c30f0 tempest-TaggedBootDevicesTest-602522751 None] attachment_update completed successfully. Mar 05 20:53:28.093111 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d req-7d15dc36-7a62-49a9-821a-82290989b5d9 tempest-TaggedBootDevicesTest-602522751 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:53:29.186257 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d req-7d15dc36-7a62-49a9-821a-82290989b5d9 tempest-TaggedBootDevicesTest-602522751 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.093s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:53:29.187255 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d req-7d15dc36-7a62-49a9-821a-82290989b5d9 tempest-TaggedBootDevicesTest-602522751 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-218d7dc8-d08f-48dd-8791-4cb639216b6b', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '218d7dc8-d08f-48dd-8791-4cb639216b6b', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:53:29.242769 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d req-7d15dc36-7a62-49a9-821a-82290989b5d9 tempest-TaggedBootDevicesTest-602522751 None] Connection info returned from driver {'name': 'volumes/volume-218d7dc8-d08f-48dd-8791-4cb639216b6b', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '218d7dc8-d08f-48dd-8791-4cb639216b6b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5fe88541-362c-45a7-a976-018e9227fd91'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 20:53:29.334317 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d req-7d15dc36-7a62-49a9-821a-82290989b5d9 tempest-TaggedBootDevicesTest-602522751 None] attachment_update completed successfully. Mar 05 20:53:29.882225 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d req-9ecbeaf8-5d45-456f-b0ca-b814bf8340e2 tempest-TaggedBootDevicesTest-602522751 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:53:31.271411 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d req-9ecbeaf8-5d45-456f-b0ca-b814bf8340e2 tempest-TaggedBootDevicesTest-602522751 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.390s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:53:31.273008 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d req-9ecbeaf8-5d45-456f-b0ca-b814bf8340e2 tempest-TaggedBootDevicesTest-602522751 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8501e6cd-ef92-486c-9fd7-73be61906481', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '8501e6cd-ef92-486c-9fd7-73be61906481', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:53:31.313903 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d req-9ecbeaf8-5d45-456f-b0ca-b814bf8340e2 tempest-TaggedBootDevicesTest-602522751 None] Connection info returned from driver {'name': 'volumes/volume-8501e6cd-ef92-486c-9fd7-73be61906481', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8501e6cd-ef92-486c-9fd7-73be61906481', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e3a59985-a8d6-4e89-b95f-0f4254245b63'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 20:53:31.404692 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d req-9ecbeaf8-5d45-456f-b0ca-b814bf8340e2 tempest-TaggedBootDevicesTest-602522751 None] attachment_update completed successfully. Mar 05 20:53:42.605634 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 req-1394f335-f5a3-42c1-8e57-34be7822b317 tempest-ServersTestBootFromVolume-72971512 None] Terminate volume connection completed successfully. Mar 05 20:53:42.606919 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 req-1394f335-f5a3-42c1-8e57-34be7822b317 tempest-ServersTestBootFromVolume-72971512 None] Deleting attachment 9ad6f1a0-e736-4a91-b94f-55d6d58da0e5. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 20:53:42.843617 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 req-c3764d04-015e-44dd-ad5e-3a7f26dab03f tempest-ServersTestBootFromVolume-72971512 None] Lock "b'cinder-7fab029c-6104-4f67-a93d-5c93dbea922a-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:53:42.918709 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 req-c3764d04-015e-44dd-ad5e-3a7f26dab03f tempest-ServersTestBootFromVolume-72971512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:53:43.005912 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 req-c3764d04-015e-44dd-ad5e-3a7f26dab03f tempest-ServersTestBootFromVolume-72971512 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:53:43.006231 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 req-c3764d04-015e-44dd-ad5e-3a7f26dab03f tempest-ServersTestBootFromVolume-72971512 None] volume has clone snapshot(s) {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1208}} Mar 05 20:53:43.007549 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 req-c3764d04-015e-44dd-ad5e-3a7f26dab03f tempest-ServersTestBootFromVolume-72971512 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:53:43.227574 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 req-c3764d04-015e-44dd-ad5e-3a7f26dab03f tempest-ServersTestBootFromVolume-72971512 None] Created reservations ['ed27f1fd-9c85-4289-ac15-ab1f8e393357', 'e9c5d018-518c-4f9d-92ff-ea4da99c6299', 'c4ecc9c5-d2ab-461b-8582-b09a463a1ec5', 'b102075c-9ed2-4d35-9780-aeb19aad70bf'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:53:43.357638 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 req-c3764d04-015e-44dd-ad5e-3a7f26dab03f tempest-ServersTestBootFromVolume-72971512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:53:43.445641 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 req-c3764d04-015e-44dd-ad5e-3a7f26dab03f tempest-ServersTestBootFromVolume-72971512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:53:43.524103 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 req-c3764d04-015e-44dd-ad5e-3a7f26dab03f tempest-ServersTestBootFromVolume-72971512 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:53:43.535309 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 req-c3764d04-015e-44dd-ad5e-3a7f26dab03f tempest-ServersTestBootFromVolume-72971512 None] Deleted volume successfully. Mar 05 20:53:43.563359 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 req-c3764d04-015e-44dd-ad5e-3a7f26dab03f tempest-ServersTestBootFromVolume-72971512 None] Lock "b'cinder-7fab029c-6104-4f67-a93d-5c93dbea922a-delete_volume'" released by "delete_volume" :: held 0.720s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:53:45.537101 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:53:45.538424 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:53:45.629445 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:53:45.692017 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:54:26.719607 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:54:26.726975 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:54:26.727561 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:54:26.770547 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Flow 'volume_create_manager' (91e537ff-d1b2-46d9-be33-04e74932b677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:54:26.790099 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4314f45-1ac8-487c-bd78-dca30c07e4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:26.806118 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:54:26.846702 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4314f45-1ac8-487c-bd78-dca30c07e4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-203008402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=26c79aaa-d9c1-41fc-9e06-a62b6b10fcec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa37ca4c9ac445f4ab3ab68f30b46d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:54:27Z,use_quota=True,user_id='33c2e3f240e04849be211c91e18234dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:26.867174 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7319544-3ed8-4b8c-8511-fffd0fa440b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:26.873794 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7319544-3ed8-4b8c-8511-fffd0fa440b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:26.880082 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cd0757-440f-4b83-bdf5-3236e5deddaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:26.887451 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cd0757-440f-4b83-bdf5-3236e5deddaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c79aaa-d9c1-41fc-9e06-a62b6b10fcec', 'volume_name': 'volume-26c79aaa-d9c1-41fc-9e06-a62b6b10fcec', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:26.896818 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99dcf30-2162-4b99-a8ba-f1bcc958d8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:26.923382 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99dcf30-2162-4b99-a8ba-f1bcc958d8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:26.929515 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600cd165-f14e-4e9c-a918-cf7c57aa4255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:26.931042 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Volume 26c79aaa-d9c1-41fc-9e06-a62b6b10fcec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c79aaa-d9c1-41fc-9e06-a62b6b10fcec', 'volume_size': 1} Mar 05 20:54:26.932848 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] creating volume 'volume-26c79aaa-d9c1-41fc-9e06-a62b6b10fcec' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:54:26.934301 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:54:27.081155 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:54:27.081648 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:54:27.090574 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600cd165-f14e-4e9c-a918-cf7c57aa4255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c79aaa-d9c1-41fc-9e06-a62b6b10fcec', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:27.115496 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0147d59f-437e-4d21-aef2-0fc82a7ad2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:27.142726 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Volume volume-26c79aaa-d9c1-41fc-9e06-a62b6b10fcec (26c79aaa-d9c1-41fc-9e06-a62b6b10fcec): created successfully Mar 05 20:54:27.146804 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0147d59f-437e-4d21-aef2-0fc82a7ad2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:27.157079 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Flow 'volume_create_manager' (91e537ff-d1b2-46d9-be33-04e74932b677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:54:27.171050 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-cb200d02-5bd0-401d-8dbd-86d498fd0a7b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Created volume successfully. Mar 05 20:54:29.574382 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-d7c7e935-81a0-4efd-8dcf-344e47fe6c47 req-ee36cf9d-9df8-43ba-90f6-54c79eacfc30 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:54:31.006019 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-d7c7e935-81a0-4efd-8dcf-344e47fe6c47 req-ee36cf9d-9df8-43ba-90f6-54c79eacfc30 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.431s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:54:31.007592 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-d7c7e935-81a0-4efd-8dcf-344e47fe6c47 req-ee36cf9d-9df8-43ba-90f6-54c79eacfc30 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-26c79aaa-d9c1-41fc-9e06-a62b6b10fcec', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '26c79aaa-d9c1-41fc-9e06-a62b6b10fcec', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:54:31.058092 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-d7c7e935-81a0-4efd-8dcf-344e47fe6c47 req-ee36cf9d-9df8-43ba-90f6-54c79eacfc30 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Connection info returned from driver {'name': 'volumes/volume-26c79aaa-d9c1-41fc-9e06-a62b6b10fcec', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '26c79aaa-d9c1-41fc-9e06-a62b6b10fcec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0afc1663-f46b-4c99-bb77-31f9de5ffd28'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 20:54:31.160514 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-d7c7e935-81a0-4efd-8dcf-344e47fe6c47 req-ee36cf9d-9df8-43ba-90f6-54c79eacfc30 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] attachment_update completed successfully. Mar 05 20:54:31.437814 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:54:31.460935 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:54:31.461856 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:54:31.501574 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Flow 'volume_create_manager' (68895717-4a22-4ea8-a3d5-60eb902c7e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:54:31.512110 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44b57ee-ce3b-4588-834d-2dc3183975f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:31.523333 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:54:31.543653 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44b57ee-ce3b-4588-834d-2dc3183975f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1882537974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d519473a-ef8a-409d-875f-13ff7f5365dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f7c0ead74544399a3e93bec3a2c1e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:54:31Z,use_quota=True,user_id='dcd74a1b34d248c2bc460357d82b70c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:31.550240 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b830e2-199d-483d-a927-e2cb9c7f09a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:31.555267 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b830e2-199d-483d-a927-e2cb9c7f09a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:31.562647 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1b1bf4-ca05-4808-9d1a-65b38ebfa6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:31.567895 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1b1bf4-ca05-4808-9d1a-65b38ebfa6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd519473a-ef8a-409d-875f-13ff7f5365dd', 'volume_name': 'volume-d519473a-ef8a-409d-875f-13ff7f5365dd', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:31.574917 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447cf337-cf4a-437f-b05f-40b4a279be3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:31.580010 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447cf337-cf4a-437f-b05f-40b4a279be3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:31.587616 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21daf435-3019-4fa2-be1e-a6c8a01dbd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:31.589249 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Volume d519473a-ef8a-409d-875f-13ff7f5365dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d519473a-ef8a-409d-875f-13ff7f5365dd', 'volume_size': 1} Mar 05 20:54:31.590363 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] creating volume 'volume-d519473a-ef8a-409d-875f-13ff7f5365dd' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:54:31.591763 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:54:31.718757 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:54:31.719562 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:54:31.727705 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21daf435-3019-4fa2-be1e-a6c8a01dbd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d519473a-ef8a-409d-875f-13ff7f5365dd', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:31.747273 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112b4f79-c658-4b37-9e41-4787cd1f2610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:31.763117 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Volume volume-d519473a-ef8a-409d-875f-13ff7f5365dd (d519473a-ef8a-409d-875f-13ff7f5365dd): created successfully Mar 05 20:54:31.767983 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112b4f79-c658-4b37-9e41-4787cd1f2610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:31.781279 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Flow 'volume_create_manager' (68895717-4a22-4ea8-a3d5-60eb902c7e48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:54:31.803126 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-75f6902c-aec7-41f7-b9b0-62d73e289fa2 tempest-VolumesTestJSON-2099402191 None] Created volume successfully. Mar 05 20:54:33.635009 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:54:33.642678 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:54:33.645637 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:54:33.710713 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Flow 'volume_create_manager' (5dd38855-14b8-4ca6-925b-3f8631756363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:54:33.723087 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c1d6f7-2ceb-4be5-87b6-77001321aea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:33.749913 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:54:33.786493 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c1d6f7-2ceb-4be5-87b6-77001321aea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-646755034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0c82cb15-d91f-4a2f-9541-5d18e0a29a66,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f7c0ead74544399a3e93bec3a2c1e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:54:34Z,use_quota=True,user_id='dcd74a1b34d248c2bc460357d82b70c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:33.798682 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a254f40-872d-482c-964a-1ab2fc211590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:33.809455 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a254f40-872d-482c-964a-1ab2fc211590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:33.829810 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa51e54b-b8a3-4c55-8e00-f922e1095c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:33.850487 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa51e54b-b8a3-4c55-8e00-f922e1095c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c82cb15-d91f-4a2f-9541-5d18e0a29a66', 'volume_name': 'volume-0c82cb15-d91f-4a2f-9541-5d18e0a29a66', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:33.872593 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33416e2f-c56d-4d65-89ab-77b319c22cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:33.899091 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33416e2f-c56d-4d65-89ab-77b319c22cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:33.931969 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95498d7b-cb10-4650-9d34-c21e94420267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:33.942956 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Volume 0c82cb15-d91f-4a2f-9541-5d18e0a29a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c82cb15-d91f-4a2f-9541-5d18e0a29a66', 'volume_size': 1} Mar 05 20:54:33.943369 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] creating volume 'volume-0c82cb15-d91f-4a2f-9541-5d18e0a29a66' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:54:33.944735 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:54:34.124491 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:54:34.125129 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:54:34.130717 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95498d7b-cb10-4650-9d34-c21e94420267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c82cb15-d91f-4a2f-9541-5d18e0a29a66', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:34.162533 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b777c9c3-bdf8-4440-98af-8e8ab741ef99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:34.214786 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Volume volume-0c82cb15-d91f-4a2f-9541-5d18e0a29a66 (0c82cb15-d91f-4a2f-9541-5d18e0a29a66): created successfully Mar 05 20:54:34.236180 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b777c9c3-bdf8-4440-98af-8e8ab741ef99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:34.263086 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Flow 'volume_create_manager' (5dd38855-14b8-4ca6-925b-3f8631756363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:54:34.279748 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-486dee8f-5215-4584-8965-529f1962ef7c tempest-VolumesTestJSON-2099402191 None] Created volume successfully. Mar 05 20:54:35.492106 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:54:35.506011 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:54:35.506771 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:54:35.561035 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Flow 'volume_create_manager' (aaae25ef-b33c-491b-b492-8338cf9fe7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:54:35.581885 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b864b24-b1d0-4e9e-83ec-a9a59cbf7e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:35.599906 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:54:35.650223 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b864b24-b1d0-4e9e-83ec-a9a59cbf7e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1417334043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5e6dcd4a-ad36-42e7-b580-9b60cc270591,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f7c0ead74544399a3e93bec3a2c1e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:54:35Z,use_quota=True,user_id='dcd74a1b34d248c2bc460357d82b70c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:35.669958 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdbcf5f-81f7-46ee-960f-aa9042eb572e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:35.687350 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdbcf5f-81f7-46ee-960f-aa9042eb572e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:35.724002 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2d434c-aa3e-460e-a5f9-ebe2a53fd5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:35.747873 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2d434c-aa3e-460e-a5f9-ebe2a53fd5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e6dcd4a-ad36-42e7-b580-9b60cc270591', 'volume_name': 'volume-5e6dcd4a-ad36-42e7-b580-9b60cc270591', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:35.764550 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5b979b-e9b7-4965-9f6c-eb777c3b2722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:35.775337 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5b979b-e9b7-4965-9f6c-eb777c3b2722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:35.795313 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674aceb9-6a0f-44a9-afeb-254e5cd0d5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:35.798200 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Volume 5e6dcd4a-ad36-42e7-b580-9b60cc270591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e6dcd4a-ad36-42e7-b580-9b60cc270591', 'volume_size': 1} Mar 05 20:54:35.798763 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] creating volume 'volume-5e6dcd4a-ad36-42e7-b580-9b60cc270591' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:54:35.802462 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:54:36.062634 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:54:36.063342 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:54:36.069352 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674aceb9-6a0f-44a9-afeb-254e5cd0d5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e6dcd4a-ad36-42e7-b580-9b60cc270591', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:36.091697 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3813c8a1-9ab6-468b-8bff-018819af98ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:54:36.135779 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Volume volume-5e6dcd4a-ad36-42e7-b580-9b60cc270591 (5e6dcd4a-ad36-42e7-b580-9b60cc270591): created successfully Mar 05 20:54:36.154930 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3813c8a1-9ab6-468b-8bff-018819af98ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:54:36.175380 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Flow 'volume_create_manager' (aaae25ef-b33c-491b-b492-8338cf9fe7ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:54:36.224446 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-1aa306ab-8372-405f-b401-6a30bee682b8 tempest-VolumesTestJSON-2099402191 None] Created volume successfully. Mar 05 20:54:42.736607 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 req-69012507-1c08-4865-a096-e1eb2cc0a133 tempest-LiveAutoBlockMigrationV225Test-1747675317 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:54:44.033541 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 req-69012507-1c08-4865-a096-e1eb2cc0a133 tempest-LiveAutoBlockMigrationV225Test-1747675317 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.297s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:54:44.035112 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 req-69012507-1c08-4865-a096-e1eb2cc0a133 tempest-LiveAutoBlockMigrationV225Test-1747675317 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-26c79aaa-d9c1-41fc-9e06-a62b6b10fcec', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '26c79aaa-d9c1-41fc-9e06-a62b6b10fcec', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:54:44.073620 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 req-69012507-1c08-4865-a096-e1eb2cc0a133 tempest-LiveAutoBlockMigrationV225Test-1747675317 None] Connection info returned from driver {'name': 'volumes/volume-26c79aaa-d9c1-41fc-9e06-a62b6b10fcec', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '26c79aaa-d9c1-41fc-9e06-a62b6b10fcec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '55e860b4-3c13-43df-8868-1f76955c7cd0'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 20:54:44.153805 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 req-69012507-1c08-4865-a096-e1eb2cc0a133 tempest-LiveAutoBlockMigrationV225Test-1747675317 None] attachment_update completed successfully. Mar 05 20:54:44.654519 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-382bfabe-435e-40d6-afee-11f19ae41b8b tempest-VolumesTestJSON-2099402191 None] Lock "b'cinder-5e6dcd4a-ad36-42e7-b580-9b60cc270591-delete_volume'" acquired by "delete_volume" :: waited 0.038s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:54:44.730538 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-382bfabe-435e-40d6-afee-11f19ae41b8b tempest-VolumesTestJSON-2099402191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:54:44.838698 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-382bfabe-435e-40d6-afee-11f19ae41b8b tempest-VolumesTestJSON-2099402191 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:54:44.839358 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-382bfabe-435e-40d6-afee-11f19ae41b8b tempest-VolumesTestJSON-2099402191 None] Volume volume-5e6dcd4a-ad36-42e7-b580-9b60cc270591 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:54:44.853462 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-382bfabe-435e-40d6-afee-11f19ae41b8b tempest-VolumesTestJSON-2099402191 None] deleting rbd volume volume-5e6dcd4a-ad36-42e7-b580-9b60cc270591 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:54:45.530655 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-382bfabe-435e-40d6-afee-11f19ae41b8b tempest-VolumesTestJSON-2099402191 None] Created reservations ['4a3d8084-2022-4881-89f1-fb8d293d87d7', 'df35cf88-0e09-414f-8a3f-2f5227591690', '1cea4237-0636-496f-8cab-fc317f73bd41', '74bc7f9d-b926-46bd-a40d-4f4bf56061e1'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:54:45.564825 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:54:45.569081 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:54:45.682172 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:54:45.796453 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:54:45.924921 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-382bfabe-435e-40d6-afee-11f19ae41b8b tempest-VolumesTestJSON-2099402191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:54:46.045314 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-382bfabe-435e-40d6-afee-11f19ae41b8b tempest-VolumesTestJSON-2099402191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:54:46.136416 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-382bfabe-435e-40d6-afee-11f19ae41b8b tempest-VolumesTestJSON-2099402191 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:54:46.142858 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-382bfabe-435e-40d6-afee-11f19ae41b8b tempest-VolumesTestJSON-2099402191 None] Deleted volume successfully. Mar 05 20:54:46.170185 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-382bfabe-435e-40d6-afee-11f19ae41b8b tempest-VolumesTestJSON-2099402191 None] Lock "b'cinder-5e6dcd4a-ad36-42e7-b580-9b60cc270591-delete_volume'" released by "delete_volume" :: held 1.515s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:54:46.176700 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-dfc6a69c-fbd3-4ab5-bec9-ba2923ab9ff2 tempest-VolumesTestJSON-2099402191 None] Lock "b'cinder-0c82cb15-d91f-4a2f-9541-5d18e0a29a66-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:54:46.228725 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-dfc6a69c-fbd3-4ab5-bec9-ba2923ab9ff2 tempest-VolumesTestJSON-2099402191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:54:46.338032 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-dfc6a69c-fbd3-4ab5-bec9-ba2923ab9ff2 tempest-VolumesTestJSON-2099402191 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:54:46.338461 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-dfc6a69c-fbd3-4ab5-bec9-ba2923ab9ff2 tempest-VolumesTestJSON-2099402191 None] Volume volume-0c82cb15-d91f-4a2f-9541-5d18e0a29a66 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:54:46.351025 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-dfc6a69c-fbd3-4ab5-bec9-ba2923ab9ff2 tempest-VolumesTestJSON-2099402191 None] deleting rbd volume volume-0c82cb15-d91f-4a2f-9541-5d18e0a29a66 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:54:46.865006 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-dfc6a69c-fbd3-4ab5-bec9-ba2923ab9ff2 tempest-VolumesTestJSON-2099402191 None] Created reservations ['97f5c7f8-02fb-42fb-8da3-8991e02b7389', '170f4dea-6028-41bd-adfd-6c46cd775eb4', '30d249b1-c7e8-47e1-9bfd-9d632fc2fa16', '4c0517db-f2b4-498b-b79b-89ee821b999c'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:54:47.074394 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-dfc6a69c-fbd3-4ab5-bec9-ba2923ab9ff2 tempest-VolumesTestJSON-2099402191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:54:47.193412 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-dfc6a69c-fbd3-4ab5-bec9-ba2923ab9ff2 tempest-VolumesTestJSON-2099402191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:54:47.321737 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-dfc6a69c-fbd3-4ab5-bec9-ba2923ab9ff2 tempest-VolumesTestJSON-2099402191 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:54:47.325954 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-dfc6a69c-fbd3-4ab5-bec9-ba2923ab9ff2 tempest-VolumesTestJSON-2099402191 None] Deleted volume successfully. Mar 05 20:54:47.351632 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-dfc6a69c-fbd3-4ab5-bec9-ba2923ab9ff2 tempest-VolumesTestJSON-2099402191 None] Lock "b'cinder-0c82cb15-d91f-4a2f-9541-5d18e0a29a66-delete_volume'" released by "delete_volume" :: held 1.174s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:54:47.406646 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-88e6ffa0-628b-42ae-9d51-0e7892c83fe5 tempest-VolumesTestJSON-2099402191 None] Lock "b'cinder-d519473a-ef8a-409d-875f-13ff7f5365dd-delete_volume'" acquired by "delete_volume" :: waited 0.038s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:54:47.529081 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-88e6ffa0-628b-42ae-9d51-0e7892c83fe5 tempest-VolumesTestJSON-2099402191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:54:47.651189 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-88e6ffa0-628b-42ae-9d51-0e7892c83fe5 tempest-VolumesTestJSON-2099402191 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:54:47.651605 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-88e6ffa0-628b-42ae-9d51-0e7892c83fe5 tempest-VolumesTestJSON-2099402191 None] Volume volume-d519473a-ef8a-409d-875f-13ff7f5365dd is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:54:47.661587 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-88e6ffa0-628b-42ae-9d51-0e7892c83fe5 tempest-VolumesTestJSON-2099402191 None] deleting rbd volume volume-d519473a-ef8a-409d-875f-13ff7f5365dd {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:54:48.326492 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-88e6ffa0-628b-42ae-9d51-0e7892c83fe5 tempest-VolumesTestJSON-2099402191 None] Created reservations ['4197f3f2-b5b3-4196-a8bc-dc1813805224', 'a823dd0b-d090-432a-9914-2641de9b25e1', '9cccb591-3ba2-4e80-ac86-e6d01009ad7c', 'b166fc81-64f7-4608-9bf7-9fd059668266'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:54:48.435732 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-88e6ffa0-628b-42ae-9d51-0e7892c83fe5 tempest-VolumesTestJSON-2099402191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:54:48.539892 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-88e6ffa0-628b-42ae-9d51-0e7892c83fe5 tempest-VolumesTestJSON-2099402191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:54:48.630728 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-88e6ffa0-628b-42ae-9d51-0e7892c83fe5 tempest-VolumesTestJSON-2099402191 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:54:48.636688 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-88e6ffa0-628b-42ae-9d51-0e7892c83fe5 tempest-VolumesTestJSON-2099402191 None] Deleted volume successfully. Mar 05 20:54:48.672212 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-88e6ffa0-628b-42ae-9d51-0e7892c83fe5 tempest-VolumesTestJSON-2099402191 None] Lock "b'cinder-d519473a-ef8a-409d-875f-13ff7f5365dd-delete_volume'" released by "delete_volume" :: held 1.255s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:54:55.716443 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 req-1d9afd9c-53fb-4017-98da-614b5f24c3e3 tempest-LiveAutoBlockMigrationV225Test-1747675317 None] Terminate volume connection completed successfully. Mar 05 20:54:55.717232 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 req-1d9afd9c-53fb-4017-98da-614b5f24c3e3 tempest-LiveAutoBlockMigrationV225Test-1747675317 None] Deleting attachment 0afc1663-f46b-4c99-bb77-31f9de5ffd28. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 20:55:03.234253 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-65eafae2-26db-40bc-8a3c-30f1091345c8 req-74fa684e-ad4b-4191-a066-554c41a2b24b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Terminate volume connection completed successfully. Mar 05 20:55:03.234988 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-65eafae2-26db-40bc-8a3c-30f1091345c8 req-74fa684e-ad4b-4191-a066-554c41a2b24b tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Deleting attachment 55e860b4-3c13-43df-8868-1f76955c7cd0. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 20:55:04.961110 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:55:04.967963 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:55:04.968444 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:55:04.997188 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Flow 'volume_create_manager' (4fa396e8-5887-4e5b-9882-362665dc0cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:55:05.004935 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0075ba-70d6-4d72-9f4c-d23c3f8fc3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:55:05.013835 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:55:05.036159 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0075ba-70d6-4d72-9f4c-d23c3f8fc3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2033666072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa37ca4c9ac445f4ab3ab68f30b46d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:55:05Z,use_quota=True,user_id='33c2e3f240e04849be211c91e18234dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:55:05.044367 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5606dd-4b8c-493d-b1b3-3bbaef496f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:55:05.049500 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5606dd-4b8c-493d-b1b3-3bbaef496f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:55:05.058403 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e213777-4070-445d-8891-5ee976d4bb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:55:05.271338 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e213777-4070-445d-8891-5ee976d4bb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e', 'volume_name': 'volume-7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:55:05.292023 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1bf18d-6edd-43b8-aee4-17a24e787c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:55:05.297332 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1bf18d-6edd-43b8-aee4-17a24e787c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:55:05.302366 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c312e7-a36a-4fec-a5a5-2d5cccb721f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:55:05.303661 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Volume 7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 20:55:05.304543 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Cloning 7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 20:55:05.317074 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:55:05.334524 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 20, 55, 5, 325408)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 20:55:05.335415 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 20:55:05.336354 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Found cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 05 20:55:05.343152 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 0.026s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:55:05.344009 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 20:55:05.354554 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 20, 55, 5, 349987)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 20:55:05.355604 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 20:55:05.356206 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Creating from source image-volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7 {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 05 20:55:05.372002 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:55:05.435828 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] creating snapshot='volume-7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 20:55:06.045293 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] cloning 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7@volume-7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e.clone_snap' to 'volume-7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 20:55:06.262192 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a.deleted is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:55:06.263536 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:55:06.264068 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:55:06.288998 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 20:55:06.290709 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Marking volume 7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 20:55:06.299384 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to 7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 20:55:06.300239 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Creating volume glance metadata for volume 7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 20:55:06.376041 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c312e7-a36a-4fec-a5a5-2d5cccb721f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:55:06.386840 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fea81ff-819d-4fa1-95f7-dc671a4b2da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:55:06.401678 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Volume volume-7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e (7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e): created successfully Mar 05 20:55:06.407090 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fea81ff-819d-4fa1-95f7-dc671a4b2da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:55:06.416132 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Flow 'volume_create_manager' (4fa396e8-5887-4e5b-9882-362665dc0cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:55:06.431082 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b87e3cc3-8b23-4472-bbdc-7e382a7ee625 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Created volume successfully. Mar 05 20:55:09.578213 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-083b1ef9-001f-4416-8696-9eefd8d7bf2a req-bc9b681a-c058-4f9d-8647-e7ce769a0d0c tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:55:10.630247 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-083b1ef9-001f-4416-8696-9eefd8d7bf2a req-bc9b681a-c058-4f9d-8647-e7ce769a0d0c tempest-LiveAutoBlockMigrationV225Test-1363872199 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.054s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:55:10.632219 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-083b1ef9-001f-4416-8696-9eefd8d7bf2a req-bc9b681a-c058-4f9d-8647-e7ce769a0d0c tempest-LiveAutoBlockMigrationV225Test-1363872199 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:55:10.679794 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-083b1ef9-001f-4416-8696-9eefd8d7bf2a req-bc9b681a-c058-4f9d-8647-e7ce769a0d0c tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Connection info returned from driver {'name': 'volumes/volume-7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4c4f2675-1827-462f-b441-6f0eacf13d91'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 20:55:10.768301 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-083b1ef9-001f-4416-8696-9eefd8d7bf2a req-bc9b681a-c058-4f9d-8647-e7ce769a0d0c tempest-LiveAutoBlockMigrationV225Test-1363872199 None] attachment_update completed successfully. Mar 05 20:55:36.231867 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-3af443ba-e30f-48be-a78a-b8d316790ebd req-d1d2918f-94cf-4b1a-8b1f-ca1d3fc2e89b tempest-LiveAutoBlockMigrationV225Test-1747675317 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:55:38.127724 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-3af443ba-e30f-48be-a78a-b8d316790ebd req-d1d2918f-94cf-4b1a-8b1f-ca1d3fc2e89b tempest-LiveAutoBlockMigrationV225Test-1747675317 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.897s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:55:38.128680 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-3af443ba-e30f-48be-a78a-b8d316790ebd req-d1d2918f-94cf-4b1a-8b1f-ca1d3fc2e89b tempest-LiveAutoBlockMigrationV225Test-1747675317 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:55:38.170436 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3af443ba-e30f-48be-a78a-b8d316790ebd req-d1d2918f-94cf-4b1a-8b1f-ca1d3fc2e89b tempest-LiveAutoBlockMigrationV225Test-1747675317 None] Connection info returned from driver {'name': 'volumes/volume-7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dbbeb7f4-0627-4cc6-b882-81730c238920'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 20:55:38.375962 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-3af443ba-e30f-48be-a78a-b8d316790ebd req-d1d2918f-94cf-4b1a-8b1f-ca1d3fc2e89b tempest-LiveAutoBlockMigrationV225Test-1747675317 None] attachment_update completed successfully. Mar 05 20:55:45.569586 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:55:45.572661 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:55:45.636756 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:55:45.670090 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:55:46.120884 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-3af443ba-e30f-48be-a78a-b8d316790ebd req-0e3e8fc4-cd20-4981-a836-9aa3c2a3ab76 tempest-LiveAutoBlockMigrationV225Test-1747675317 None] Terminate volume connection completed successfully. Mar 05 20:55:46.121342 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3af443ba-e30f-48be-a78a-b8d316790ebd req-0e3e8fc4-cd20-4981-a836-9aa3c2a3ab76 tempest-LiveAutoBlockMigrationV225Test-1747675317 None] Deleting attachment 4c4f2675-1827-462f-b441-6f0eacf13d91. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 20:55:55.494428 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-ec865a9c-779c-486e-b895-b976e08a3c49 req-7adffdfe-a23d-431f-8762-20a9ac0d1ec0 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Terminate volume connection completed successfully. Mar 05 20:55:55.495005 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ec865a9c-779c-486e-b895-b976e08a3c49 req-7adffdfe-a23d-431f-8762-20a9ac0d1ec0 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Deleting attachment dbbeb7f4-0627-4cc6-b882-81730c238920. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 20:55:55.746215 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-ec865a9c-779c-486e-b895-b976e08a3c49 req-37bdcc45-bfad-4d4f-b161-50b6794c2f17 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Lock "b'cinder-7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:55:55.842273 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-ec865a9c-779c-486e-b895-b976e08a3c49 req-37bdcc45-bfad-4d4f-b161-50b6794c2f17 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:55:55.997105 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-ec865a9c-779c-486e-b895-b976e08a3c49 req-37bdcc45-bfad-4d4f-b161-50b6794c2f17 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:55:56.015496 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-ec865a9c-779c-486e-b895-b976e08a3c49 req-37bdcc45-bfad-4d4f-b161-50b6794c2f17 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] deleting rbd volume volume-7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:55:56.529849 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-8ccec9c5-fe9f-4b89-9e2f-786c7ab738c2 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Lock "b'cinder-26c79aaa-d9c1-41fc-9e06-a62b6b10fcec-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:55:56.572949 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8ccec9c5-fe9f-4b89-9e2f-786c7ab738c2 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:55:56.660620 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8ccec9c5-fe9f-4b89-9e2f-786c7ab738c2 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:55:56.661139 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8ccec9c5-fe9f-4b89-9e2f-786c7ab738c2 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Volume volume-26c79aaa-d9c1-41fc-9e06-a62b6b10fcec is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:55:56.680591 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8ccec9c5-fe9f-4b89-9e2f-786c7ab738c2 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] deleting rbd volume volume-26c79aaa-d9c1-41fc-9e06-a62b6b10fcec {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:55:56.682687 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-ec865a9c-779c-486e-b895-b976e08a3c49 req-37bdcc45-bfad-4d4f-b161-50b6794c2f17 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 20:55:56.755430 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-ec865a9c-779c-486e-b895-b976e08a3c49 req-37bdcc45-bfad-4d4f-b161-50b6794c2f17 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] deleting parent snapshot volume-7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 20:55:57.152848 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [req-ec865a9c-779c-486e-b895-b976e08a3c49 req-37bdcc45-bfad-4d4f-b161-50b6794c2f17 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Created reservations ['4e1cd26c-4a8c-4066-825e-e3a44ddf6e30', 'f36f7212-5f92-4e25-80e4-d64471c4a515', 'da262900-8685-4220-9a56-44d5eb3fd74d', 'c59c8de2-17ac-4758-8a5d-73f8b1e104ed'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:55:57.230703 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-ec865a9c-779c-486e-b895-b976e08a3c49 req-37bdcc45-bfad-4d4f-b161-50b6794c2f17 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:55:57.294844 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-ec865a9c-779c-486e-b895-b976e08a3c49 req-37bdcc45-bfad-4d4f-b161-50b6794c2f17 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:55:57.370665 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [req-ec865a9c-779c-486e-b895-b976e08a3c49 req-37bdcc45-bfad-4d4f-b161-50b6794c2f17 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:55:57.397380 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-ec865a9c-779c-486e-b895-b976e08a3c49 req-37bdcc45-bfad-4d4f-b161-50b6794c2f17 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Deleted volume successfully. Mar 05 20:55:57.482581 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-ec865a9c-779c-486e-b895-b976e08a3c49 req-37bdcc45-bfad-4d4f-b161-50b6794c2f17 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Lock "b'cinder-7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e-delete_volume'" released by "delete_volume" :: held 1.736s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:55:57.508595 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-8ccec9c5-fe9f-4b89-9e2f-786c7ab738c2 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Created reservations ['b5eae5c0-60f3-440d-886a-d897c552b5d5', '60ea92d9-4c47-4bb3-bf60-faf665d835a9', '036ae002-3295-492f-8a1b-aad2ef399aed', 'f4a5e6ad-da28-421b-89cc-a2bc99011fc3'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:55:57.582857 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8ccec9c5-fe9f-4b89-9e2f-786c7ab738c2 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:55:57.686200 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8ccec9c5-fe9f-4b89-9e2f-786c7ab738c2 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:55:57.765292 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-8ccec9c5-fe9f-4b89-9e2f-786c7ab738c2 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:55:57.772951 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8ccec9c5-fe9f-4b89-9e2f-786c7ab738c2 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Deleted volume successfully. Mar 05 20:55:57.795018 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-8ccec9c5-fe9f-4b89-9e2f-786c7ab738c2 tempest-LiveAutoBlockMigrationV225Test-1363872199 None] Lock "b'cinder-26c79aaa-d9c1-41fc-9e06-a62b6b10fcec-delete_volume'" released by "delete_volume" :: held 1.265s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:56:13.525509 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:56:13.535880 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:56:13.537702 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:56:13.598785 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Flow 'volume_create_manager' (c82ffc9f-bca8-42bb-85d7-8b6096ad7b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:56:13.607430 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85217cd0-11cc-47b3-82ce-3962ac20f893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:56:13.617656 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:56:13.635334 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85217cd0-11cc-47b3-82ce-3962ac20f893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1250153390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=107837e7-b61e-41fc-9310-a10876d5a787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02c2521498e48a3a5650f7b6f81d5ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:56:13Z,use_quota=True,user_id='e8b67d8bbe9a44898a889826e12ffb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:56:13.642264 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7160946-f585-413f-ad0e-490d9e345c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:56:13.653052 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7160946-f585-413f-ad0e-490d9e345c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:56:13.659880 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a632688f-2858-420f-8c15-769833004722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:56:13.666016 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a632688f-2858-420f-8c15-769833004722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '107837e7-b61e-41fc-9310-a10876d5a787', 'volume_name': 'volume-107837e7-b61e-41fc-9310-a10876d5a787', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:56:13.672369 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01b9e34-d35c-4754-92cb-05b85787bd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:56:13.677662 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01b9e34-d35c-4754-92cb-05b85787bd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:56:13.684021 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b208b792-977d-4816-8290-b5ccc9a5b139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:56:13.685753 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Volume 107837e7-b61e-41fc-9310-a10876d5a787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-107837e7-b61e-41fc-9310-a10876d5a787', 'volume_size': 1} Mar 05 20:56:13.686351 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] creating volume 'volume-107837e7-b61e-41fc-9310-a10876d5a787' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:56:13.687557 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:56:13.843389 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:56:13.843389 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:56:13.848683 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b208b792-977d-4816-8290-b5ccc9a5b139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-107837e7-b61e-41fc-9310-a10876d5a787', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:56:13.863219 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce024b78-f3bc-47e4-acf6-38ee1478a276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:56:13.900237 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Volume volume-107837e7-b61e-41fc-9310-a10876d5a787 (107837e7-b61e-41fc-9310-a10876d5a787): created successfully Mar 05 20:56:13.924899 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce024b78-f3bc-47e4-acf6-38ee1478a276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:56:13.964420 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Flow 'volume_create_manager' (c82ffc9f-bca8-42bb-85d7-8b6096ad7b48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:56:13.997864 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f639edec-5cb9-440e-ac92-df649cab7a73 tempest-DeleteServersTestJSON-1599485420 None] Created volume successfully. Mar 05 20:56:15.453549 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-07b57ec9-3553-4bfd-80e1-8dc5582827e9 req-63a0c9ca-7f11-426d-a8c3-de2070e99365 tempest-DeleteServersTestJSON-1599485420 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:56:16.860230 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-07b57ec9-3553-4bfd-80e1-8dc5582827e9 req-63a0c9ca-7f11-426d-a8c3-de2070e99365 tempest-DeleteServersTestJSON-1599485420 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.406s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:56:16.862174 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-07b57ec9-3553-4bfd-80e1-8dc5582827e9 req-63a0c9ca-7f11-426d-a8c3-de2070e99365 tempest-DeleteServersTestJSON-1599485420 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-107837e7-b61e-41fc-9310-a10876d5a787', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '107837e7-b61e-41fc-9310-a10876d5a787', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:56:16.930555 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-07b57ec9-3553-4bfd-80e1-8dc5582827e9 req-63a0c9ca-7f11-426d-a8c3-de2070e99365 tempest-DeleteServersTestJSON-1599485420 None] Connection info returned from driver {'name': 'volumes/volume-107837e7-b61e-41fc-9310-a10876d5a787', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '107837e7-b61e-41fc-9310-a10876d5a787', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f8b85ea5-e403-4ee1-bbd5-c8ff84de41cb'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 20:56:17.030328 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-07b57ec9-3553-4bfd-80e1-8dc5582827e9 req-63a0c9ca-7f11-426d-a8c3-de2070e99365 tempest-DeleteServersTestJSON-1599485420 None] attachment_update completed successfully. Mar 05 20:56:23.113697 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-618a6692-7fdd-4757-a89b-8db108a7e1d7 req-fddf9b3c-55b2-42e6-8091-accb0b559e35 tempest-DeleteServersTestJSON-1599485420 None] Terminate volume connection completed successfully. Mar 05 20:56:23.114318 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-618a6692-7fdd-4757-a89b-8db108a7e1d7 req-fddf9b3c-55b2-42e6-8091-accb0b559e35 tempest-DeleteServersTestJSON-1599485420 None] Deleting attachment f8b85ea5-e403-4ee1-bbd5-c8ff84de41cb. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 20:56:45.566734 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:56:45.567884 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:56:45.605621 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:56:45.659239 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:57:45.568257 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:57:45.569304 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:57:45.618153 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:57:45.712975 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:57:47.849150 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:57:47.858327 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:57:47.858758 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:57:47.889184 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Flow 'volume_create_manager' (613e5e4d-dd49-4808-b025-d45aa19882c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:57:47.897123 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f51a2e-ed48-4f19-b764-ec95371ae80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:57:47.904625 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:57:47.928156 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f51a2e-ed48-4f19-b764-ec95371ae80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1495546199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b806219b-37d8-4dec-ad16-2514611f0b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b614473c32347b297c445104d001714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:57:48Z,use_quota=True,user_id='d166334f4de84b7ea62f197c6832ab6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:57:47.938548 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8c4a71-058a-480f-a31d-7a1301f4a722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:57:47.945434 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8c4a71-058a-480f-a31d-7a1301f4a722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:57:47.958638 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f587d3-c328-4ff4-bac4-7792822af6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:57:47.963966 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f587d3-c328-4ff4-bac4-7792822af6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b806219b-37d8-4dec-ad16-2514611f0b3d', 'volume_name': 'volume-b806219b-37d8-4dec-ad16-2514611f0b3d', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:57:47.969419 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f01ed9c-8893-46b2-b12c-fb9923d4b98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:57:47.975222 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f01ed9c-8893-46b2-b12c-fb9923d4b98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:57:47.988322 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cf637c-2815-49b4-82d6-5bf80570bf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:57:47.990850 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Volume b806219b-37d8-4dec-ad16-2514611f0b3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b806219b-37d8-4dec-ad16-2514611f0b3d', 'volume_size': 1} Mar 05 20:57:47.991474 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] creating volume 'volume-b806219b-37d8-4dec-ad16-2514611f0b3d' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:57:47.993181 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:57:48.165857 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:57:48.166458 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:57:48.171141 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cf637c-2815-49b4-82d6-5bf80570bf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b806219b-37d8-4dec-ad16-2514611f0b3d', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:57:48.182572 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6173f96-3f03-4185-ae2a-3c474fdde81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:57:48.201271 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Volume volume-b806219b-37d8-4dec-ad16-2514611f0b3d (b806219b-37d8-4dec-ad16-2514611f0b3d): created successfully Mar 05 20:57:48.206198 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6173f96-3f03-4185-ae2a-3c474fdde81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:57:48.221308 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Flow 'volume_create_manager' (613e5e4d-dd49-4808-b025-d45aa19882c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:57:48.234844 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-826bc13b-03c1-499d-854d-380c600237ee tempest-VolumeQuotasAdminTestJSON-505927806 None] Created volume successfully. Mar 05 20:57:48.923783 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-404e684f-f879-4f9b-94ee-2fc88f5c7610 tempest-VolumeQuotasAdminTestJSON-505927806 None] Lock "b'cinder-b806219b-37d8-4dec-ad16-2514611f0b3d-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:57:48.972240 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-404e684f-f879-4f9b-94ee-2fc88f5c7610 tempest-VolumeQuotasAdminTestJSON-505927806 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:57:49.058199 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-404e684f-f879-4f9b-94ee-2fc88f5c7610 tempest-VolumeQuotasAdminTestJSON-505927806 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:57:49.058775 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-404e684f-f879-4f9b-94ee-2fc88f5c7610 tempest-VolumeQuotasAdminTestJSON-505927806 None] Volume volume-b806219b-37d8-4dec-ad16-2514611f0b3d is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:57:49.072878 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-404e684f-f879-4f9b-94ee-2fc88f5c7610 tempest-VolumeQuotasAdminTestJSON-505927806 None] deleting rbd volume volume-b806219b-37d8-4dec-ad16-2514611f0b3d {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:57:49.437923 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-404e684f-f879-4f9b-94ee-2fc88f5c7610 tempest-VolumeQuotasAdminTestJSON-505927806 None] Created reservations ['3b099e2d-9b4b-4081-ad9e-ae1c95e2bc38', 'b00c2ad2-f13a-4b9b-9d74-a3646c8392b1', 'cdeb2cbc-81e3-462a-bd64-44d7ce348bd1', '3671a71f-34e7-4a09-b982-22fcb4da9617'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:57:49.502234 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-404e684f-f879-4f9b-94ee-2fc88f5c7610 tempest-VolumeQuotasAdminTestJSON-505927806 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:57:49.534775 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-404e684f-f879-4f9b-94ee-2fc88f5c7610 tempest-VolumeQuotasAdminTestJSON-505927806 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:57:49.617407 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-404e684f-f879-4f9b-94ee-2fc88f5c7610 tempest-VolumeQuotasAdminTestJSON-505927806 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:57:49.622268 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-404e684f-f879-4f9b-94ee-2fc88f5c7610 tempest-VolumeQuotasAdminTestJSON-505927806 None] Deleted volume successfully. Mar 05 20:57:49.640917 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-404e684f-f879-4f9b-94ee-2fc88f5c7610 tempest-VolumeQuotasAdminTestJSON-505927806 None] Lock "b'cinder-b806219b-37d8-4dec-ad16-2514611f0b3d-delete_volume'" released by "delete_volume" :: held 0.719s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:57:50.568476 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:57:50.572669 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:57:50.573355 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:57:50.599454 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Flow 'volume_create_manager' (5070568b-2e56-4c0e-a01e-6dac5714fb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:57:50.611102 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11c8fda-7e84-42e7-b62c-196a1160fc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:57:50.619411 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:57:50.650737 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11c8fda-7e84-42e7-b62c-196a1160fc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1136807744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=19b42631-04b9-4aa2-8712-ec5214f450db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b614473c32347b297c445104d001714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:57:51Z,use_quota=True,user_id='d166334f4de84b7ea62f197c6832ab6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:57:50.658303 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6e13f7-eb8e-4f0d-b021-458dc1118059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:57:50.679408 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6e13f7-eb8e-4f0d-b021-458dc1118059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:57:50.693486 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede33d1a-8c58-4191-85ee-40d763628b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:57:50.702086 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede33d1a-8c58-4191-85ee-40d763628b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b42631-04b9-4aa2-8712-ec5214f450db', 'volume_name': 'volume-19b42631-04b9-4aa2-8712-ec5214f450db', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:57:50.724801 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7db6286-b3f8-4760-8305-126050e06c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:57:50.732762 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7db6286-b3f8-4760-8305-126050e06c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:57:50.747313 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adcd213f-426a-421a-a787-8f311232452d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:57:50.749374 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Volume 19b42631-04b9-4aa2-8712-ec5214f450db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b42631-04b9-4aa2-8712-ec5214f450db', 'volume_size': 1} Mar 05 20:57:50.749966 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] creating volume 'volume-19b42631-04b9-4aa2-8712-ec5214f450db' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:57:50.751194 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:57:50.884410 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:57:50.885481 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:57:50.890189 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adcd213f-426a-421a-a787-8f311232452d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b42631-04b9-4aa2-8712-ec5214f450db', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:57:50.899053 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b244636f-9616-4c91-a623-a72fab482d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:57:50.915066 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Volume volume-19b42631-04b9-4aa2-8712-ec5214f450db (19b42631-04b9-4aa2-8712-ec5214f450db): created successfully Mar 05 20:57:50.921549 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b244636f-9616-4c91-a623-a72fab482d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:57:50.941484 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Flow 'volume_create_manager' (5070568b-2e56-4c0e-a01e-6dac5714fb2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:57:50.960385 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d6cb8340-33a1-4b9b-92c5-64026335a7d5 tempest-VolumeQuotasAdminTestJSON-505927806 None] Created volume successfully. Mar 05 20:57:52.634039 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b1702f16-2fa8-4c68-a002-e6686ca2141c tempest-VolumeQuotasAdminTestJSON-103719802 None] Transfer volume completed successfully. Mar 05 20:57:53.394341 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-79de3f99-1ffe-4d24-b595-d185a28c0742 tempest-VolumeQuotasAdminTestJSON-963839452 None] Lock "b'cinder-19b42631-04b9-4aa2-8712-ec5214f450db-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:57:53.453997 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-79de3f99-1ffe-4d24-b595-d185a28c0742 tempest-VolumeQuotasAdminTestJSON-963839452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:57:53.556659 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-79de3f99-1ffe-4d24-b595-d185a28c0742 tempest-VolumeQuotasAdminTestJSON-963839452 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:57:53.557314 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-79de3f99-1ffe-4d24-b595-d185a28c0742 tempest-VolumeQuotasAdminTestJSON-963839452 None] Volume volume-19b42631-04b9-4aa2-8712-ec5214f450db is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:57:53.568293 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-79de3f99-1ffe-4d24-b595-d185a28c0742 tempest-VolumeQuotasAdminTestJSON-963839452 None] deleting rbd volume volume-19b42631-04b9-4aa2-8712-ec5214f450db {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:57:54.014083 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-79de3f99-1ffe-4d24-b595-d185a28c0742 tempest-VolumeQuotasAdminTestJSON-963839452 None] Created reservations ['1a160405-e9ea-4ce5-9ea1-0f4d0ed7691e', 'fa939b74-a94e-4262-9629-1683cf653d9a', 'c746306d-bdd6-4bb7-9697-45659402241f', 'd89a1aa6-39cc-4be0-bfe5-0b1dd98fe342'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:57:54.095768 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-79de3f99-1ffe-4d24-b595-d185a28c0742 tempest-VolumeQuotasAdminTestJSON-963839452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:57:54.186210 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-79de3f99-1ffe-4d24-b595-d185a28c0742 tempest-VolumeQuotasAdminTestJSON-963839452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:57:54.264561 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-79de3f99-1ffe-4d24-b595-d185a28c0742 tempest-VolumeQuotasAdminTestJSON-963839452 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:57:54.276967 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-79de3f99-1ffe-4d24-b595-d185a28c0742 tempest-VolumeQuotasAdminTestJSON-963839452 None] Deleted volume successfully. Mar 05 20:57:54.297119 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-79de3f99-1ffe-4d24-b595-d185a28c0742 tempest-VolumeQuotasAdminTestJSON-963839452 None] Lock "b'cinder-19b42631-04b9-4aa2-8712-ec5214f450db-delete_volume'" released by "delete_volume" :: held 0.903s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:58:04.251583 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:58:04.256523 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:58:04.257162 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:58:04.279579 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Flow 'volume_create_manager' (3003baa2-62d4-4534-925e-3c8df662bfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:04.295308 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad992f30-1c03-4ee9-a059-7bee91bf539f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:04.308842 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:58:04.327757 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad992f30-1c03-4ee9-a059-7bee91bf539f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-799033152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=defeec3e-a403-44c9-8eae-c63d8d9f0028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e781589aa23445b8a97ebc5ac4536b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:58:04Z,use_quota=True,user_id='7320badb5fb0497f923c976420cb53d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:04.334136 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c75eb7-d953-45f0-85d8-485deef119b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:04.338540 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c75eb7-d953-45f0-85d8-485deef119b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:04.347439 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0ff2a6-22b9-4b5b-8ceb-9641ea2aab81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:04.353799 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0ff2a6-22b9-4b5b-8ceb-9641ea2aab81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'defeec3e-a403-44c9-8eae-c63d8d9f0028', 'volume_name': 'volume-defeec3e-a403-44c9-8eae-c63d8d9f0028', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:04.359753 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b724fb9d-cc62-4ff0-8494-fe2e8809ad6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:04.364858 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b724fb9d-cc62-4ff0-8494-fe2e8809ad6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:04.370377 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95827c13-37a7-4f8b-bf2b-c9d8ec14261b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:04.372473 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Volume defeec3e-a403-44c9-8eae-c63d8d9f0028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-defeec3e-a403-44c9-8eae-c63d8d9f0028', 'volume_size': 1} Mar 05 20:58:04.373422 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] creating volume 'volume-defeec3e-a403-44c9-8eae-c63d8d9f0028' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:58:04.374343 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:04.502209 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:58:04.502590 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:58:04.507093 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95827c13-37a7-4f8b-bf2b-c9d8ec14261b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-defeec3e-a403-44c9-8eae-c63d8d9f0028', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:04.511867 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f526a15-65a7-4d7c-8453-1b77d814ff67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:04.535202 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Volume volume-defeec3e-a403-44c9-8eae-c63d8d9f0028 (defeec3e-a403-44c9-8eae-c63d8d9f0028): created successfully Mar 05 20:58:04.539296 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f526a15-65a7-4d7c-8453-1b77d814ff67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:04.545109 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Flow 'volume_create_manager' (3003baa2-62d4-4534-925e-3c8df662bfb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:04.578653 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-043448e2-3c8b-4b95-b01f-1459c63ee30c tempest-VolumesServicesTestJSON-387218356 None] Created volume successfully. Mar 05 20:58:05.470849 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:58:05.489252 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:58:05.489721 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:58:05.517868 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Flow 'volume_create_manager' (b361433d-f389-4d2f-a5da-5ae2a0d6c270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:05.525153 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6302219-dd87-4314-a0ca-cece7c30b61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:05.538420 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:58:05.567440 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6302219-dd87-4314-a0ca-cece7c30b61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1286799099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b4d17444-3aa0-4844-b95f-1594f1c1b9ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c35382c7454a51ab1fbd37f9157ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:58:05Z,use_quota=True,user_id='4ff43fd6998d454887c5aae39464ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:05.592660 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dea272d-52a0-4970-bcde-01c873b6e31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:05.602976 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dea272d-52a0-4970-bcde-01c873b6e31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:05.609996 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974c4999-adcd-463e-b5e0-58da91943c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:05.625753 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974c4999-adcd-463e-b5e0-58da91943c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d17444-3aa0-4844-b95f-1594f1c1b9ec', 'volume_name': 'volume-b4d17444-3aa0-4844-b95f-1594f1c1b9ec', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:05.638402 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbdfb94-03b8-4262-bdcb-b1c762b18a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:05.645170 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbdfb94-03b8-4262-bdcb-b1c762b18a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:05.658032 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8854355c-1eb9-4729-b11c-f8b358e90dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:05.676366 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Volume b4d17444-3aa0-4844-b95f-1594f1c1b9ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d17444-3aa0-4844-b95f-1594f1c1b9ec', 'volume_size': 1} Mar 05 20:58:05.677410 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] creating volume 'volume-b4d17444-3aa0-4844-b95f-1594f1c1b9ec' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:58:05.685170 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:05.792897 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-73856193-5fb3-4cdc-b924-d17ac27d71a4 tempest-VolumesServicesTestJSON-387218356 None] Lock "b'cinder-defeec3e-a403-44c9-8eae-c63d8d9f0028-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:58:05.861578 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:58:05.862197 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:58:05.876489 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8854355c-1eb9-4729-b11c-f8b358e90dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d17444-3aa0-4844-b95f-1594f1c1b9ec', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:05.883783 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b017d3-6926-4ad3-9bb8-f16f829f86d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:05.912537 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Volume volume-b4d17444-3aa0-4844-b95f-1594f1c1b9ec (b4d17444-3aa0-4844-b95f-1594f1c1b9ec): created successfully Mar 05 20:58:05.917215 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b017d3-6926-4ad3-9bb8-f16f829f86d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:05.925159 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Flow 'volume_create_manager' (b361433d-f389-4d2f-a5da-5ae2a0d6c270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:05.933526 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-73856193-5fb3-4cdc-b924-d17ac27d71a4 tempest-VolumesServicesTestJSON-387218356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:06.026031 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-73856193-5fb3-4cdc-b924-d17ac27d71a4 tempest-VolumesServicesTestJSON-387218356 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:58:06.027071 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-73856193-5fb3-4cdc-b924-d17ac27d71a4 tempest-VolumesServicesTestJSON-387218356 None] Volume volume-defeec3e-a403-44c9-8eae-c63d8d9f0028 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:58:06.040263 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-73856193-5fb3-4cdc-b924-d17ac27d71a4 tempest-VolumesServicesTestJSON-387218356 None] deleting rbd volume volume-defeec3e-a403-44c9-8eae-c63d8d9f0028 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:58:06.042960 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-69d38ce0-e9f6-4e03-b99b-93c2ea0d5e7b tempest-LiveMigrationTest-958104892 None] Created volume successfully. Mar 05 20:58:06.476404 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-73856193-5fb3-4cdc-b924-d17ac27d71a4 tempest-VolumesServicesTestJSON-387218356 None] Created reservations ['bbec5d1b-59cd-4cb9-b403-e1380d270795', 'c159f1e0-d66e-49da-882d-a54e9d66cbe6', '4fca423b-7a34-45d3-9eac-80dd687565a7', 'e0e6a4bb-6b41-4290-a70c-42d7f256d850'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:58:06.557410 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-73856193-5fb3-4cdc-b924-d17ac27d71a4 tempest-VolumesServicesTestJSON-387218356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:06.628910 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-73856193-5fb3-4cdc-b924-d17ac27d71a4 tempest-VolumesServicesTestJSON-387218356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:06.698233 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-73856193-5fb3-4cdc-b924-d17ac27d71a4 tempest-VolumesServicesTestJSON-387218356 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:58:06.704025 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-73856193-5fb3-4cdc-b924-d17ac27d71a4 tempest-VolumesServicesTestJSON-387218356 None] Deleted volume successfully. Mar 05 20:58:06.729299 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-73856193-5fb3-4cdc-b924-d17ac27d71a4 tempest-VolumesServicesTestJSON-387218356 None] Lock "b'cinder-defeec3e-a403-44c9-8eae-c63d8d9f0028-delete_volume'" released by "delete_volume" :: held 0.937s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:58:07.313872 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-44eabd75-d2df-4f06-b485-c015c8ba9562 req-d682f0c4-9381-4460-baf3-0f40e3eb4ee0 tempest-LiveMigrationTest-958104892 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:58:08.538232 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-44eabd75-d2df-4f06-b485-c015c8ba9562 req-d682f0c4-9381-4460-baf3-0f40e3eb4ee0 tempest-LiveMigrationTest-958104892 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.223s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:58:08.539251 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-44eabd75-d2df-4f06-b485-c015c8ba9562 req-d682f0c4-9381-4460-baf3-0f40e3eb4ee0 tempest-LiveMigrationTest-958104892 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b4d17444-3aa0-4844-b95f-1594f1c1b9ec', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'b4d17444-3aa0-4844-b95f-1594f1c1b9ec', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:58:08.645824 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-44eabd75-d2df-4f06-b485-c015c8ba9562 req-d682f0c4-9381-4460-baf3-0f40e3eb4ee0 tempest-LiveMigrationTest-958104892 None] Connection info returned from driver {'name': 'volumes/volume-b4d17444-3aa0-4844-b95f-1594f1c1b9ec', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b4d17444-3aa0-4844-b95f-1594f1c1b9ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '57515b2f-3eb4-4dde-b223-9eae2e5a1a0c'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 20:58:08.783096 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-44eabd75-d2df-4f06-b485-c015c8ba9562 req-d682f0c4-9381-4460-baf3-0f40e3eb4ee0 tempest-LiveMigrationTest-958104892 None] attachment_update completed successfully. Mar 05 20:58:15.379354 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:58:15.390190 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:58:15.390698 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:58:15.457902 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Flow 'volume_create_manager' (84fb5388-6dab-4495-a925-a31996e1e8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:15.477574 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76137ce2-3061-4d2d-a0c0-c910a1bdeed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:15.484814 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:58:15.501124 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76137ce2-3061-4d2d-a0c0-c910a1bdeed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-228360767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=353b030c-0947-4add-94c7-0240e192abe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2d07117699c4fb794ade889007cd95a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:58:15Z,use_quota=True,user_id='8fcfdfe37c344a2aa18d5678b129b886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0ec377d-1ee4-427e-904b-59a562b55756),volume_type_id=c0ec377d-1ee4-427e-904b-59a562b55756)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:15.508199 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8779338b-5b0c-4b8d-a3e9-482657b6caac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:15.512693 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8779338b-5b0c-4b8d-a3e9-482657b6caac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:15.518182 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd2244b-3675-4adf-b725-24b066dd51ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:15.524177 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd2244b-3675-4adf-b725-24b066dd51ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '353b030c-0947-4add-94c7-0240e192abe0', 'volume_name': 'volume-353b030c-0947-4add-94c7-0240e192abe0', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:15.529752 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5642d1c-3123-498d-9ddd-80849e926b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:15.534334 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5642d1c-3123-498d-9ddd-80849e926b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:15.539602 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a6cc89-fee6-422f-b1cc-3dd9e3a83e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:15.540961 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Volume 353b030c-0947-4add-94c7-0240e192abe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-353b030c-0947-4add-94c7-0240e192abe0', 'volume_size': 1} Mar 05 20:58:15.541528 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] creating volume 'volume-353b030c-0947-4add-94c7-0240e192abe0' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:58:15.542812 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:15.657809 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] extra_specs: {} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:58:15.658706 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] extra_specs: {} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:58:15.664347 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a6cc89-fee6-422f-b1cc-3dd9e3a83e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-353b030c-0947-4add-94c7-0240e192abe0', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:15.671498 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f96380-5d1a-4d60-a9ec-881d2d54cfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:15.686006 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Volume volume-353b030c-0947-4add-94c7-0240e192abe0 (353b030c-0947-4add-94c7-0240e192abe0): created successfully Mar 05 20:58:15.691527 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f96380-5d1a-4d60-a9ec-881d2d54cfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:15.699876 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Flow 'volume_create_manager' (84fb5388-6dab-4495-a925-a31996e1e8a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:15.752908 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c5b59028-2171-4de4-8521-e69504694f85 tempest-VolumeTypesAccessTest-2010880150 None] Created volume successfully. Mar 05 20:58:17.185217 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e83496c0-02ae-497e-9543-7d6780d21f3c tempest-VolumeTypesAccessTest-2010880150 None] Lock "b'cinder-353b030c-0947-4add-94c7-0240e192abe0-delete_volume'" acquired by "delete_volume" :: waited 0.056s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:58:17.265574 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e83496c0-02ae-497e-9543-7d6780d21f3c tempest-VolumeTypesAccessTest-2010880150 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:17.354424 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e83496c0-02ae-497e-9543-7d6780d21f3c tempest-VolumeTypesAccessTest-2010880150 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:58:17.355017 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e83496c0-02ae-497e-9543-7d6780d21f3c tempest-VolumeTypesAccessTest-2010880150 None] Volume volume-353b030c-0947-4add-94c7-0240e192abe0 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:58:17.361306 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e83496c0-02ae-497e-9543-7d6780d21f3c tempest-VolumeTypesAccessTest-2010880150 None] deleting rbd volume volume-353b030c-0947-4add-94c7-0240e192abe0 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:58:17.746677 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-e83496c0-02ae-497e-9543-7d6780d21f3c tempest-VolumeTypesAccessTest-2010880150 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-290485945 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-290485945, it is now deprecated. Please use the default quota class for default quota. Mar 05 20:58:17.747481 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-e83496c0-02ae-497e-9543-7d6780d21f3c tempest-VolumeTypesAccessTest-2010880150 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-290485945 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-290485945, it is now deprecated. Please use the default quota class for default quota. Mar 05 20:58:17.776036 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-e83496c0-02ae-497e-9543-7d6780d21f3c tempest-VolumeTypesAccessTest-2010880150 None] Created reservations ['1e0b1b4c-9e3b-46f1-81da-0b1657544bc0', '2d52c281-dd8a-4689-9a1f-2c2df825eea8', 'a18a017c-4b81-44ce-b288-c2d6f0a6bcaf', 'ed015ba0-48ab-462f-82ef-35be458a407e'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:58:17.865056 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e83496c0-02ae-497e-9543-7d6780d21f3c tempest-VolumeTypesAccessTest-2010880150 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:17.953059 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e83496c0-02ae-497e-9543-7d6780d21f3c tempest-VolumeTypesAccessTest-2010880150 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:18.038678 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-e83496c0-02ae-497e-9543-7d6780d21f3c tempest-VolumeTypesAccessTest-2010880150 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:58:18.046637 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-e83496c0-02ae-497e-9543-7d6780d21f3c tempest-VolumeTypesAccessTest-2010880150 None] Deleted volume successfully. Mar 05 20:58:18.073041 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e83496c0-02ae-497e-9543-7d6780d21f3c tempest-VolumeTypesAccessTest-2010880150 None] Lock "b'cinder-353b030c-0947-4add-94c7-0240e192abe0-delete_volume'" released by "delete_volume" :: held 0.891s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:58:19.767282 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-b5662f02-4b99-4575-995f-228880b83da6 req-e54929ee-4a83-4e81-b40d-8d336ad2424d tempest-LiveMigrationTest-747499185 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:58:20.691703 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-b5662f02-4b99-4575-995f-228880b83da6 req-e54929ee-4a83-4e81-b40d-8d336ad2424d tempest-LiveMigrationTest-747499185 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.924s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:58:20.693982 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-b5662f02-4b99-4575-995f-228880b83da6 req-e54929ee-4a83-4e81-b40d-8d336ad2424d tempest-LiveMigrationTest-747499185 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b4d17444-3aa0-4844-b95f-1594f1c1b9ec', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'b4d17444-3aa0-4844-b95f-1594f1c1b9ec', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:58:20.750363 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-b5662f02-4b99-4575-995f-228880b83da6 req-e54929ee-4a83-4e81-b40d-8d336ad2424d tempest-LiveMigrationTest-747499185 None] Connection info returned from driver {'name': 'volumes/volume-b4d17444-3aa0-4844-b95f-1594f1c1b9ec', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b4d17444-3aa0-4844-b95f-1594f1c1b9ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b159b653-4c19-4876-bdd4-b29f4497d33a'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 20:58:20.831407 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-b5662f02-4b99-4575-995f-228880b83da6 req-e54929ee-4a83-4e81-b40d-8d336ad2424d tempest-LiveMigrationTest-747499185 None] attachment_update completed successfully. Mar 05 20:58:24.557840 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-588bf5ec-c391-4eb5-970f-faca559910e7 req-8f0729fe-4df6-43ee-af83-9c2c184df266 tempest-TaggedBootDevicesTest-602522751 None] Terminate volume connection completed successfully. Mar 05 20:58:24.558397 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-588bf5ec-c391-4eb5-970f-faca559910e7 req-8f0729fe-4df6-43ee-af83-9c2c184df266 tempest-TaggedBootDevicesTest-602522751 None] Deleting attachment e32b24e3-c109-4bd8-935d-8ebef4c0eb04. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 20:58:24.818179 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-588bf5ec-c391-4eb5-970f-faca559910e7 req-e9194a43-2c28-4c67-9a91-a1e10956fdb7 tempest-TaggedBootDevicesTest-602522751 None] Terminate volume connection completed successfully. Mar 05 20:58:24.824857 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-588bf5ec-c391-4eb5-970f-faca559910e7 req-e9194a43-2c28-4c67-9a91-a1e10956fdb7 tempest-TaggedBootDevicesTest-602522751 None] Deleting attachment 5fe88541-362c-45a7-a976-018e9227fd91. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 20:58:25.070049 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-588bf5ec-c391-4eb5-970f-faca559910e7 req-52ba3a14-6885-423a-b6ff-33b1db9ea73e tempest-TaggedBootDevicesTest-602522751 None] Terminate volume connection completed successfully. Mar 05 20:58:25.070768 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-588bf5ec-c391-4eb5-970f-faca559910e7 req-52ba3a14-6885-423a-b6ff-33b1db9ea73e tempest-TaggedBootDevicesTest-602522751 None] Deleting attachment e3a59985-a8d6-4e89-b95f-0f4254245b63. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 20:58:27.196944 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:58:27.202251 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:58:27.202983 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:58:27.226101 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Flow 'volume_create_manager' (ee9cd675-0ac1-4aab-83be-2ddb0f8af2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:27.233410 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b8e967-3f61-4db0-8edc-78c03431b9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:27.242870 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:58:27.260881 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b8e967-3f61-4db0-8edc-78c03431b9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-1919319394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a7055011-640a-4cb4-b12b-077a721ff496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff38e7d62dc4f5daa04cd84693c2e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:58:27Z,use_quota=True,user_id='196f6dfa309e48088c9be46210001e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:27.268071 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e344880-a657-4baf-8690-fe35bd8d9301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:27.273015 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e344880-a657-4baf-8690-fe35bd8d9301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:27.279131 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a7d592-bd0e-4971-9b30-4c37bd53a721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:27.283796 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a7d592-bd0e-4971-9b30-4c37bd53a721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7055011-640a-4cb4-b12b-077a721ff496', 'volume_name': 'volume-a7055011-640a-4cb4-b12b-077a721ff496', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:27.289634 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392b368e-63da-43ae-b022-27bcdb9dabfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:27.294011 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392b368e-63da-43ae-b022-27bcdb9dabfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:27.299848 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (099c8906-07f9-4ed6-b3a2-992f392b9e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:27.302051 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Volume a7055011-640a-4cb4-b12b-077a721ff496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7055011-640a-4cb4-b12b-077a721ff496', 'volume_size': 1} Mar 05 20:58:27.302673 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] creating volume 'volume-a7055011-640a-4cb4-b12b-077a721ff496' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:58:27.304050 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:27.423273 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:58:27.423694 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:58:27.428040 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (099c8906-07f9-4ed6-b3a2-992f392b9e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7055011-640a-4cb4-b12b-077a721ff496', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:27.436520 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4322df01-2304-4c81-9e0c-22635523188b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:27.450185 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Volume volume-a7055011-640a-4cb4-b12b-077a721ff496 (a7055011-640a-4cb4-b12b-077a721ff496): created successfully Mar 05 20:58:27.459701 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4322df01-2304-4c81-9e0c-22635523188b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:27.474700 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Flow 'volume_create_manager' (ee9cd675-0ac1-4aab-83be-2ddb0f8af2e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:27.516105 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-7c03ce2c-a9e5-444c-ba20-9ce3af13785d tempest-VolumesBackupsV39Test-610288572 None] Created volume successfully. Mar 05 20:58:28.831186 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d24df752-a049-4460-9051-eb58314dfef9 tempest-VolumesBackupsV39Test-610288572 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-05T20:58:28Z,data_timestamp=2022-03-05T20:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-834020033',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=c9ae053c-27a0-41db-88dd-5d0400936bd6,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='0ff38e7d62dc4f5daa04cd84693c2e90',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='196f6dfa309e48088c9be46210001e7b',volume_id=a7055011-640a-4cb4-b12b-077a721ff496) Mar 05 20:58:28.833696 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.backup.rpcapi [None req-d24df752-a049-4460-9051-eb58314dfef9 tempest-VolumesBackupsV39Test-610288572 None] continue_backup in rpcapi backup_id c9ae053c-27a0-41db-88dd-5d0400936bd6 {{(pid=134747) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 05 20:58:29.605176 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-b5662f02-4b99-4575-995f-228880b83da6 req-1f2ca280-4dce-4ad9-8d01-6c3b35a60f0e tempest-LiveMigrationTest-747499185 None] Terminate volume connection completed successfully. Mar 05 20:58:29.605897 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-b5662f02-4b99-4575-995f-228880b83da6 req-1f2ca280-4dce-4ad9-8d01-6c3b35a60f0e tempest-LiveMigrationTest-747499185 None] Deleting attachment 57515b2f-3eb4-4dde-b223-9eae2e5a1a0c. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 20:58:33.457759 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-d24df752-a049-4460-9051-eb58314dfef9 tempest-VolumesBackupsV39Test-610288572 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:58:34.484990 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-d24df752-a049-4460-9051-eb58314dfef9 tempest-VolumesBackupsV39Test-610288572 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.027s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:58:34.488725 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d24df752-a049-4460-9051-eb58314dfef9 tempest-VolumesBackupsV39Test-610288572 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a7055011-640a-4cb4-b12b-077a721ff496', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'a7055011-640a-4cb4-b12b-077a721ff496', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:58:34.518736 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d24df752-a049-4460-9051-eb58314dfef9 tempest-VolumesBackupsV39Test-610288572 None] Initialize volume connection completed successfully. Mar 05 20:58:38.433574 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e2308c9b-f446-493c-a19b-a233aec666ba tempest-TaggedBootDevicesTest-602522751 None] Lock "b'cinder-8501e6cd-ef92-486c-9fd7-73be61906481-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:58:38.560037 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d24df752-a049-4460-9051-eb58314dfef9 tempest-VolumesBackupsV39Test-610288572 None] Terminate volume connection completed successfully. Mar 05 20:58:38.568861 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e2308c9b-f446-493c-a19b-a233aec666ba tempest-TaggedBootDevicesTest-602522751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:38.686570 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e2308c9b-f446-493c-a19b-a233aec666ba tempest-TaggedBootDevicesTest-602522751 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:58:38.687030 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e2308c9b-f446-493c-a19b-a233aec666ba tempest-TaggedBootDevicesTest-602522751 None] Volume volume-8501e6cd-ef92-486c-9fd7-73be61906481 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:58:38.719077 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e2308c9b-f446-493c-a19b-a233aec666ba tempest-TaggedBootDevicesTest-602522751 None] deleting rbd volume volume-8501e6cd-ef92-486c-9fd7-73be61906481 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:58:38.757779 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d24df752-a049-4460-9051-eb58314dfef9 tempest-VolumesBackupsV39Test-610288572 None] Remove volume export completed successfully. Mar 05 20:58:39.213919 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-e2308c9b-f446-493c-a19b-a233aec666ba tempest-TaggedBootDevicesTest-602522751 None] Created reservations ['d71967c3-699c-46b6-a5b5-c2386f845281', '0788181b-5f84-40db-8bea-6c8796a5aafa', 'e3e583e4-ac36-424d-aca5-d604c18d270f', 'fd4ed5a1-acae-40bc-a272-e0833b9cf960'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:58:39.305747 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e2308c9b-f446-493c-a19b-a233aec666ba tempest-TaggedBootDevicesTest-602522751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:39.377739 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e2308c9b-f446-493c-a19b-a233aec666ba tempest-TaggedBootDevicesTest-602522751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:39.436913 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-e2308c9b-f446-493c-a19b-a233aec666ba tempest-TaggedBootDevicesTest-602522751 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:58:39.451881 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-e2308c9b-f446-493c-a19b-a233aec666ba tempest-TaggedBootDevicesTest-602522751 None] Deleted volume successfully. Mar 05 20:58:39.473810 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e2308c9b-f446-493c-a19b-a233aec666ba tempest-TaggedBootDevicesTest-602522751 None] Lock "b'cinder-8501e6cd-ef92-486c-9fd7-73be61906481-delete_volume'" released by "delete_volume" :: held 1.040s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:58:39.702060 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-218a996a-df77-4628-80bd-b6eb27476873 tempest-TaggedBootDevicesTest-602522751 None] Lock "b'cinder-218d7dc8-d08f-48dd-8791-4cb639216b6b-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:58:39.760294 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-218a996a-df77-4628-80bd-b6eb27476873 tempest-TaggedBootDevicesTest-602522751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:39.856784 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-218a996a-df77-4628-80bd-b6eb27476873 tempest-TaggedBootDevicesTest-602522751 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:58:39.857215 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-218a996a-df77-4628-80bd-b6eb27476873 tempest-TaggedBootDevicesTest-602522751 None] Volume volume-218d7dc8-d08f-48dd-8791-4cb639216b6b is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:58:39.864680 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-218a996a-df77-4628-80bd-b6eb27476873 tempest-TaggedBootDevicesTest-602522751 None] deleting rbd volume volume-218d7dc8-d08f-48dd-8791-4cb639216b6b {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:58:39.949701 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-86ead924-bb7b-45df-bdc7-c514cc45afb8 req-7895d070-ea80-43c0-ad07-07ff1c7e0f92 tempest-LiveMigrationTest-958104892 None] Terminate volume connection completed successfully. Mar 05 20:58:39.949701 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-86ead924-bb7b-45df-bdc7-c514cc45afb8 req-7895d070-ea80-43c0-ad07-07ff1c7e0f92 tempest-LiveMigrationTest-958104892 None] Deleting attachment b159b653-4c19-4876-bdd4-b29f4497d33a. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 20:58:40.299246 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-218a996a-df77-4628-80bd-b6eb27476873 tempest-TaggedBootDevicesTest-602522751 None] Created reservations ['29ecb0b1-bbdb-4d87-bbc7-f2a60bd6f975', '0730c73f-b12b-435b-abc8-4301b55c124c', '14fe7bb9-f8ab-4d18-ad22-0c83d86bc347', 'e9763932-dc6b-4c4e-b6c9-0b5376702ac7'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:58:40.372695 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-218a996a-df77-4628-80bd-b6eb27476873 tempest-TaggedBootDevicesTest-602522751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:40.459205 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-218a996a-df77-4628-80bd-b6eb27476873 tempest-TaggedBootDevicesTest-602522751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:40.572371 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-218a996a-df77-4628-80bd-b6eb27476873 tempest-TaggedBootDevicesTest-602522751 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:58:40.579112 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-218a996a-df77-4628-80bd-b6eb27476873 tempest-TaggedBootDevicesTest-602522751 None] Deleted volume successfully. Mar 05 20:58:40.611596 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-218a996a-df77-4628-80bd-b6eb27476873 tempest-TaggedBootDevicesTest-602522751 None] Lock "b'cinder-218d7dc8-d08f-48dd-8791-4cb639216b6b-delete_volume'" released by "delete_volume" :: held 0.910s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:58:40.711237 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:58:40.735215 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:58:40.737807 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:58:40.793829 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Flow 'volume_create_manager' (7f29cade-51e0-45f4-8544-dec6913dba7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:40.801983 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cb5d5b-46a4-4d09-82ad-7bc09a6f1fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:40.813527 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:58:40.830518 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cb5d5b-46a4-4d09-82ad-7bc09a6f1fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1639695050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=555a5c26-7277-41de-bd15-f5dccc052252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbcdb241d131498383d795897e2ffbee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:58:41Z,use_quota=True,user_id='89a962f8b01c453691caf9a8735689ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:40.839450 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2aeb1f-6e46-43e8-b624-e0701b43bcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:40.844053 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2aeb1f-6e46-43e8-b624-e0701b43bcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:40.851500 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a338314a-aed9-4c14-931a-2667f13c6c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:40.856967 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a338314a-aed9-4c14-931a-2667f13c6c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '555a5c26-7277-41de-bd15-f5dccc052252', 'volume_name': 'volume-555a5c26-7277-41de-bd15-f5dccc052252', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:40.863558 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d260b934-7ff4-45fa-9fa6-f33387c1ee1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:40.868251 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d260b934-7ff4-45fa-9fa6-f33387c1ee1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:40.873747 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db3165d-2ff7-4f53-aad5-5be39cf318d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:40.874937 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Volume 555a5c26-7277-41de-bd15-f5dccc052252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-555a5c26-7277-41de-bd15-f5dccc052252', 'volume_size': 1} Mar 05 20:58:40.875349 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] creating volume 'volume-555a5c26-7277-41de-bd15-f5dccc052252' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:58:40.876399 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:40.997141 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:58:40.997584 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:58:41.001847 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db3165d-2ff7-4f53-aad5-5be39cf318d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555a5c26-7277-41de-bd15-f5dccc052252', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:41.008273 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f5ab48-7240-456a-9a2a-5c7d9b454bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:41.024973 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-815a49af-72ba-4bb0-a23f-19f62b467141 tempest-TaggedBootDevicesTest-602522751 None] Lock "b'cinder-f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e-delete_volume'" acquired by "delete_volume" :: waited 0.042s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:58:41.033751 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Volume volume-555a5c26-7277-41de-bd15-f5dccc052252 (555a5c26-7277-41de-bd15-f5dccc052252): created successfully Mar 05 20:58:41.041661 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f5ab48-7240-456a-9a2a-5c7d9b454bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:41.050934 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Flow 'volume_create_manager' (7f29cade-51e0-45f4-8544-dec6913dba7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:41.068498 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-3e1cfd32-8894-4f6d-a580-588bcee92e70 req-222f417d-2d38-4d94-8b1e-b34d346a9544 tempest-VolumesSnapshotsTestJSON-1459184426 None] Created volume successfully. Mar 05 20:58:41.100728 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-815a49af-72ba-4bb0-a23f-19f62b467141 tempest-TaggedBootDevicesTest-602522751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:41.236534 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-815a49af-72ba-4bb0-a23f-19f62b467141 tempest-TaggedBootDevicesTest-602522751 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:58:41.255221 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-815a49af-72ba-4bb0-a23f-19f62b467141 tempest-TaggedBootDevicesTest-602522751 None] deleting rbd volume volume-f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:58:41.632499 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-4346dbae-25a2-46fd-b682-ebe2ccb9df27 tempest-VolumesBackupsV39Test-610288572 None] Lock "b'cinder-a7055011-640a-4cb4-b12b-077a721ff496-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:58:41.696767 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4346dbae-25a2-46fd-b682-ebe2ccb9df27 tempest-VolumesBackupsV39Test-610288572 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:42.228888 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4346dbae-25a2-46fd-b682-ebe2ccb9df27 tempest-VolumesBackupsV39Test-610288572 None] Volume volume-a7055011-640a-4cb4-b12b-077a721ff496 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:58:42.243238 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4346dbae-25a2-46fd-b682-ebe2ccb9df27 tempest-VolumesBackupsV39Test-610288572 None] deleting rbd volume volume-a7055011-640a-4cb4-b12b-077a721ff496 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:58:42.257994 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-815a49af-72ba-4bb0-a23f-19f62b467141 tempest-TaggedBootDevicesTest-602522751 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 20:58:42.297983 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-815a49af-72ba-4bb0-a23f-19f62b467141 tempest-TaggedBootDevicesTest-602522751 None] deleting parent snapshot volume-f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 20:58:43.370246 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:58:43.373563 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:58:43.374265 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:58:43.396534 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Flow 'volume_create_manager' (8b53c4df-2dab-4c08-bfcf-45e0c714e35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:43.403791 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968ea768-a48d-4223-8a0a-fdd8ac9fd1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:43.408659 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-e2c68a71-eb3d-4f3e-806e-dbcbf02800c4 req-0361b127-7906-4eac-b9b6-74708024a3d5 tempest-VolumesSnapshotsTestJSON-1459184426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:43.474158 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:58:43.496195 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968ea768-a48d-4223-8a0a-fdd8ac9fd1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1229488662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=343d02d7-1904-4f02-a9f0-6e1deab8d765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c35382c7454a51ab1fbd37f9157ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:58:42Z,use_quota=True,user_id='4ff43fd6998d454887c5aae39464ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:43.501966 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2603799-1647-4fd7-b192-64d3fde9ae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:43.507405 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2603799-1647-4fd7-b192-64d3fde9ae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:43.512747 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4de26ff-c4dc-4709-a5bc-7fa4b4c06f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:43.517152 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-815a49af-72ba-4bb0-a23f-19f62b467141 tempest-TaggedBootDevicesTest-602522751 None] Created reservations ['6f313ab8-4af9-48a7-943b-a708a2d75e62', '0572de69-489c-48ee-a727-5400abc247c5', '638a130e-4452-4fd0-82ac-d9a0dfc1e754', '366604b5-6d80-4fb3-96ea-2a7f166b00ca'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:58:43.542295 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-4346dbae-25a2-46fd-b682-ebe2ccb9df27 tempest-VolumesBackupsV39Test-610288572 None] Created reservations ['ab165f09-b699-48d6-884a-96a009480e0c', 'fe3c986a-2b3d-4c8b-9b31-93fc20c52a1a', 'e40bafc3-2e56-4a49-a1c6-86be661af975', 'a619b1d8-e5fe-41b6-9a4a-48afe55977d6'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:58:43.617292 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-815a49af-72ba-4bb0-a23f-19f62b467141 tempest-TaggedBootDevicesTest-602522751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:43.641982 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-815a49af-72ba-4bb0-a23f-19f62b467141 tempest-TaggedBootDevicesTest-602522751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:43.666717 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-815a49af-72ba-4bb0-a23f-19f62b467141 tempest-TaggedBootDevicesTest-602522751 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:58:43.679136 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-815a49af-72ba-4bb0-a23f-19f62b467141 tempest-TaggedBootDevicesTest-602522751 None] Deleted volume successfully. Mar 05 20:58:43.692548 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4de26ff-c4dc-4709-a5bc-7fa4b4c06f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '343d02d7-1904-4f02-a9f0-6e1deab8d765', 'volume_name': 'volume-343d02d7-1904-4f02-a9f0-6e1deab8d765', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:43.697686 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75e62ea-14d4-4bc9-8c99-c679847bbde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:43.701869 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75e62ea-14d4-4bc9-8c99-c679847bbde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:43.706813 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f588049f-1f35-4e72-9952-f4b8e01e7412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:43.707953 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Volume 343d02d7-1904-4f02-a9f0-6e1deab8d765: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-343d02d7-1904-4f02-a9f0-6e1deab8d765', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 20:58:43.708541 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Cloning 343d02d7-1904-4f02-a9f0-6e1deab8d765 from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 20:58:43.719260 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4346dbae-25a2-46fd-b682-ebe2ccb9df27 tempest-VolumesBackupsV39Test-610288572 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:43.744244 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4346dbae-25a2-46fd-b682-ebe2ccb9df27 tempest-VolumesBackupsV39Test-610288572 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:43.774935 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-4346dbae-25a2-46fd-b682-ebe2ccb9df27 tempest-VolumesBackupsV39Test-610288572 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:58:43.777723 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-815a49af-72ba-4bb0-a23f-19f62b467141 tempest-TaggedBootDevicesTest-602522751 None] Lock "b'cinder-f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e-delete_volume'" released by "delete_volume" :: held 2.753s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:58:43.780234 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.071s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:58:43.792053 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-4346dbae-25a2-46fd-b682-ebe2ccb9df27 tempest-VolumesBackupsV39Test-610288572 None] Deleted volume successfully. Mar 05 20:58:43.805607 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 20, 58, 43, 788444)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 20:58:43.806150 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 20:58:43.806454 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Found cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 05 20:58:43.812546 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 0.032s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:58:43.814144 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 20:58:43.823632 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-4346dbae-25a2-46fd-b682-ebe2ccb9df27 tempest-VolumesBackupsV39Test-610288572 None] Lock "b'cinder-a7055011-640a-4cb4-b12b-077a721ff496-delete_volume'" released by "delete_volume" :: held 2.191s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:58:43.827621 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 20, 58, 43, 825314)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 20:58:43.828057 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 20:58:43.828696 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Creating from source image-volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7 {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 05 20:58:43.850945 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:43.915589 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] creating snapshot='volume-343d02d7-1904-4f02-a9f0-6e1deab8d765.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 20:58:44.304411 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] cloning 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7@volume-343d02d7-1904-4f02-a9f0-6e1deab8d765.clone_snap' to 'volume-343d02d7-1904-4f02-a9f0-6e1deab8d765' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 20:58:44.414733 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-e2c68a71-eb3d-4f3e-806e-dbcbf02800c4 req-0361b127-7906-4eac-b9b6-74708024a3d5 tempest-VolumesSnapshotsTestJSON-1459184426 None] Create snapshot completed successfully Mar 05 20:58:44.536672 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a.deleted is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:58:44.538288 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:58:44.538809 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:58:44.577006 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 20:58:44.577675 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Marking volume 343d02d7-1904-4f02-a9f0-6e1deab8d765 as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 20:58:44.591010 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to 343d02d7-1904-4f02-a9f0-6e1deab8d765. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 20:58:44.591630 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Creating volume glance metadata for volume 343d02d7-1904-4f02-a9f0-6e1deab8d765 backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 20:58:44.685070 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f588049f-1f35-4e72-9952-f4b8e01e7412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343d02d7-1904-4f02-a9f0-6e1deab8d765', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:44.691386 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3d717f-8e75-46e1-b254-86718884fb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:44.710559 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Volume volume-343d02d7-1904-4f02-a9f0-6e1deab8d765 (343d02d7-1904-4f02-a9f0-6e1deab8d765): created successfully Mar 05 20:58:44.717007 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3d717f-8e75-46e1-b254-86718884fb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:44.727436 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Flow 'volume_create_manager' (8b53c4df-2dab-4c08-bfcf-45e0c714e35f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:44.749016 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-723d340f-d131-41cd-8c4c-4c737bcc210e tempest-LiveMigrationTest-958104892 None] Created volume successfully. Mar 05 20:58:45.507045 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-2064bdbf-ae6e-4eab-bf1b-052b3b1caa41 req-6903bda4-5604-4e69-a244-2e52c0c49579 tempest-VolumesSnapshotsTestJSON-1459184426 None] Lock "b'cinder-4ab774c1-2d19-4e7d-a95c-e9ebd6094b31-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:58:45.509012 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-2064bdbf-ae6e-4eab-bf1b-052b3b1caa41 req-6903bda4-5604-4e69-a244-2e52c0c49579 tempest-VolumesSnapshotsTestJSON-1459184426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:45.595343 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:58:45.596272 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:45.623628 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:45.663105 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:58:46.423719 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [req-2064bdbf-ae6e-4eab-bf1b-052b3b1caa41 req-6903bda4-5604-4e69-a244-2e52c0c49579 tempest-VolumesSnapshotsTestJSON-1459184426 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Mar 05 20:58:46.448244 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [req-2064bdbf-ae6e-4eab-bf1b-052b3b1caa41 req-6903bda4-5604-4e69-a244-2e52c0c49579 tempest-VolumesSnapshotsTestJSON-1459184426 None] Created reservations ['59be6138-e763-4a3b-9e12-cf2dc9a35a4f', '3759c60c-e7cc-4a7e-9fa6-d03df81a7f0d', 'bac6d5c1-b99c-416c-ab45-2fe80f9af989', '751832ed-e304-46bb-bc09-bb20cfd3516e'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:58:46.518481 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-2064bdbf-ae6e-4eab-bf1b-052b3b1caa41 req-6903bda4-5604-4e69-a244-2e52c0c49579 tempest-VolumesSnapshotsTestJSON-1459184426 None] Delete snapshot completed successfully. Mar 05 20:58:46.527314 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-2064bdbf-ae6e-4eab-bf1b-052b3b1caa41 req-6903bda4-5604-4e69-a244-2e52c0c49579 tempest-VolumesSnapshotsTestJSON-1459184426 None] Lock "b'cinder-4ab774c1-2d19-4e7d-a95c-e9ebd6094b31-delete_snapshot'" released by "delete_snapshot" :: held 1.019s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:58:47.335028 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-d65400fe-4aca-42c9-a278-c656945769f6 req-559c3856-8583-4d99-815c-ecad342af353 tempest-VolumesSnapshotsTestJSON-1459184426 None] Lock "b'cinder-555a5c26-7277-41de-bd15-f5dccc052252-delete_volume'" acquired by "delete_volume" :: waited 0.047s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:58:47.461310 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-d65400fe-4aca-42c9-a278-c656945769f6 req-559c3856-8583-4d99-815c-ecad342af353 tempest-VolumesSnapshotsTestJSON-1459184426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:47.572524 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-d65400fe-4aca-42c9-a278-c656945769f6 req-559c3856-8583-4d99-815c-ecad342af353 tempest-VolumesSnapshotsTestJSON-1459184426 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:58:47.573172 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-d65400fe-4aca-42c9-a278-c656945769f6 req-559c3856-8583-4d99-815c-ecad342af353 tempest-VolumesSnapshotsTestJSON-1459184426 None] Volume volume-555a5c26-7277-41de-bd15-f5dccc052252 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:58:47.591796 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-d65400fe-4aca-42c9-a278-c656945769f6 req-559c3856-8583-4d99-815c-ecad342af353 tempest-VolumesSnapshotsTestJSON-1459184426 None] deleting rbd volume volume-555a5c26-7277-41de-bd15-f5dccc052252 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:58:48.029258 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [req-d65400fe-4aca-42c9-a278-c656945769f6 req-559c3856-8583-4d99-815c-ecad342af353 tempest-VolumesSnapshotsTestJSON-1459184426 None] Created reservations ['23734bd5-c8dd-42eb-8df1-ae4888edf813', 'ae132b8d-b44d-4612-b59e-26f47481b5fc', '01ed043e-3138-4e3f-9ac8-ecfeb0f9d854', '709f7be4-c870-48a9-8aeb-b7754f28efb9'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:58:48.141186 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-d65400fe-4aca-42c9-a278-c656945769f6 req-559c3856-8583-4d99-815c-ecad342af353 tempest-VolumesSnapshotsTestJSON-1459184426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:48.207892 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-d65400fe-4aca-42c9-a278-c656945769f6 req-559c3856-8583-4d99-815c-ecad342af353 tempest-VolumesSnapshotsTestJSON-1459184426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:48.268118 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [req-d65400fe-4aca-42c9-a278-c656945769f6 req-559c3856-8583-4d99-815c-ecad342af353 tempest-VolumesSnapshotsTestJSON-1459184426 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:58:48.272430 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-d65400fe-4aca-42c9-a278-c656945769f6 req-559c3856-8583-4d99-815c-ecad342af353 tempest-VolumesSnapshotsTestJSON-1459184426 None] Deleted volume successfully. Mar 05 20:58:48.290913 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-d65400fe-4aca-42c9-a278-c656945769f6 req-559c3856-8583-4d99-815c-ecad342af353 tempest-VolumesSnapshotsTestJSON-1459184426 None] Lock "b'cinder-555a5c26-7277-41de-bd15-f5dccc052252-delete_volume'" released by "delete_volume" :: held 0.956s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:58:48.998099 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:58:49.010421 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:58:49.011957 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:58:49.083130 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Flow 'volume_create_manager' (7990a084-6ef5-4b61-a5e6-628555a22e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:49.101121 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52fd2b8f-a9cb-415f-9474-2bdcab2f44e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:49.127479 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:58:49.155798 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52fd2b8f-a9cb-415f-9474-2bdcab2f44e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-791541900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=707cde8e-cfc1-4862-8674-4c8d9731352a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81011357b48d4ea48ccf7f433041dc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:58:49Z,use_quota=True,user_id='03c1e41c4ae743cc949f0d422d0fbdd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:49.162075 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040bc37c-b7f0-4e0f-8928-3875ea5925ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:49.166605 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040bc37c-b7f0-4e0f-8928-3875ea5925ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:49.172389 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1cc7f8-06ec-47ec-aa25-ca84c3b8c2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:49.312932 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1cc7f8-06ec-47ec-aa25-ca84c3b8c2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '707cde8e-cfc1-4862-8674-4c8d9731352a', 'volume_name': 'volume-707cde8e-cfc1-4862-8674-4c8d9731352a', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:49.332064 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef89fa5-f0b3-4e84-9122-9495ffc15e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:49.367440 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef89fa5-f0b3-4e84-9122-9495ffc15e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:49.373874 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a176aefb-1fa6-4ceb-bd66-7ab88eeae5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:49.376492 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Volume 707cde8e-cfc1-4862-8674-4c8d9731352a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-707cde8e-cfc1-4862-8674-4c8d9731352a', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 20:58:49.377431 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Cloning 707cde8e-cfc1-4862-8674-4c8d9731352a from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 20:58:49.395762 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.017s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:58:49.412031 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 20, 58, 49, 402857)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 20:58:49.413206 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 20:58:49.414004 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Found cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 05 20:58:49.428233 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 0.032s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:58:49.429442 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 20:58:49.436680 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 20, 58, 49, 434124)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 20:58:49.437479 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 20:58:49.438181 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Creating from source image-volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7 {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 05 20:58:49.456553 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:49.551551 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] creating snapshot='volume-707cde8e-cfc1-4862-8674-4c8d9731352a.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 20:58:50.026906 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] cloning 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7@volume-707cde8e-cfc1-4862-8674-4c8d9731352a.clone_snap' to 'volume-707cde8e-cfc1-4862-8674-4c8d9731352a' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 20:58:50.056138 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-7852c66a-e10c-4299-89f7-72107f5a6815 req-1670bde8-5d3a-41b5-8414-a4e6224fd565 tempest-LiveMigrationTest-958104892 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:58:50.245478 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a.deleted is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:58:50.246943 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:58:50.247566 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:58:50.277989 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 20:58:50.280425 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Marking volume 707cde8e-cfc1-4862-8674-4c8d9731352a as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 20:58:50.296277 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to 707cde8e-cfc1-4862-8674-4c8d9731352a. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 20:58:50.296967 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Creating volume glance metadata for volume 707cde8e-cfc1-4862-8674-4c8d9731352a backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 20:58:50.406132 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a176aefb-1fa6-4ceb-bd66-7ab88eeae5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707cde8e-cfc1-4862-8674-4c8d9731352a', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:50.412214 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f998852f-5ecc-4822-ac66-3fdd6743cd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:50.426733 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Volume volume-707cde8e-cfc1-4862-8674-4c8d9731352a (707cde8e-cfc1-4862-8674-4c8d9731352a): created successfully Mar 05 20:58:50.434683 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f998852f-5ecc-4822-ac66-3fdd6743cd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:50.443970 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Flow 'volume_create_manager' (7990a084-6ef5-4b61-a5e6-628555a22e3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:50.473865 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d8db13dd-c537-4cd0-9286-0dd05b822bba tempest-VolumesExtendTest-1607009964 None] Created volume successfully. Mar 05 20:58:51.086532 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-7852c66a-e10c-4299-89f7-72107f5a6815 req-1670bde8-5d3a-41b5-8414-a4e6224fd565 tempest-LiveMigrationTest-958104892 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.030s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:58:51.089215 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-7852c66a-e10c-4299-89f7-72107f5a6815 req-1670bde8-5d3a-41b5-8414-a4e6224fd565 tempest-LiveMigrationTest-958104892 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-343d02d7-1904-4f02-a9f0-6e1deab8d765', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '343d02d7-1904-4f02-a9f0-6e1deab8d765', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:58:51.123396 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-7852c66a-e10c-4299-89f7-72107f5a6815 req-1670bde8-5d3a-41b5-8414-a4e6224fd565 tempest-LiveMigrationTest-958104892 None] Connection info returned from driver {'name': 'volumes/volume-343d02d7-1904-4f02-a9f0-6e1deab8d765', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '343d02d7-1904-4f02-a9f0-6e1deab8d765', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '45d91163-e509-4829-a1f9-0a278993c903'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 20:58:51.203580 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-7852c66a-e10c-4299-89f7-72107f5a6815 req-1670bde8-5d3a-41b5-8414-a4e6224fd565 tempest-LiveMigrationTest-958104892 None] attachment_update completed successfully. Mar 05 20:58:51.445386 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6ef4be6f-8526-4cfe-a810-521f7a5efe5f tempest-VolumesExtendTest-1607009964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:51.676166 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6ef4be6f-8526-4cfe-a810-521f7a5efe5f tempest-VolumesExtendTest-1607009964 None] Extend volume from 1 GB to 2 GB. {{(pid=134747) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Mar 05 20:58:51.750372 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6ef4be6f-8526-4cfe-a810-521f7a5efe5f tempest-VolumesExtendTest-1607009964 None] Extend volume completed successfully. Mar 05 20:58:53.543504 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:58:53.592760 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:58:53.593879 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:58:53.626248 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Flow 'volume_create_manager' (5eda151b-ffef-46e3-9169-c6074ba46f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:53.656401 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2962a0-87c3-4895-b5be-a3acde86094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:53.676713 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:58:53.713896 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2962a0-87c3-4895-b5be-a3acde86094e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-486779594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=98eac049-e2fd-4d8d-9b34-aa5642db7da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81011357b48d4ea48ccf7f433041dc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:58:53Z,use_quota=True,user_id='03c1e41c4ae743cc949f0d422d0fbdd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:53.747056 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cf1953-172a-4aca-ab7c-697aa015edf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:53.761363 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cf1953-172a-4aca-ab7c-697aa015edf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:53.782364 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d39c76-0281-4809-a5b4-cd1039c8f873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:53.789524 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d39c76-0281-4809-a5b4-cd1039c8f873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98eac049-e2fd-4d8d-9b34-aa5642db7da9', 'volume_name': 'volume-98eac049-e2fd-4d8d-9b34-aa5642db7da9', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:53.796764 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce9ff8a-e0ec-4aab-9771-98fa07b3b0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:53.801231 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce9ff8a-e0ec-4aab-9771-98fa07b3b0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:53.807286 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f33ccc-8213-4654-b6d9-5058e09d427c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:53.809322 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Volume 98eac049-e2fd-4d8d-9b34-aa5642db7da9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98eac049-e2fd-4d8d-9b34-aa5642db7da9', 'volume_size': 1} Mar 05 20:58:53.809917 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] creating volume 'volume-98eac049-e2fd-4d8d-9b34-aa5642db7da9' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:58:53.811643 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:54.038505 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:58:54.043024 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:58:54.043728 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:58:54.091355 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Flow 'volume_create_manager' (fdca0277-52aa-428e-8c2c-78fd0080d7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:54.106059 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c89ade-fb43-43f3-b756-036af1340dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:54.128167 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:58:54.128556 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:58:54.133360 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f33ccc-8213-4654-b6d9-5058e09d427c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98eac049-e2fd-4d8d-9b34-aa5642db7da9', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:54.146197 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb70b6a5-7811-4e1a-adae-bcf6c850190e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:54.155974 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:58:54.178286 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c89ade-fb43-43f3-b756-036af1340dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-602581320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e31a6df1-b1e1-425b-a125-603d8f627046,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2f96112fc85849a7b76d1850a749e38d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:58:54Z,use_quota=True,user_id='d48b9b90d96844d7be116c0eecb43985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:54.193021 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6a1511-c483-4272-897b-24b67ab9fe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:54.198249 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6a1511-c483-4272-897b-24b67ab9fe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:54.206814 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1685bd-3713-4de8-a0c6-8c202a93ab1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:54.219611 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1685bd-3713-4de8-a0c6-8c202a93ab1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31a6df1-b1e1-425b-a125-603d8f627046', 'volume_name': 'volume-e31a6df1-b1e1-425b-a125-603d8f627046', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:54.236699 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8189a2de-166a-44bc-a13f-ffdac61939b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:54.241957 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8189a2de-166a-44bc-a13f-ffdac61939b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:54.249140 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045fe484-eb23-4629-a970-6cbed5bdc828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:54.250534 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Volume e31a6df1-b1e1-425b-a125-603d8f627046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31a6df1-b1e1-425b-a125-603d8f627046', 'volume_size': 1} Mar 05 20:58:54.251184 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] creating volume 'volume-e31a6df1-b1e1-425b-a125-603d8f627046' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:58:54.253539 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:54.294193 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Volume volume-98eac049-e2fd-4d8d-9b34-aa5642db7da9 (98eac049-e2fd-4d8d-9b34-aa5642db7da9): created successfully Mar 05 20:58:54.298676 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb70b6a5-7811-4e1a-adae-bcf6c850190e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:54.310776 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Flow 'volume_create_manager' (5eda151b-ffef-46e3-9169-c6074ba46f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:54.322919 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-fb596941-2dfc-417f-8e73-b0c345448407 tempest-VolumesExtendTest-1607009964 None] Created volume successfully. Mar 05 20:58:54.356436 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:58:54.356829 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:58:54.361079 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045fe484-eb23-4629-a970-6cbed5bdc828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31a6df1-b1e1-425b-a125-603d8f627046', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:54.366863 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7f2603-d549-4dd5-a827-24dc2f17494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:58:54.379289 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Volume volume-e31a6df1-b1e1-425b-a125-603d8f627046 (e31a6df1-b1e1-425b-a125-603d8f627046): created successfully Mar 05 20:58:54.384004 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7f2603-d549-4dd5-a827-24dc2f17494c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:58:54.405727 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Flow 'volume_create_manager' (fdca0277-52aa-428e-8c2c-78fd0080d7df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:58:54.419283 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-ac628f21-70a9-4fd1-afc4-2fd179b34efe req-6ed05d9a-3235-4188-9777-f5fd53bfa722 tempest-VolumesGetTestJSON-1870238009 None] Created volume successfully. Mar 05 20:58:54.872322 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b65f0bb6-16bd-42a1-a1c6-f4f1e52ca180 tempest-VolumesExtendTest-1607009964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:55.377315 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-83a35718-a0cc-4259-9a4e-b025aedce914 req-84e59338-18c8-49ad-bc13-9945cb6d1da2 tempest-VolumesGetTestJSON-1870238009 None] Lock "b'cinder-e31a6df1-b1e1-425b-a125-603d8f627046-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:58:55.453011 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-83a35718-a0cc-4259-9a4e-b025aedce914 req-84e59338-18c8-49ad-bc13-9945cb6d1da2 tempest-VolumesGetTestJSON-1870238009 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:55.536844 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-83a35718-a0cc-4259-9a4e-b025aedce914 req-84e59338-18c8-49ad-bc13-9945cb6d1da2 tempest-VolumesGetTestJSON-1870238009 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:58:55.537296 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-83a35718-a0cc-4259-9a4e-b025aedce914 req-84e59338-18c8-49ad-bc13-9945cb6d1da2 tempest-VolumesGetTestJSON-1870238009 None] Volume volume-e31a6df1-b1e1-425b-a125-603d8f627046 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:58:55.555174 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-83a35718-a0cc-4259-9a4e-b025aedce914 req-84e59338-18c8-49ad-bc13-9945cb6d1da2 tempest-VolumesGetTestJSON-1870238009 None] deleting rbd volume volume-e31a6df1-b1e1-425b-a125-603d8f627046 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:58:55.968087 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [req-83a35718-a0cc-4259-9a4e-b025aedce914 req-84e59338-18c8-49ad-bc13-9945cb6d1da2 tempest-VolumesGetTestJSON-1870238009 None] Created reservations ['787d2df5-b463-4daa-9aa7-1da47dc0561e', '743a1444-e459-46c7-ba71-e64c6447716d', '8928f695-3d51-4a41-9525-dff1e5b704fd', '3cb93239-9bd3-461b-a088-8247647eda74'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:58:56.058959 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-83a35718-a0cc-4259-9a4e-b025aedce914 req-84e59338-18c8-49ad-bc13-9945cb6d1da2 tempest-VolumesGetTestJSON-1870238009 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:56.127644 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-83a35718-a0cc-4259-9a4e-b025aedce914 req-84e59338-18c8-49ad-bc13-9945cb6d1da2 tempest-VolumesGetTestJSON-1870238009 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:56.172361 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [req-83a35718-a0cc-4259-9a4e-b025aedce914 req-84e59338-18c8-49ad-bc13-9945cb6d1da2 tempest-VolumesGetTestJSON-1870238009 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:58:56.184617 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-83a35718-a0cc-4259-9a4e-b025aedce914 req-84e59338-18c8-49ad-bc13-9945cb6d1da2 tempest-VolumesGetTestJSON-1870238009 None] Deleted volume successfully. Mar 05 20:58:56.205517 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-83a35718-a0cc-4259-9a4e-b025aedce914 req-84e59338-18c8-49ad-bc13-9945cb6d1da2 tempest-VolumesGetTestJSON-1870238009 None] Lock "b'cinder-e31a6df1-b1e1-425b-a125-603d8f627046-delete_volume'" released by "delete_volume" :: held 0.827s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:58:56.238430 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b65f0bb6-16bd-42a1-a1c6-f4f1e52ca180 tempest-VolumesExtendTest-1607009964 None] Create snapshot completed successfully Mar 05 20:58:57.071121 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-bda18fc7-af7c-4f98-abd0-1229f625803b tempest-VolumesExtendTest-1607009964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:57.207087 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-bda18fc7-af7c-4f98-abd0-1229f625803b tempest-VolumesExtendTest-1607009964 None] Extend volume from 1 GB to 2 GB. {{(pid=134747) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Mar 05 20:58:57.233513 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-bda18fc7-af7c-4f98-abd0-1229f625803b tempest-VolumesExtendTest-1607009964 None] Extend volume completed successfully. Mar 05 20:58:58.424025 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-3b7ddc26-0b22-4746-8264-1d22201bb836 tempest-VolumesExtendTest-1607009964 None] Lock "b'cinder-9b971996-bdc1-4ec8-855f-231bdb35ff12-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:58:58.426307 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3b7ddc26-0b22-4746-8264-1d22201bb836 tempest-VolumesExtendTest-1607009964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:59.231619 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-3b7ddc26-0b22-4746-8264-1d22201bb836 tempest-VolumesExtendTest-1607009964 None] Created reservations ['25b18f47-c690-4a9f-be35-adec9f1b7ba3', '074401d3-3c2b-4966-aa43-d20313403d24', '31f4715d-ce9f-4f9b-803f-e6ec827791d2', '2e211608-078d-460f-96e4-350b5182ef79'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:58:59.316606 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-3b7ddc26-0b22-4746-8264-1d22201bb836 tempest-VolumesExtendTest-1607009964 None] Delete snapshot completed successfully. Mar 05 20:58:59.323377 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-3b7ddc26-0b22-4746-8264-1d22201bb836 tempest-VolumesExtendTest-1607009964 None] Lock "b'cinder-9b971996-bdc1-4ec8-855f-231bdb35ff12-delete_snapshot'" released by "delete_snapshot" :: held 0.899s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:58:59.601653 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b682199f-ac42-44d7-a235-dc8d50ecdd76 tempest-VolumesExtendTest-1607009964 None] Lock "b'cinder-98eac049-e2fd-4d8d-9b34-aa5642db7da9-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:58:59.688166 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b682199f-ac42-44d7-a235-dc8d50ecdd76 tempest-VolumesExtendTest-1607009964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:58:59.768613 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b682199f-ac42-44d7-a235-dc8d50ecdd76 tempest-VolumesExtendTest-1607009964 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:58:59.769043 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b682199f-ac42-44d7-a235-dc8d50ecdd76 tempest-VolumesExtendTest-1607009964 None] Volume volume-98eac049-e2fd-4d8d-9b34-aa5642db7da9 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:58:59.784729 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b682199f-ac42-44d7-a235-dc8d50ecdd76 tempest-VolumesExtendTest-1607009964 None] deleting rbd volume volume-98eac049-e2fd-4d8d-9b34-aa5642db7da9 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:59:00.348752 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-b682199f-ac42-44d7-a235-dc8d50ecdd76 tempest-VolumesExtendTest-1607009964 None] Created reservations ['0e1dbaa6-c672-4fe4-b209-c36056dc39ac', 'a8fb769f-ea0e-4d5a-b1d4-dc8803bf500e', '2538f8d5-3a75-4395-bf33-e067f6af1c21', '32d7e7af-dc32-4be4-8e91-ecf5a0f49ee3'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:59:00.491780 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b682199f-ac42-44d7-a235-dc8d50ecdd76 tempest-VolumesExtendTest-1607009964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:00.552619 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b682199f-ac42-44d7-a235-dc8d50ecdd76 tempest-VolumesExtendTest-1607009964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:00.611159 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-b682199f-ac42-44d7-a235-dc8d50ecdd76 tempest-VolumesExtendTest-1607009964 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:00.618493 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b682199f-ac42-44d7-a235-dc8d50ecdd76 tempest-VolumesExtendTest-1607009964 None] Deleted volume successfully. Mar 05 20:59:00.638920 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b682199f-ac42-44d7-a235-dc8d50ecdd76 tempest-VolumesExtendTest-1607009964 None] Lock "b'cinder-98eac049-e2fd-4d8d-9b34-aa5642db7da9-delete_volume'" released by "delete_volume" :: held 1.037s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:59:00.947358 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-fc349a8b-d42c-4afe-919e-fff91f1e176a tempest-VolumesExtendTest-1607009964 None] Lock "b'cinder-707cde8e-cfc1-4862-8674-4c8d9731352a-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:59:01.021628 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fc349a8b-d42c-4afe-919e-fff91f1e176a tempest-VolumesExtendTest-1607009964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:01.160183 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fc349a8b-d42c-4afe-919e-fff91f1e176a tempest-VolumesExtendTest-1607009964 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:59:01.180097 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fc349a8b-d42c-4afe-919e-fff91f1e176a tempest-VolumesExtendTest-1607009964 None] deleting rbd volume volume-707cde8e-cfc1-4862-8674-4c8d9731352a {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:59:01.585486 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fc349a8b-d42c-4afe-919e-fff91f1e176a tempest-VolumesExtendTest-1607009964 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 20:59:01.636636 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fc349a8b-d42c-4afe-919e-fff91f1e176a tempest-VolumesExtendTest-1607009964 None] deleting parent snapshot volume-707cde8e-cfc1-4862-8674-4c8d9731352a.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 20:59:02.249769 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-fc349a8b-d42c-4afe-919e-fff91f1e176a tempest-VolumesExtendTest-1607009964 None] Created reservations ['fa83c29c-6ecf-4db4-9a8b-347150a56486', '162ed3de-cc47-4a10-a2de-7639fae83539', '228c3452-ba76-4ec3-986f-71a9e134f451', 'ede18513-6ca3-4ada-9a84-57e9bd4712f8'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:59:02.329034 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fc349a8b-d42c-4afe-919e-fff91f1e176a tempest-VolumesExtendTest-1607009964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:02.385882 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fc349a8b-d42c-4afe-919e-fff91f1e176a tempest-VolumesExtendTest-1607009964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:02.465202 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-fc349a8b-d42c-4afe-919e-fff91f1e176a tempest-VolumesExtendTest-1607009964 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:02.471336 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-fc349a8b-d42c-4afe-919e-fff91f1e176a tempest-VolumesExtendTest-1607009964 None] Deleted volume successfully. Mar 05 20:59:02.489374 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-fc349a8b-d42c-4afe-919e-fff91f1e176a tempest-VolumesExtendTest-1607009964 None] Lock "b'cinder-707cde8e-cfc1-4862-8674-4c8d9731352a-delete_volume'" released by "delete_volume" :: held 1.542s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:59:09.333203 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:59:09.345425 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:59:09.345948 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:59:09.387479 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Flow 'volume_create_manager' (901c4704-da40-4abe-b741-03d68c2996f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:09.406031 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515becdf-6778-4d3b-b38a-25b36bcc32bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:09.419187 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:59:09.453968 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515becdf-6778-4d3b-b38a-25b36bcc32bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-838630603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8240a6ab-128e-451a-b6b7-c97623ba6643,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c9ee06ab238046948aa467052422c6d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:59:09Z,use_quota=True,user_id='796fc840762a4ce892e02b897cae4905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:09.474072 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f8a216-5cfc-4857-98ba-6445b907e9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:09.484769 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f8a216-5cfc-4857-98ba-6445b907e9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:09.501194 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b28e7f-421b-4850-bc43-3bdfe7c2bbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:09.512454 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b28e7f-421b-4850-bc43-3bdfe7c2bbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8240a6ab-128e-451a-b6b7-c97623ba6643', 'volume_name': 'volume-8240a6ab-128e-451a-b6b7-c97623ba6643', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:09.529957 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3703c92a-a6c0-403c-ae50-cc1ced73e2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:09.543278 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3703c92a-a6c0-403c-ae50-cc1ced73e2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:09.568884 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8dd3c49-8f69-4a60-8268-b41075723846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:09.574344 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Volume 8240a6ab-128e-451a-b6b7-c97623ba6643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8240a6ab-128e-451a-b6b7-c97623ba6643', 'volume_size': 1} Mar 05 20:59:09.575392 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] creating volume 'volume-8240a6ab-128e-451a-b6b7-c97623ba6643' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:59:09.576659 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:09.704360 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:59:09.705218 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:59:09.710533 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8dd3c49-8f69-4a60-8268-b41075723846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8240a6ab-128e-451a-b6b7-c97623ba6643', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:09.720811 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b6d414-c76b-4560-a035-60be71f335e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:09.746759 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Volume volume-8240a6ab-128e-451a-b6b7-c97623ba6643 (8240a6ab-128e-451a-b6b7-c97623ba6643): created successfully Mar 05 20:59:09.757990 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b6d414-c76b-4560-a035-60be71f335e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:09.770105 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Flow 'volume_create_manager' (901c4704-da40-4abe-b741-03d68c2996f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:09.786069 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-026bdbb7-48b4-4886-a8fe-a518a1cb5874 tempest-VolumesGetTest-525195791 None] Created volume successfully. Mar 05 20:59:11.084021 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-a112856c-94c2-41ab-a071-ff3ca50138df req-cfb8a3a3-644a-4519-95e6-420abfb18467 tempest-LiveMigrationTest-747499185 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:59:11.953201 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:59:11.958725 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:59:11.960776 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:59:12.010851 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Flow 'volume_create_manager' (0a6825f3-9643-4f5f-8a76-1039392bd22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:12.028366 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf08997-c94a-444c-b7e8-980d6a923c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:12.041337 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:59:12.076508 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf08997-c94a-444c-b7e8-980d6a923c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:59:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1615929844',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f139fdfc-7888-4cf7-a52c-83d9e4cc41fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ee06ab238046948aa467052422c6d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:59:12Z,use_quota=True,user_id='796fc840762a4ce892e02b897cae4905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:12.102263 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7c89a0-25c4-4ac3-81e9-96ad4d827bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:12.107038 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7c89a0-25c4-4ac3-81e9-96ad4d827bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:12.113988 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a5ae68-c0d0-45fa-847c-8a31f4530bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:12.123879 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a5ae68-c0d0-45fa-847c-8a31f4530bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f139fdfc-7888-4cf7-a52c-83d9e4cc41fa', 'volume_name': 'volume-f139fdfc-7888-4cf7-a52c-83d9e4cc41fa', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:12.141519 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957e5341-5f95-47fa-8cfc-2ba65da1b183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:12.151123 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957e5341-5f95-47fa-8cfc-2ba65da1b183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:12.162899 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb857c0-2522-4f47-8c3b-2a81b4cae30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:12.174786 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Volume f139fdfc-7888-4cf7-a52c-83d9e4cc41fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f139fdfc-7888-4cf7-a52c-83d9e4cc41fa', 'volume_size': 1} Mar 05 20:59:12.175209 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] creating volume 'volume-f139fdfc-7888-4cf7-a52c-83d9e4cc41fa' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:59:12.177812 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:12.313301 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:59:12.313688 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:59:12.327041 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb857c0-2522-4f47-8c3b-2a81b4cae30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f139fdfc-7888-4cf7-a52c-83d9e4cc41fa', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:12.334593 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7308f39-89f3-4487-b032-484c3b9c22bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:12.365037 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Volume volume-f139fdfc-7888-4cf7-a52c-83d9e4cc41fa (f139fdfc-7888-4cf7-a52c-83d9e4cc41fa): created successfully Mar 05 20:59:12.370078 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7308f39-89f3-4487-b032-484c3b9c22bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:12.375716 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Flow 'volume_create_manager' (0a6825f3-9643-4f5f-8a76-1039392bd22e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:12.398471 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f189bde6-f13d-4f54-93ec-92adab74750b tempest-VolumesGetTest-525195791 None] Created volume successfully. Mar 05 20:59:12.651390 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-a112856c-94c2-41ab-a071-ff3ca50138df req-cfb8a3a3-644a-4519-95e6-420abfb18467 tempest-LiveMigrationTest-747499185 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.567s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:59:12.652125 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-a112856c-94c2-41ab-a071-ff3ca50138df req-cfb8a3a3-644a-4519-95e6-420abfb18467 tempest-LiveMigrationTest-747499185 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-343d02d7-1904-4f02-a9f0-6e1deab8d765', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '343d02d7-1904-4f02-a9f0-6e1deab8d765', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 20:59:12.707554 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-a112856c-94c2-41ab-a071-ff3ca50138df req-cfb8a3a3-644a-4519-95e6-420abfb18467 tempest-LiveMigrationTest-747499185 None] Connection info returned from driver {'name': 'volumes/volume-343d02d7-1904-4f02-a9f0-6e1deab8d765', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '343d02d7-1904-4f02-a9f0-6e1deab8d765', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fe63ec5e-503d-4557-9727-13723dcdd28e'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 20:59:12.864387 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-a112856c-94c2-41ab-a071-ff3ca50138df req-cfb8a3a3-644a-4519-95e6-420abfb18467 tempest-LiveMigrationTest-747499185 None] attachment_update completed successfully. Mar 05 20:59:13.035903 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ff53827a-a190-4664-9ea9-73f8bd752852 tempest-VolumesGetTest-525195791 None] Lock "b'cinder-f139fdfc-7888-4cf7-a52c-83d9e4cc41fa-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:59:13.106615 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ff53827a-a190-4664-9ea9-73f8bd752852 tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:13.207662 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ff53827a-a190-4664-9ea9-73f8bd752852 tempest-VolumesGetTest-525195791 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:59:13.208133 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ff53827a-a190-4664-9ea9-73f8bd752852 tempest-VolumesGetTest-525195791 None] Volume volume-f139fdfc-7888-4cf7-a52c-83d9e4cc41fa is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:59:13.220253 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ff53827a-a190-4664-9ea9-73f8bd752852 tempest-VolumesGetTest-525195791 None] deleting rbd volume volume-f139fdfc-7888-4cf7-a52c-83d9e4cc41fa {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:59:13.662186 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-ff53827a-a190-4664-9ea9-73f8bd752852 tempest-VolumesGetTest-525195791 None] Created reservations ['678b8e57-a8d4-4cf8-9d15-667f8dfbbe59', '299d8960-e53f-4cb2-8084-874a2005816f', 'd90dcf35-9829-4794-b064-b58947cfe7fd', '6aed9d93-87ff-43bf-b47c-1ff6e91b3b67'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:59:13.739597 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ff53827a-a190-4664-9ea9-73f8bd752852 tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:13.811772 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ff53827a-a190-4664-9ea9-73f8bd752852 tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:13.880486 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-ff53827a-a190-4664-9ea9-73f8bd752852 tempest-VolumesGetTest-525195791 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:13.892082 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ff53827a-a190-4664-9ea9-73f8bd752852 tempest-VolumesGetTest-525195791 None] Deleted volume successfully. Mar 05 20:59:13.926884 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ff53827a-a190-4664-9ea9-73f8bd752852 tempest-VolumesGetTest-525195791 None] Lock "b'cinder-f139fdfc-7888-4cf7-a52c-83d9e4cc41fa-delete_volume'" released by "delete_volume" :: held 0.891s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:59:14.288001 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-c5a9fb1a-953c-485c-a5c2-1f1468b2a18c tempest-VolumesGetTest-525195791 None] Lock "b'cinder-8240a6ab-128e-451a-b6b7-c97623ba6643-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:59:14.354550 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c5a9fb1a-953c-485c-a5c2-1f1468b2a18c tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:14.441781 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c5a9fb1a-953c-485c-a5c2-1f1468b2a18c tempest-VolumesGetTest-525195791 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:59:14.442368 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c5a9fb1a-953c-485c-a5c2-1f1468b2a18c tempest-VolumesGetTest-525195791 None] Volume volume-8240a6ab-128e-451a-b6b7-c97623ba6643 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:59:14.454390 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c5a9fb1a-953c-485c-a5c2-1f1468b2a18c tempest-VolumesGetTest-525195791 None] deleting rbd volume volume-8240a6ab-128e-451a-b6b7-c97623ba6643 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:59:14.860517 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-c5a9fb1a-953c-485c-a5c2-1f1468b2a18c tempest-VolumesGetTest-525195791 None] Created reservations ['a277039f-00d0-49fb-bf75-4089c25320c4', 'a505c1a5-ab61-452d-b944-4fdb8d692bda', '4afd1d2d-ce14-45b5-a492-2233fe517969', '54f926c5-3f0d-4580-b903-4748f8d4d5cd'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:59:14.952250 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c5a9fb1a-953c-485c-a5c2-1f1468b2a18c tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:15.038276 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c5a9fb1a-953c-485c-a5c2-1f1468b2a18c tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:15.093741 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-c5a9fb1a-953c-485c-a5c2-1f1468b2a18c tempest-VolumesGetTest-525195791 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:15.116216 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c5a9fb1a-953c-485c-a5c2-1f1468b2a18c tempest-VolumesGetTest-525195791 None] Deleted volume successfully. Mar 05 20:59:15.139144 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-c5a9fb1a-953c-485c-a5c2-1f1468b2a18c tempest-VolumesGetTest-525195791 None] Lock "b'cinder-8240a6ab-128e-451a-b6b7-c97623ba6643-delete_volume'" released by "delete_volume" :: held 0.851s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:59:16.132761 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:59:16.139439 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:59:16.141163 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:59:16.166478 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Flow 'volume_create_manager' (349360b6-0e72-479f-b353-ddd180c4e253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:16.173746 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0767338d-6e60-47de-955b-3b8e414a1719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:16.184515 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:59:16.203540 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0767338d-6e60-47de-955b-3b8e414a1719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2035631670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d41a6161-baa6-45f1-abcc-8fe9a11c8c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ee06ab238046948aa467052422c6d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:59:16Z,use_quota=True,user_id='796fc840762a4ce892e02b897cae4905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:16.210785 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95c1604-fc6c-4c1a-aa32-427999aca9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:16.215215 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95c1604-fc6c-4c1a-aa32-427999aca9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:16.221534 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620db2ea-7157-4a70-bb9b-808a86a2d09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:16.226248 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620db2ea-7157-4a70-bb9b-808a86a2d09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd41a6161-baa6-45f1-abcc-8fe9a11c8c58', 'volume_name': 'volume-d41a6161-baa6-45f1-abcc-8fe9a11c8c58', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:16.232468 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af35f2b-0698-4b6e-81d7-657d7de60c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:16.237822 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af35f2b-0698-4b6e-81d7-657d7de60c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:16.243369 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc082be-95cc-4fb4-96bd-f4c412079764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:16.244850 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Volume d41a6161-baa6-45f1-abcc-8fe9a11c8c58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d41a6161-baa6-45f1-abcc-8fe9a11c8c58', 'volume_size': 1} Mar 05 20:59:16.246134 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] creating volume 'volume-d41a6161-baa6-45f1-abcc-8fe9a11c8c58' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:59:16.247521 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:16.377623 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:59:16.378088 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:59:16.382337 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc082be-95cc-4fb4-96bd-f4c412079764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d41a6161-baa6-45f1-abcc-8fe9a11c8c58', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:16.387514 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee371a3-efc1-4d1c-97d8-4f587f71cfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:16.416362 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Volume volume-d41a6161-baa6-45f1-abcc-8fe9a11c8c58 (d41a6161-baa6-45f1-abcc-8fe9a11c8c58): created successfully Mar 05 20:59:16.421586 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee371a3-efc1-4d1c-97d8-4f587f71cfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:16.433669 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Flow 'volume_create_manager' (349360b6-0e72-479f-b353-ddd180c4e253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:16.454712 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-5dd3b08b-4441-42fb-abe5-a74142bb3887 tempest-VolumesGetTest-525195791 None] Created volume successfully. Mar 05 20:59:17.921841 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:59:17.928519 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:59:17.929311 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:59:17.979984 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Flow 'volume_create_manager' (326e5882-ec6a-4dc0-af2c-443c7f543a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:17.994949 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d1a9e6-8386-4cb4-892d-52681d768c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:18.003972 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:59:18.026450 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d1a9e6-8386-4cb4-892d-52681d768c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1158086155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0c4b78dc-3396-40be-8f61-f3d3453b5daf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c9ee06ab238046948aa467052422c6d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d41a6161-baa6-45f1-abcc-8fe9a11c8c58,status='creating',terminated_at=None,updated_at=2022-03-05T20:59:18Z,use_quota=True,user_id='796fc840762a4ce892e02b897cae4905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:18.033083 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dcd7a3b-dab6-4a92-b933-7ade09301b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:18.038837 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dcd7a3b-dab6-4a92-b933-7ade09301b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:18.046055 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414ae7f6-7443-49d6-8a6f-008a96342e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:18.074965 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414ae7f6-7443-49d6-8a6f-008a96342e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0c4b78dc-3396-40be-8f61-f3d3453b5daf', 'volume_name': 'volume-0c4b78dc-3396-40be-8f61-f3d3453b5daf', 'volume_size': 1, 'source_volid': 'd41a6161-baa6-45f1-abcc-8fe9a11c8c58', 'source_volstatus': 'available'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:18.092047 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74e8202-c3ad-4c85-9a37-0173c5cb8f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:18.103862 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74e8202-c3ad-4c85-9a37-0173c5cb8f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:18.119815 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f1a385-26e7-47c6-9d53-552af4ed6d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:18.121498 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Volume 0c4b78dc-3396-40be-8f61-f3d3453b5daf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0c4b78dc-3396-40be-8f61-f3d3453b5daf', 'volume_size': 1, 'source_volid': 'd41a6161-baa6-45f1-abcc-8fe9a11c8c58', 'source_volstatus': 'available'} Mar 05 20:59:18.154649 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:18.258525 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] creating snapshot='volume-0c4b78dc-3396-40be-8f61-f3d3453b5daf.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 20:59:18.552712 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] cloning 'volume-d41a6161-baa6-45f1-abcc-8fe9a11c8c58@volume-0c4b78dc-3396-40be-8f61-f3d3453b5daf.clone_snap' to 'volume-0c4b78dc-3396-40be-8f61-f3d3453b5daf' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 20:59:18.759749 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Volume volume-d41a6161-baa6-45f1-abcc-8fe9a11c8c58 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:59:18.760872 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:59:18.761259 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:59:18.801833 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 20:59:18.813175 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f1a385-26e7-47c6-9d53-552af4ed6d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c4b78dc-3396-40be-8f61-f3d3453b5daf', 'volume_size': 1, 'source_volid': 'd41a6161-baa6-45f1-abcc-8fe9a11c8c58', 'source_volstatus': 'available'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:18.830282 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330d63c9-a721-4793-ae20-d7b8ea4744f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:18.852353 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Volume volume-0c4b78dc-3396-40be-8f61-f3d3453b5daf (0c4b78dc-3396-40be-8f61-f3d3453b5daf): created successfully Mar 05 20:59:18.856852 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330d63c9-a721-4793-ae20-d7b8ea4744f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:18.867606 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Flow 'volume_create_manager' (326e5882-ec6a-4dc0-af2c-443c7f543a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:18.905420 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-4b79fd43-5db0-46a9-9dc8-1896659147e4 tempest-VolumesGetTest-525195791 None] Created volume successfully. Mar 05 20:59:21.365808 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:59:21.369847 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:59:21.370511 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:59:21.412384 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Flow 'volume_create_manager' (a0e94015-4677-4f5d-99f9-810498dfcf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:21.423188 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673517ac-bd24-444f-b40a-3271f08b730d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:21.445096 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:59:21.472221 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673517ac-bd24-444f-b40a-3271f08b730d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:59:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2007835067',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d13e559-6709-43cb-811a-35e5478632a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ee06ab238046948aa467052422c6d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:59:21Z,use_quota=True,user_id='796fc840762a4ce892e02b897cae4905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:21.487105 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa39f328-cbfc-4d3e-b78d-8940eb2f416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:21.491954 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa39f328-cbfc-4d3e-b78d-8940eb2f416c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:21.505089 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e13cc77-0cd6-40c8-a5f9-61998469eaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:21.511751 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e13cc77-0cd6-40c8-a5f9-61998469eaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d13e559-6709-43cb-811a-35e5478632a6', 'volume_name': 'volume-5d13e559-6709-43cb-811a-35e5478632a6', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:21.517611 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba66c14d-ca93-438c-9327-652bde44dfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:21.536551 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba66c14d-ca93-438c-9327-652bde44dfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:21.548098 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5348b662-1be5-4ce3-a512-02d5eb41d591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:21.553051 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Volume 5d13e559-6709-43cb-811a-35e5478632a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d13e559-6709-43cb-811a-35e5478632a6', 'volume_size': 1} Mar 05 20:59:21.555462 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] creating volume 'volume-5d13e559-6709-43cb-811a-35e5478632a6' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:59:21.556711 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:21.679648 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:59:21.680043 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:59:21.684212 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5348b662-1be5-4ce3-a512-02d5eb41d591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d13e559-6709-43cb-811a-35e5478632a6', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:21.701462 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8f3e2c-7c3e-4571-a233-8bde41ee58eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:21.724558 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Volume volume-5d13e559-6709-43cb-811a-35e5478632a6 (5d13e559-6709-43cb-811a-35e5478632a6): created successfully Mar 05 20:59:21.736230 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8f3e2c-7c3e-4571-a233-8bde41ee58eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:21.749504 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Flow 'volume_create_manager' (a0e94015-4677-4f5d-99f9-810498dfcf01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:21.772348 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-9460ccce-45ac-4882-a0f3-a93fcafd1b37 tempest-VolumesGetTest-525195791 None] Created volume successfully. Mar 05 20:59:22.667893 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-a112856c-94c2-41ab-a071-ff3ca50138df req-2c6233f0-8f83-49b4-8301-f96dd8263205 tempest-LiveMigrationTest-747499185 None] Terminate volume connection completed successfully. Mar 05 20:59:22.679490 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-a112856c-94c2-41ab-a071-ff3ca50138df req-2c6233f0-8f83-49b4-8301-f96dd8263205 tempest-LiveMigrationTest-747499185 None] Deleting attachment 45d91163-e509-4829-a1f9-0a278993c903. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 20:59:22.689236 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ee13c609-2e23-4c31-a34a-b11a2b2e9d61 tempest-VolumesGetTest-525195791 None] Lock "b'cinder-5d13e559-6709-43cb-811a-35e5478632a6-delete_volume'" acquired by "delete_volume" :: waited 0.065s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:59:22.771360 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ee13c609-2e23-4c31-a34a-b11a2b2e9d61 tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:22.817269 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ee13c609-2e23-4c31-a34a-b11a2b2e9d61 tempest-VolumesGetTest-525195791 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:59:22.817929 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ee13c609-2e23-4c31-a34a-b11a2b2e9d61 tempest-VolumesGetTest-525195791 None] Volume volume-5d13e559-6709-43cb-811a-35e5478632a6 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:59:22.832723 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ee13c609-2e23-4c31-a34a-b11a2b2e9d61 tempest-VolumesGetTest-525195791 None] deleting rbd volume volume-5d13e559-6709-43cb-811a-35e5478632a6 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:59:23.297264 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-ee13c609-2e23-4c31-a34a-b11a2b2e9d61 tempest-VolumesGetTest-525195791 None] Created reservations ['d412d156-2167-42b5-b9e2-b28f8c186d4a', '1926bc60-fcc6-412b-85f3-89589b53a42f', '14e72d8d-0427-4ea2-baee-a2ecf554bfe1', 'b13cb88c-6dc9-45d0-b804-3ff49277fe9f'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:59:23.427162 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ee13c609-2e23-4c31-a34a-b11a2b2e9d61 tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:23.521396 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ee13c609-2e23-4c31-a34a-b11a2b2e9d61 tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:23.606353 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-ee13c609-2e23-4c31-a34a-b11a2b2e9d61 tempest-VolumesGetTest-525195791 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:23.611126 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ee13c609-2e23-4c31-a34a-b11a2b2e9d61 tempest-VolumesGetTest-525195791 None] Deleted volume successfully. Mar 05 20:59:23.632201 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ee13c609-2e23-4c31-a34a-b11a2b2e9d61 tempest-VolumesGetTest-525195791 None] Lock "b'cinder-5d13e559-6709-43cb-811a-35e5478632a6-delete_volume'" released by "delete_volume" :: held 0.942s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:59:23.966852 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-79589188-8502-4735-85e6-ed1d85aa9b2e tempest-VolumesGetTest-525195791 None] Lock "b'cinder-0c4b78dc-3396-40be-8f61-f3d3453b5daf-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:59:24.128159 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-79589188-8502-4735-85e6-ed1d85aa9b2e tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:24.245625 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-79589188-8502-4735-85e6-ed1d85aa9b2e tempest-VolumesGetTest-525195791 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:59:24.262468 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-79589188-8502-4735-85e6-ed1d85aa9b2e tempest-VolumesGetTest-525195791 None] deleting rbd volume volume-0c4b78dc-3396-40be-8f61-f3d3453b5daf {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:59:24.734897 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-79589188-8502-4735-85e6-ed1d85aa9b2e tempest-VolumesGetTest-525195791 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 20:59:24.762235 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-79589188-8502-4735-85e6-ed1d85aa9b2e tempest-VolumesGetTest-525195791 None] Volume volume-d41a6161-baa6-45f1-abcc-8fe9a11c8c58 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:59:24.762656 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-79589188-8502-4735-85e6-ed1d85aa9b2e tempest-VolumesGetTest-525195791 None] deleting parent snapshot volume-0c4b78dc-3396-40be-8f61-f3d3453b5daf.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 20:59:26.002903 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-79589188-8502-4735-85e6-ed1d85aa9b2e tempest-VolumesGetTest-525195791 None] Created reservations ['d2ae7d8a-833e-4512-8fef-687db7fc6d4e', '5f87137e-dca4-4119-b386-84dd5c451955', '4e49f406-c63d-49e2-bddd-338cba6b53eb', 'b005abb5-0338-4573-b2fb-a401ad0570a8'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:59:26.114732 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-79589188-8502-4735-85e6-ed1d85aa9b2e tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:26.200698 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-79589188-8502-4735-85e6-ed1d85aa9b2e tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:26.298849 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-79589188-8502-4735-85e6-ed1d85aa9b2e tempest-VolumesGetTest-525195791 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:26.307037 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-79589188-8502-4735-85e6-ed1d85aa9b2e tempest-VolumesGetTest-525195791 None] Deleted volume successfully. Mar 05 20:59:26.325050 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-79589188-8502-4735-85e6-ed1d85aa9b2e tempest-VolumesGetTest-525195791 None] Lock "b'cinder-0c4b78dc-3396-40be-8f61-f3d3453b5daf-delete_volume'" released by "delete_volume" :: held 2.364s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:59:27.773401 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:59:27.789314 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:59:27.789848 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:59:27.902795 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Flow 'volume_create_manager' (b66e675f-a684-4858-949e-82a0b4a70d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:27.952210 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc21e3a-8ad7-4ed0-aacf-4c46780391a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:27.982176 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:59:28.020985 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc21e3a-8ad7-4ed0-aacf-4c46780391a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1449931400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ed2dca31-f884-48a8-8b7a-476a21bd74fd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c9ee06ab238046948aa467052422c6d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:59:28Z,use_quota=True,user_id='796fc840762a4ce892e02b897cae4905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:28.034416 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b260fc9-5369-4fdd-8f1e-2507406dda31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:28.048075 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b260fc9-5369-4fdd-8f1e-2507406dda31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:28.063516 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b245366-1f97-4f07-9b29-a11cfaddcc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:28.273325 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b245366-1f97-4f07-9b29-a11cfaddcc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ed2dca31-f884-48a8-8b7a-476a21bd74fd', 'volume_name': 'volume-ed2dca31-f884-48a8-8b7a-476a21bd74fd', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:28.290105 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0429f14e-84fd-497c-961b-8d33304f7c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:28.304649 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0429f14e-84fd-497c-961b-8d33304f7c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:28.310493 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1601142b-468a-4c9a-98cc-556e3565f2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:28.313427 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Volume ed2dca31-f884-48a8-8b7a-476a21bd74fd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ed2dca31-f884-48a8-8b7a-476a21bd74fd', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 20:59:28.315111 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Cloning ed2dca31-f884-48a8-8b7a-476a21bd74fd from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 20:59:28.328588 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:59:28.349061 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 20, 59, 28, 335735)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 20:59:28.349840 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 20:59:28.350791 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Found cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 05 20:59:28.356801 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 0.028s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:59:28.358538 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 20:59:28.367589 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 20, 59, 28, 364300)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 20:59:28.368283 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 20:59:28.368945 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Creating from source image-volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7 {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 05 20:59:28.385855 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:28.493968 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] creating snapshot='volume-ed2dca31-f884-48a8-8b7a-476a21bd74fd.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 20:59:28.917504 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] cloning 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7@volume-ed2dca31-f884-48a8-8b7a-476a21bd74fd.clone_snap' to 'volume-ed2dca31-f884-48a8-8b7a-476a21bd74fd' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 20:59:29.144729 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a.deleted is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:59:29.145782 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:59:29.146152 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:59:29.186100 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 20:59:29.187468 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Marking volume ed2dca31-f884-48a8-8b7a-476a21bd74fd as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 20:59:29.201055 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to ed2dca31-f884-48a8-8b7a-476a21bd74fd. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 20:59:29.201742 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Creating volume glance metadata for volume ed2dca31-f884-48a8-8b7a-476a21bd74fd backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 20:59:29.313378 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1601142b-468a-4c9a-98cc-556e3565f2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed2dca31-f884-48a8-8b7a-476a21bd74fd', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:29.342193 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91eeb09-6a29-469e-b046-f68b6b429443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:29.376413 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Volume volume-ed2dca31-f884-48a8-8b7a-476a21bd74fd (ed2dca31-f884-48a8-8b7a-476a21bd74fd): created successfully Mar 05 20:59:29.383028 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91eeb09-6a29-469e-b046-f68b6b429443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:29.397078 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Flow 'volume_create_manager' (b66e675f-a684-4858-949e-82a0b4a70d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:29.417872 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-9b18cecb-c987-4df7-a869-ee0a8e768a3a tempest-VolumesGetTest-525195791 None] Created volume successfully. Mar 05 20:59:30.683301 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:59:30.691018 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:59:30.691991 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:59:30.717501 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Flow 'volume_create_manager' (73fe8e9b-e264-4552-95e1-78866bdea37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:30.727715 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e1af23-0e79-4a3a-bbc2-d5e9b47d4d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:30.736018 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:59:30.753452 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e1af23-0e79-4a3a-bbc2-d5e9b47d4d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:59:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-627001875',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e349ea42-5b7e-4f41-8196-1a2546007dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ee06ab238046948aa467052422c6d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:59:31Z,use_quota=True,user_id='796fc840762a4ce892e02b897cae4905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:30.760173 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e8306f-60be-4a10-9db2-e69c62e4945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:30.765785 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e8306f-60be-4a10-9db2-e69c62e4945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:30.772493 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f53ed34-59fb-4aea-a011-fda11a2f7086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:30.777258 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f53ed34-59fb-4aea-a011-fda11a2f7086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e349ea42-5b7e-4f41-8196-1a2546007dae', 'volume_name': 'volume-e349ea42-5b7e-4f41-8196-1a2546007dae', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:30.782629 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b409df90-9e6b-4fa1-a9e4-4c5f7ac1467b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:30.787877 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b409df90-9e6b-4fa1-a9e4-4c5f7ac1467b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:30.793492 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84d41d0-e316-4ef6-b232-0beffc7a41ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:30.794964 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Volume e349ea42-5b7e-4f41-8196-1a2546007dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e349ea42-5b7e-4f41-8196-1a2546007dae', 'volume_size': 1} Mar 05 20:59:30.795593 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] creating volume 'volume-e349ea42-5b7e-4f41-8196-1a2546007dae' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:59:30.796977 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:30.961846 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:59:30.962159 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:59:30.966342 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84d41d0-e316-4ef6-b232-0beffc7a41ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e349ea42-5b7e-4f41-8196-1a2546007dae', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:30.972168 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c56ca0-913d-4bce-bfd7-79062a1d4e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:30.996688 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Volume volume-e349ea42-5b7e-4f41-8196-1a2546007dae (e349ea42-5b7e-4f41-8196-1a2546007dae): created successfully Mar 05 20:59:31.007881 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c56ca0-913d-4bce-bfd7-79062a1d4e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:31.022527 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Flow 'volume_create_manager' (73fe8e9b-e264-4552-95e1-78866bdea37f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:31.044878 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-4a2a60d2-f767-4549-ab05-b5ca0c31f689 tempest-VolumesGetTest-525195791 None] Created volume successfully. Mar 05 20:59:31.879272 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-49cdfb49-0706-43c8-b4f7-5d473592ab29 tempest-VolumesGetTest-525195791 None] Lock "b'cinder-e349ea42-5b7e-4f41-8196-1a2546007dae-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:59:31.949120 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-49cdfb49-0706-43c8-b4f7-5d473592ab29 tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:32.047834 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-49cdfb49-0706-43c8-b4f7-5d473592ab29 tempest-VolumesGetTest-525195791 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:59:32.048288 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-49cdfb49-0706-43c8-b4f7-5d473592ab29 tempest-VolumesGetTest-525195791 None] Volume volume-e349ea42-5b7e-4f41-8196-1a2546007dae is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:59:32.058287 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-49cdfb49-0706-43c8-b4f7-5d473592ab29 tempest-VolumesGetTest-525195791 None] deleting rbd volume volume-e349ea42-5b7e-4f41-8196-1a2546007dae {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:59:32.475420 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-49cdfb49-0706-43c8-b4f7-5d473592ab29 tempest-VolumesGetTest-525195791 None] Created reservations ['157d674f-8e88-4c0f-982e-4af97043df45', '65ae2a93-60bb-47da-803c-42cd6c3a4842', '19ac3594-6ede-41b8-8dd2-b72c7ae1f668', '6e734f5f-2702-4076-93a0-5451d45bc871'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:59:32.551590 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-49cdfb49-0706-43c8-b4f7-5d473592ab29 tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:32.631496 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-49cdfb49-0706-43c8-b4f7-5d473592ab29 tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:32.697188 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-49cdfb49-0706-43c8-b4f7-5d473592ab29 tempest-VolumesGetTest-525195791 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:32.701582 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-49cdfb49-0706-43c8-b4f7-5d473592ab29 tempest-VolumesGetTest-525195791 None] Deleted volume successfully. Mar 05 20:59:32.723943 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-49cdfb49-0706-43c8-b4f7-5d473592ab29 tempest-VolumesGetTest-525195791 None] Lock "b'cinder-e349ea42-5b7e-4f41-8196-1a2546007dae-delete_volume'" released by "delete_volume" :: held 0.843s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:59:33.072744 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-405af48d-7508-4a4b-9998-5a0500d7380c tempest-VolumesGetTest-525195791 None] Lock "b'cinder-ed2dca31-f884-48a8-8b7a-476a21bd74fd-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:59:33.159906 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-405af48d-7508-4a4b-9998-5a0500d7380c tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:33.277228 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-405af48d-7508-4a4b-9998-5a0500d7380c tempest-VolumesGetTest-525195791 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:59:33.288102 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-405af48d-7508-4a4b-9998-5a0500d7380c tempest-VolumesGetTest-525195791 None] deleting rbd volume volume-ed2dca31-f884-48a8-8b7a-476a21bd74fd {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:59:33.646621 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-405af48d-7508-4a4b-9998-5a0500d7380c tempest-VolumesGetTest-525195791 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 20:59:33.695313 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-405af48d-7508-4a4b-9998-5a0500d7380c tempest-VolumesGetTest-525195791 None] deleting parent snapshot volume-ed2dca31-f884-48a8-8b7a-476a21bd74fd.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 20:59:34.844115 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-405af48d-7508-4a4b-9998-5a0500d7380c tempest-VolumesGetTest-525195791 None] Created reservations ['d9c36915-190d-4d69-88f8-228675b05574', '304aae88-e5bf-418b-a706-cfa780d56242', 'ab1d27ae-6dbe-482e-ad37-bafb21cc49ca', '93a3aacd-712a-4cee-9fc1-66031cc79935'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:59:34.927655 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-405af48d-7508-4a4b-9998-5a0500d7380c tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:34.992347 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-405af48d-7508-4a4b-9998-5a0500d7380c tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:35.064016 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-405af48d-7508-4a4b-9998-5a0500d7380c tempest-VolumesGetTest-525195791 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:35.076146 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-405af48d-7508-4a4b-9998-5a0500d7380c tempest-VolumesGetTest-525195791 None] Deleted volume successfully. Mar 05 20:59:35.099262 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-405af48d-7508-4a4b-9998-5a0500d7380c tempest-VolumesGetTest-525195791 None] Lock "b'cinder-ed2dca31-f884-48a8-8b7a-476a21bd74fd-delete_volume'" released by "delete_volume" :: held 2.026s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:59:35.358907 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ffd43dc8-20de-4816-bd9b-3f6e7436f9fa tempest-VolumesGetTest-525195791 None] Lock "b'cinder-d41a6161-baa6-45f1-abcc-8fe9a11c8c58-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:59:35.410343 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ffd43dc8-20de-4816-bd9b-3f6e7436f9fa tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:35.535546 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ffd43dc8-20de-4816-bd9b-3f6e7436f9fa tempest-VolumesGetTest-525195791 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:59:35.536163 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ffd43dc8-20de-4816-bd9b-3f6e7436f9fa tempest-VolumesGetTest-525195791 None] Volume volume-d41a6161-baa6-45f1-abcc-8fe9a11c8c58 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:59:35.549643 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ffd43dc8-20de-4816-bd9b-3f6e7436f9fa tempest-VolumesGetTest-525195791 None] deleting rbd volume volume-d41a6161-baa6-45f1-abcc-8fe9a11c8c58 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:59:35.724261 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 req-ea9d575b-ee1f-4c69-905d-3db1b1a435fe tempest-LiveMigrationTest-958104892 None] Terminate volume connection completed successfully. Mar 05 20:59:35.725392 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 req-ea9d575b-ee1f-4c69-905d-3db1b1a435fe tempest-LiveMigrationTest-958104892 None] Deleting attachment fe63ec5e-503d-4557-9727-13723dcdd28e. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 20:59:35.983536 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-ffd43dc8-20de-4816-bd9b-3f6e7436f9fa tempest-VolumesGetTest-525195791 None] Created reservations ['7a7fbf8e-36c7-4f66-baba-4b195e55fcc2', '27cf0699-4248-40ea-b61f-ab1f119deb16', '5a0f2d22-bc0c-42d5-9023-49d3c46199bb', '0c275a62-32ea-4387-888d-f686d07b7e25'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:59:36.016536 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 req-7408ecb3-a7cd-41c0-b498-5bf2f53a3b40 tempest-LiveMigrationTest-958104892 None] Lock "b'cinder-343d02d7-1904-4f02-a9f0-6e1deab8d765-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:59:36.077437 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 req-7408ecb3-a7cd-41c0-b498-5bf2f53a3b40 tempest-LiveMigrationTest-958104892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:36.183383 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 req-7408ecb3-a7cd-41c0-b498-5bf2f53a3b40 tempest-LiveMigrationTest-958104892 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:59:36.197348 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 req-7408ecb3-a7cd-41c0-b498-5bf2f53a3b40 tempest-LiveMigrationTest-958104892 None] deleting rbd volume volume-343d02d7-1904-4f02-a9f0-6e1deab8d765 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:59:36.199796 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ffd43dc8-20de-4816-bd9b-3f6e7436f9fa tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:36.262202 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ffd43dc8-20de-4816-bd9b-3f6e7436f9fa tempest-VolumesGetTest-525195791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:36.340250 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-ffd43dc8-20de-4816-bd9b-3f6e7436f9fa tempest-VolumesGetTest-525195791 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:36.347277 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ffd43dc8-20de-4816-bd9b-3f6e7436f9fa tempest-VolumesGetTest-525195791 None] Deleted volume successfully. Mar 05 20:59:36.365379 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ffd43dc8-20de-4816-bd9b-3f6e7436f9fa tempest-VolumesGetTest-525195791 None] Lock "b'cinder-d41a6161-baa6-45f1-abcc-8fe9a11c8c58-delete_volume'" released by "delete_volume" :: held 1.006s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:59:36.586438 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 req-7408ecb3-a7cd-41c0-b498-5bf2f53a3b40 tempest-LiveMigrationTest-958104892 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 20:59:36.625173 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 req-7408ecb3-a7cd-41c0-b498-5bf2f53a3b40 tempest-LiveMigrationTest-958104892 None] deleting parent snapshot volume-343d02d7-1904-4f02-a9f0-6e1deab8d765.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 20:59:36.847832 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-75c27b4f-de5b-4391-b49e-fe15251d6aa2 tempest-LiveMigrationTest-958104892 None] Lock "b'cinder-b4d17444-3aa0-4844-b95f-1594f1c1b9ec-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:59:36.967442 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 req-7408ecb3-a7cd-41c0-b498-5bf2f53a3b40 tempest-LiveMigrationTest-958104892 None] Created reservations ['0edaa873-daed-42f1-a81d-1e44c14fbbef', '37c1f66e-0062-40bd-a995-7e4edbd5b06d', 'f34623b5-31b0-46c8-84d6-31668de9ef66', '8ad1614a-a6d8-4e98-b75d-867e8ac2881d'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:59:36.989396 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-75c27b4f-de5b-4391-b49e-fe15251d6aa2 tempest-LiveMigrationTest-958104892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:37.090777 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-75c27b4f-de5b-4391-b49e-fe15251d6aa2 tempest-LiveMigrationTest-958104892 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:59:37.091220 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-75c27b4f-de5b-4391-b49e-fe15251d6aa2 tempest-LiveMigrationTest-958104892 None] Volume volume-b4d17444-3aa0-4844-b95f-1594f1c1b9ec is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:59:37.115011 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-75c27b4f-de5b-4391-b49e-fe15251d6aa2 tempest-LiveMigrationTest-958104892 None] deleting rbd volume volume-b4d17444-3aa0-4844-b95f-1594f1c1b9ec {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:59:37.237423 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 req-7408ecb3-a7cd-41c0-b498-5bf2f53a3b40 tempest-LiveMigrationTest-958104892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:37.347164 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 req-7408ecb3-a7cd-41c0-b498-5bf2f53a3b40 tempest-LiveMigrationTest-958104892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:37.412910 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 req-7408ecb3-a7cd-41c0-b498-5bf2f53a3b40 tempest-LiveMigrationTest-958104892 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:37.417844 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 req-7408ecb3-a7cd-41c0-b498-5bf2f53a3b40 tempest-LiveMigrationTest-958104892 None] Deleted volume successfully. Mar 05 20:59:37.448730 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 req-7408ecb3-a7cd-41c0-b498-5bf2f53a3b40 tempest-LiveMigrationTest-958104892 None] Lock "b'cinder-343d02d7-1904-4f02-a9f0-6e1deab8d765-delete_volume'" released by "delete_volume" :: held 1.432s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:59:37.607869 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-75c27b4f-de5b-4391-b49e-fe15251d6aa2 tempest-LiveMigrationTest-958104892 None] Created reservations ['20882433-9801-4f89-9db2-891552d9b9e0', '7f1fce7b-b694-4512-9de6-7acb793e44a2', 'c98706a1-8874-4aa2-907d-886cf887f588', 'df3c20c0-8ddf-4f6a-9a59-c5ef46a78241'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:59:37.708283 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-75c27b4f-de5b-4391-b49e-fe15251d6aa2 tempest-LiveMigrationTest-958104892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:37.797590 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-75c27b4f-de5b-4391-b49e-fe15251d6aa2 tempest-LiveMigrationTest-958104892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:37.898244 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-75c27b4f-de5b-4391-b49e-fe15251d6aa2 tempest-LiveMigrationTest-958104892 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:37.903947 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-75c27b4f-de5b-4391-b49e-fe15251d6aa2 tempest-LiveMigrationTest-958104892 None] Deleted volume successfully. Mar 05 20:59:37.925858 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-75c27b4f-de5b-4391-b49e-fe15251d6aa2 tempest-LiveMigrationTest-958104892 None] Lock "b'cinder-b4d17444-3aa0-4844-b95f-1594f1c1b9ec-delete_volume'" released by "delete_volume" :: held 1.083s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:59:42.486555 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:59:42.492973 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:59:42.497199 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:59:42.537980 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Flow 'volume_create_manager' (35f70d7d-3623-4e08-85f7-64d47df97c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:42.557909 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc25b00-61f9-43e6-8f1f-d2e328438acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:42.569736 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:59:42.604315 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc25b00-61f9-43e6-8f1f-d2e328438acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1212526228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=479f383f-4516-40dd-9c9b-62daf93859e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e1867a550b44208b845f01ca1be7758',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:59:42Z,use_quota=True,user_id='0f322cd75e2449c19b157ac3893cea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:42.610247 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94885594-ff88-45be-8982-b8e6b8c3c149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:42.618779 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94885594-ff88-45be-8982-b8e6b8c3c149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:42.639926 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd8e27f-ab8a-4f6f-b7a9-b114d1439dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:42.650145 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd8e27f-ab8a-4f6f-b7a9-b114d1439dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '479f383f-4516-40dd-9c9b-62daf93859e6', 'volume_name': 'volume-479f383f-4516-40dd-9c9b-62daf93859e6', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:42.656217 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b1caf6-0c45-4ab1-8fa1-d6eb629f986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:42.661360 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b1caf6-0c45-4ab1-8fa1-d6eb629f986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:42.667787 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b805041-224b-4b52-b393-7db5671a1437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:42.670003 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Volume 479f383f-4516-40dd-9c9b-62daf93859e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-479f383f-4516-40dd-9c9b-62daf93859e6', 'volume_size': 1} Mar 05 20:59:42.670710 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] creating volume 'volume-479f383f-4516-40dd-9c9b-62daf93859e6' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:59:42.672077 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:42.844598 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:59:42.845043 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:59:42.850152 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b805041-224b-4b52-b393-7db5671a1437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-479f383f-4516-40dd-9c9b-62daf93859e6', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:42.862625 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61669d8a-30e2-4d38-80e2-00ad3bdce11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:42.903122 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Volume volume-479f383f-4516-40dd-9c9b-62daf93859e6 (479f383f-4516-40dd-9c9b-62daf93859e6): created successfully Mar 05 20:59:42.913423 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61669d8a-30e2-4d38-80e2-00ad3bdce11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:42.958266 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Flow 'volume_create_manager' (35f70d7d-3623-4e08-85f7-64d47df97c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:42.980527 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-624993c3-8566-433f-acb0-00e6e71d854c tempest-VolumesListTestJSON-1337644283 None] Created volume successfully. Mar 05 20:59:44.240820 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:59:44.250002 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:59:44.251049 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:59:44.315948 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Flow 'volume_create_manager' (6dea857c-9858-4714-8bd9-96bf29ab1e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:44.350045 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c36caeb-1f02-4477-9f62-aa10ab8576dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:44.365444 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:59:44.384626 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c36caeb-1f02-4477-9f62-aa10ab8576dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1689892564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d4319bae-6216-4782-b43d-35ad33c98f35,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e1867a550b44208b845f01ca1be7758',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:59:44Z,use_quota=True,user_id='0f322cd75e2449c19b157ac3893cea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:44.391116 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8bb37e-09d0-40c4-9f49-780880b9e570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:44.396386 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8bb37e-09d0-40c4-9f49-780880b9e570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:44.403004 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf8c6d7-9c7f-430b-bf15-83f47d63fd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:44.409298 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf8c6d7-9c7f-430b-bf15-83f47d63fd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4319bae-6216-4782-b43d-35ad33c98f35', 'volume_name': 'volume-d4319bae-6216-4782-b43d-35ad33c98f35', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:44.415463 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df208b45-840e-460e-bff7-3bb4e2d575fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:44.420959 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df208b45-840e-460e-bff7-3bb4e2d575fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:44.427931 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac073b1f-22b6-40b3-9586-a2246c144a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:44.429538 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Volume d4319bae-6216-4782-b43d-35ad33c98f35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4319bae-6216-4782-b43d-35ad33c98f35', 'volume_size': 1} Mar 05 20:59:44.430149 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] creating volume 'volume-d4319bae-6216-4782-b43d-35ad33c98f35' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:59:44.431620 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:44.567759 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:59:44.569174 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:59:44.574416 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac073b1f-22b6-40b3-9586-a2246c144a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4319bae-6216-4782-b43d-35ad33c98f35', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:44.586851 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6d9980-7419-4ab0-9495-8786b26c65a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:44.604124 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Volume volume-d4319bae-6216-4782-b43d-35ad33c98f35 (d4319bae-6216-4782-b43d-35ad33c98f35): created successfully Mar 05 20:59:44.615323 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6d9980-7419-4ab0-9495-8786b26c65a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:44.624781 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Flow 'volume_create_manager' (6dea857c-9858-4714-8bd9-96bf29ab1e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:44.671475 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-0031ccec-d6dc-4f91-8e71-c006f46d6149 tempest-VolumesListTestJSON-1337644283 None] Created volume successfully. Mar 05 20:59:45.600945 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 20:59:45.603056 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:45.687846 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:45.801399 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:46.144335 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 20:59:46.149391 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 20:59:46.150310 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 20:59:46.226846 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Flow 'volume_create_manager' (1eed48d3-f21f-4d44-b20e-66c85989b1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:46.255841 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4a33ca-5fc2-496d-8d5a-de21ed21925d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:46.269774 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:59:46.299277 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4a33ca-5fc2-496d-8d5a-de21ed21925d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T20:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-564111671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=946f1ef9-0a7b-484f-b3a4-0364c909724c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e1867a550b44208b845f01ca1be7758',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T20:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T20:59:46Z,use_quota=True,user_id='0f322cd75e2449c19b157ac3893cea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:46.305442 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c80efa-858d-4821-9ef0-06cf3fff2af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:46.310704 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c80efa-858d-4821-9ef0-06cf3fff2af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:46.320921 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16a4e14-88ea-4040-a751-43d68744968e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:46.326975 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16a4e14-88ea-4040-a751-43d68744968e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '946f1ef9-0a7b-484f-b3a4-0364c909724c', 'volume_name': 'volume-946f1ef9-0a7b-484f-b3a4-0364c909724c', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:46.335473 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb08292-1724-484d-b865-e2fedbdcbdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:46.350425 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb08292-1724-484d-b865-e2fedbdcbdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:46.356291 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4495daad-179b-4ab4-ae41-1d1b85a84eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:46.358935 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Volume 946f1ef9-0a7b-484f-b3a4-0364c909724c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-946f1ef9-0a7b-484f-b3a4-0364c909724c', 'volume_size': 1} Mar 05 20:59:46.361578 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] creating volume 'volume-946f1ef9-0a7b-484f-b3a4-0364c909724c' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 20:59:46.362931 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:46.516415 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 20:59:46.516815 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 20:59:46.522975 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4495daad-179b-4ab4-ae41-1d1b85a84eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-946f1ef9-0a7b-484f-b3a4-0364c909724c', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:46.533370 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70203936-b3cb-46b6-9b83-d663dab67686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 20:59:46.568177 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Volume volume-946f1ef9-0a7b-484f-b3a4-0364c909724c (946f1ef9-0a7b-484f-b3a4-0364c909724c): created successfully Mar 05 20:59:46.600925 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70203936-b3cb-46b6-9b83-d663dab67686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 20:59:46.619080 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Flow 'volume_create_manager' (1eed48d3-f21f-4d44-b20e-66c85989b1a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 20:59:46.643242 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-455dad27-b172-4b17-aa03-2ba7e6300014 tempest-VolumesListTestJSON-1337644283 None] Created volume successfully. Mar 05 20:59:47.085806 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-74202113-7f4a-44d3-893e-a30d37fc42ce tempest-DeleteServersTestJSON-1599485420 None] Lock "b'cinder-107837e7-b61e-41fc-9310-a10876d5a787-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:59:47.207506 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-74202113-7f4a-44d3-893e-a30d37fc42ce tempest-DeleteServersTestJSON-1599485420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:47.315783 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-74202113-7f4a-44d3-893e-a30d37fc42ce tempest-DeleteServersTestJSON-1599485420 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:59:47.316212 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-74202113-7f4a-44d3-893e-a30d37fc42ce tempest-DeleteServersTestJSON-1599485420 None] Volume volume-107837e7-b61e-41fc-9310-a10876d5a787 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:59:47.334237 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-74202113-7f4a-44d3-893e-a30d37fc42ce tempest-DeleteServersTestJSON-1599485420 None] deleting rbd volume volume-107837e7-b61e-41fc-9310-a10876d5a787 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:59:47.908639 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-74202113-7f4a-44d3-893e-a30d37fc42ce tempest-DeleteServersTestJSON-1599485420 None] Created reservations ['478bff84-a4d9-4ed6-b29c-61fee731a8cd', '4ba4eb93-6e64-48e3-b007-1d99525ba068', '2e4f310d-1799-4983-82e7-675708e8d489', '21f6ea8e-3a92-45d4-8893-b6b581b7df09'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:59:48.045717 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-74202113-7f4a-44d3-893e-a30d37fc42ce tempest-DeleteServersTestJSON-1599485420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:48.119556 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-74202113-7f4a-44d3-893e-a30d37fc42ce tempest-DeleteServersTestJSON-1599485420 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:48.195863 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-74202113-7f4a-44d3-893e-a30d37fc42ce tempest-DeleteServersTestJSON-1599485420 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:48.200729 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-74202113-7f4a-44d3-893e-a30d37fc42ce tempest-DeleteServersTestJSON-1599485420 None] Deleted volume successfully. Mar 05 20:59:48.223252 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-74202113-7f4a-44d3-893e-a30d37fc42ce tempest-DeleteServersTestJSON-1599485420 None] Lock "b'cinder-107837e7-b61e-41fc-9310-a10876d5a787-delete_volume'" released by "delete_volume" :: held 1.138s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:59:52.205758 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-f04e1467-8e3e-400c-a7e8-27ccc7455987 tempest-VolumesListTestJSON-1337644283 None] Lock "b'cinder-946f1ef9-0a7b-484f-b3a4-0364c909724c-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:59:52.294216 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f04e1467-8e3e-400c-a7e8-27ccc7455987 tempest-VolumesListTestJSON-1337644283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:52.502517 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f04e1467-8e3e-400c-a7e8-27ccc7455987 tempest-VolumesListTestJSON-1337644283 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:59:52.503829 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f04e1467-8e3e-400c-a7e8-27ccc7455987 tempest-VolumesListTestJSON-1337644283 None] Volume volume-946f1ef9-0a7b-484f-b3a4-0364c909724c is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:59:52.548871 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f04e1467-8e3e-400c-a7e8-27ccc7455987 tempest-VolumesListTestJSON-1337644283 None] deleting rbd volume volume-946f1ef9-0a7b-484f-b3a4-0364c909724c {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:59:53.103888 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-f04e1467-8e3e-400c-a7e8-27ccc7455987 tempest-VolumesListTestJSON-1337644283 None] Created reservations ['5e911b85-b063-4233-bb14-08e6c0d1aae8', '61607317-6727-4797-94b2-0c4cc9bb4db9', '584922e1-bb8d-4f71-9cbc-4a11fba9549c', '4f30dad7-4451-4d23-9fd2-9063ed92af65'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:59:53.162163 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f04e1467-8e3e-400c-a7e8-27ccc7455987 tempest-VolumesListTestJSON-1337644283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:53.198143 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f04e1467-8e3e-400c-a7e8-27ccc7455987 tempest-VolumesListTestJSON-1337644283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:53.244797 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-f04e1467-8e3e-400c-a7e8-27ccc7455987 tempest-VolumesListTestJSON-1337644283 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:53.248874 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f04e1467-8e3e-400c-a7e8-27ccc7455987 tempest-VolumesListTestJSON-1337644283 None] Deleted volume successfully. Mar 05 20:59:53.271910 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-f04e1467-8e3e-400c-a7e8-27ccc7455987 tempest-VolumesListTestJSON-1337644283 None] Lock "b'cinder-946f1ef9-0a7b-484f-b3a4-0364c909724c-delete_volume'" released by "delete_volume" :: held 1.066s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:59:53.413232 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-26412dbc-de5d-49fd-9368-dca71c8ddc73 tempest-VolumesListTestJSON-1337644283 None] Lock "b'cinder-d4319bae-6216-4782-b43d-35ad33c98f35-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:59:53.503156 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-26412dbc-de5d-49fd-9368-dca71c8ddc73 tempest-VolumesListTestJSON-1337644283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:53.585599 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-26412dbc-de5d-49fd-9368-dca71c8ddc73 tempest-VolumesListTestJSON-1337644283 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:59:53.586287 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-26412dbc-de5d-49fd-9368-dca71c8ddc73 tempest-VolumesListTestJSON-1337644283 None] Volume volume-d4319bae-6216-4782-b43d-35ad33c98f35 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:59:53.608351 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-26412dbc-de5d-49fd-9368-dca71c8ddc73 tempest-VolumesListTestJSON-1337644283 None] deleting rbd volume volume-d4319bae-6216-4782-b43d-35ad33c98f35 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:59:54.068122 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-26412dbc-de5d-49fd-9368-dca71c8ddc73 tempest-VolumesListTestJSON-1337644283 None] Created reservations ['bd0583da-b06a-4655-97b4-7478d88a1bbb', '5212512b-aa60-4ca3-b622-37c3921f8a95', '3b57d042-f11d-49f7-8e67-9b473da9956a', '953ac96f-4a29-4c5f-97aa-0f2d397a3a2c'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:59:54.163120 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-26412dbc-de5d-49fd-9368-dca71c8ddc73 tempest-VolumesListTestJSON-1337644283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:54.250816 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-26412dbc-de5d-49fd-9368-dca71c8ddc73 tempest-VolumesListTestJSON-1337644283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:54.327584 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-26412dbc-de5d-49fd-9368-dca71c8ddc73 tempest-VolumesListTestJSON-1337644283 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:54.335619 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-26412dbc-de5d-49fd-9368-dca71c8ddc73 tempest-VolumesListTestJSON-1337644283 None] Deleted volume successfully. Mar 05 20:59:54.362683 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-26412dbc-de5d-49fd-9368-dca71c8ddc73 tempest-VolumesListTestJSON-1337644283 None] Lock "b'cinder-d4319bae-6216-4782-b43d-35ad33c98f35-delete_volume'" released by "delete_volume" :: held 0.948s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 20:59:54.671928 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b04ba551-7e94-4d77-9895-5f3fdab9e439 tempest-VolumesListTestJSON-1337644283 None] Lock "b'cinder-479f383f-4516-40dd-9c9b-62daf93859e6-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 20:59:54.756036 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b04ba551-7e94-4d77-9895-5f3fdab9e439 tempest-VolumesListTestJSON-1337644283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:54.860842 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b04ba551-7e94-4d77-9895-5f3fdab9e439 tempest-VolumesListTestJSON-1337644283 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 20:59:54.861282 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b04ba551-7e94-4d77-9895-5f3fdab9e439 tempest-VolumesListTestJSON-1337644283 None] Volume volume-479f383f-4516-40dd-9c9b-62daf93859e6 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 20:59:54.875157 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b04ba551-7e94-4d77-9895-5f3fdab9e439 tempest-VolumesListTestJSON-1337644283 None] deleting rbd volume volume-479f383f-4516-40dd-9c9b-62daf93859e6 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 20:59:55.353257 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-b04ba551-7e94-4d77-9895-5f3fdab9e439 tempest-VolumesListTestJSON-1337644283 None] Created reservations ['5ec171b6-0c1a-4776-995f-a0b002a05ec1', 'facf422f-0c24-4f13-beee-04584d3cab0b', '374dbb55-08bd-4fd6-8733-7a0848a7c374', '36cec413-6e13-4a3d-9c1f-946d11e37f50'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 20:59:55.447793 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b04ba551-7e94-4d77-9895-5f3fdab9e439 tempest-VolumesListTestJSON-1337644283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:55.529771 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b04ba551-7e94-4d77-9895-5f3fdab9e439 tempest-VolumesListTestJSON-1337644283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 20:59:55.602781 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-b04ba551-7e94-4d77-9895-5f3fdab9e439 tempest-VolumesListTestJSON-1337644283 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 20:59:55.607513 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b04ba551-7e94-4d77-9895-5f3fdab9e439 tempest-VolumesListTestJSON-1337644283 None] Deleted volume successfully. Mar 05 20:59:55.627495 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b04ba551-7e94-4d77-9895-5f3fdab9e439 tempest-VolumesListTestJSON-1337644283 None] Lock "b'cinder-479f383f-4516-40dd-9c9b-62daf93859e6-delete_volume'" released by "delete_volume" :: held 0.956s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:00:45.598432 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:00:45.599234 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:00:45.653848 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:00:45.755505 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:01:45.601139 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:01:45.601709 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:01:45.705485 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:01:45.819662 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:02:02.061219 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:02:02.068492 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:02:02.069174 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:02:02.111426 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Flow 'volume_create_manager' (986cbcaf-da9f-4abc-b5dc-03b3bc7a0b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:02:02.120189 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad4d42c-d06d-4017-87a6-f3f4e1dacab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:02:02.137730 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:02:02.161734 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad4d42c-d06d-4017-87a6-f3f4e1dacab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1100518065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8607c3b6-20ea-47c0-9fee-9ac4fd535791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f59b6cf41e6d4308819eb264dcaa320e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:02:02Z,use_quota=True,user_id='352a9d7250c742638d90f17006f12c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:02:02.168519 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb08ac4e-af59-4ad0-9322-b50d8c26026e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:02:02.174999 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb08ac4e-af59-4ad0-9322-b50d8c26026e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:02:02.182133 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57da65e1-2466-4d48-82ec-9f44f99b26a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:02:02.187929 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57da65e1-2466-4d48-82ec-9f44f99b26a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8607c3b6-20ea-47c0-9fee-9ac4fd535791', 'volume_name': 'volume-8607c3b6-20ea-47c0-9fee-9ac4fd535791', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:02:02.196194 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45fbdf5d-d237-4c11-a93f-df9a971486e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:02:02.203124 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45fbdf5d-d237-4c11-a93f-df9a971486e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:02:02.209885 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47ded1b-75fc-4bb5-998f-5838b9874526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:02:02.211392 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Volume 8607c3b6-20ea-47c0-9fee-9ac4fd535791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8607c3b6-20ea-47c0-9fee-9ac4fd535791', 'volume_size': 1} Mar 05 21:02:02.211984 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] creating volume 'volume-8607c3b6-20ea-47c0-9fee-9ac4fd535791' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:02:02.213235 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:02:02.350193 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:02:02.350578 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:02:02.354381 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47ded1b-75fc-4bb5-998f-5838b9874526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8607c3b6-20ea-47c0-9fee-9ac4fd535791', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:02:02.368140 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96cdacd-91de-490a-b11a-61eec9278cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:02:02.393055 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Volume volume-8607c3b6-20ea-47c0-9fee-9ac4fd535791 (8607c3b6-20ea-47c0-9fee-9ac4fd535791): created successfully Mar 05 21:02:02.397125 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96cdacd-91de-490a-b11a-61eec9278cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:02:02.403079 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Flow 'volume_create_manager' (986cbcaf-da9f-4abc-b5dc-03b3bc7a0b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:02:02.428890 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-2b0a6544-44f1-4755-b89e-c4d4e017e7cf tempest-AttachVolumeTestJSON-1994322257 None] Created volume successfully. Mar 05 21:02:04.201731 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-c5842f33-bda1-46ee-8009-abbfc2229cd0 req-f4148148-334f-4ebc-8f42-1778fdb8a2c1 tempest-AttachVolumeTestJSON-1994322257 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:02:05.415885 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-c5842f33-bda1-46ee-8009-abbfc2229cd0 req-f4148148-334f-4ebc-8f42-1778fdb8a2c1 tempest-AttachVolumeTestJSON-1994322257 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.214s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:02:05.418810 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-c5842f33-bda1-46ee-8009-abbfc2229cd0 req-f4148148-334f-4ebc-8f42-1778fdb8a2c1 tempest-AttachVolumeTestJSON-1994322257 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8607c3b6-20ea-47c0-9fee-9ac4fd535791', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '8607c3b6-20ea-47c0-9fee-9ac4fd535791', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:02:05.497973 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-c5842f33-bda1-46ee-8009-abbfc2229cd0 req-f4148148-334f-4ebc-8f42-1778fdb8a2c1 tempest-AttachVolumeTestJSON-1994322257 None] Connection info returned from driver {'name': 'volumes/volume-8607c3b6-20ea-47c0-9fee-9ac4fd535791', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8607c3b6-20ea-47c0-9fee-9ac4fd535791', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c8a10e14-6000-4438-bf77-e1a5d0f9a2f8'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:02:05.689774 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-c5842f33-bda1-46ee-8009-abbfc2229cd0 req-f4148148-334f-4ebc-8f42-1778fdb8a2c1 tempest-AttachVolumeTestJSON-1994322257 None] attachment_update completed successfully. Mar 05 21:02:45.601547 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:02:45.602827 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:02:45.696954 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:02:45.799661 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:02:59.224774 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-4ff085d2-96cf-4055-9fc2-0ac20b0e5546 req-f7c45015-6129-42dd-a10b-8d342e06afd2 tempest-AttachVolumeTestJSON-1994322257 None] Terminate volume connection completed successfully. Mar 05 21:02:59.228355 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-4ff085d2-96cf-4055-9fc2-0ac20b0e5546 req-f7c45015-6129-42dd-a10b-8d342e06afd2 tempest-AttachVolumeTestJSON-1994322257 None] Deleting attachment c8a10e14-6000-4438-bf77-e1a5d0f9a2f8. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:03:36.025268 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:03:36.037898 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:03:36.038397 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:03:36.109721 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Flow 'volume_create_manager' (f0fae2b0-fd1d-4ab1-b440-f956fa5ff3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:03:36.140428 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea39012c-aded-4800-a3d9-1cb1d5168a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:36.153916 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:03:36.180672 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea39012c-aded-4800-a3d9-1cb1d5168a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-594002997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c4889834-9564-427c-924e-8df6f5bc7738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784a2229e2b6445589597e5bf3be6344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:03:36Z,use_quota=True,user_id='5f63dccf0b4843cb8aaeee1070d1f82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:36.195436 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223e2454-ef29-4548-949c-9c7614d0b9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:36.211236 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223e2454-ef29-4548-949c-9c7614d0b9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:36.217591 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d32415b-2a0c-4fb4-a0dd-06edfa56f788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:36.868684 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d32415b-2a0c-4fb4-a0dd-06edfa56f788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c4889834-9564-427c-924e-8df6f5bc7738', 'volume_name': 'volume-c4889834-9564-427c-924e-8df6f5bc7738', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:36.897610 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067325c5-9739-4c60-a4ad-ae9f28c78b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:36.912081 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067325c5-9739-4c60-a4ad-ae9f28c78b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:36.918569 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25c0ca0-4260-49c5-90d6-521b9e08253a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:36.920473 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Volume c4889834-9564-427c-924e-8df6f5bc7738: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c4889834-9564-427c-924e-8df6f5bc7738', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 21:03:36.921316 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Cloning c4889834-9564-427c-924e-8df6f5bc7738 from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 21:03:36.934253 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:03:36.953849 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 3, 36, 943875)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:03:36.954503 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:03:36.955009 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Found cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 05 21:03:36.960259 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 0.026s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:03:36.961603 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 21:03:36.988651 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 3, 36, 974616)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:03:36.989201 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:03:36.989842 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Creating from source image-volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7 {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 05 21:03:37.006387 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:03:37.109632 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] creating snapshot='volume-c4889834-9564-427c-924e-8df6f5bc7738.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 21:03:37.915164 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] cloning 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7@volume-c4889834-9564-427c-924e-8df6f5bc7738.clone_snap' to 'volume-c4889834-9564-427c-924e-8df6f5bc7738' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 21:03:38.185408 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a.deleted is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:03:38.186565 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:03:38.187025 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:03:38.219077 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 21:03:38.220000 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Marking volume c4889834-9564-427c-924e-8df6f5bc7738 as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 21:03:38.232790 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to c4889834-9564-427c-924e-8df6f5bc7738. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 21:03:38.233350 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Creating volume glance metadata for volume c4889834-9564-427c-924e-8df6f5bc7738 backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 21:03:38.353320 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25c0ca0-4260-49c5-90d6-521b9e08253a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4889834-9564-427c-924e-8df6f5bc7738', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:38.373700 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb79f6ca-71f1-474d-bf32-1ae6c98b89f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:38.403876 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Volume volume-c4889834-9564-427c-924e-8df6f5bc7738 (c4889834-9564-427c-924e-8df6f5bc7738): created successfully Mar 05 21:03:38.408058 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb79f6ca-71f1-474d-bf32-1ae6c98b89f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:38.414259 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Flow 'volume_create_manager' (f0fae2b0-fd1d-4ab1-b440-f956fa5ff3fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:03:38.439497 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b68aa55b-c5d0-4ffe-9fdf-3d90e067cd7f tempest-TaggedBootDevicesTest_v242-1271501382 None] Created volume successfully. Mar 05 21:03:40.707760 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:03:40.720841 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:03:40.734741 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:03:40.827295 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Flow 'volume_create_manager' (46e4130c-6110-42a1-8d1d-2c4d179a9649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:03:40.863818 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4b7cc5-e266-4048-8a94-a0ade4bf5deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:40.906169 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:03:40.960933 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4b7cc5-e266-4048-8a94-a0ade4bf5deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1793714387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0d7be807-5817-4f1d-a429-8b9efd75b15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784a2229e2b6445589597e5bf3be6344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:03:41Z,use_quota=True,user_id='5f63dccf0b4843cb8aaeee1070d1f82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:40.981095 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea75b370-1bad-4530-aa3f-b096180810b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:40.996072 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea75b370-1bad-4530-aa3f-b096180810b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:41.020316 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db839a6-3c45-4790-bc69-8aca39c6f22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:41.036345 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db839a6-3c45-4790-bc69-8aca39c6f22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d7be807-5817-4f1d-a429-8b9efd75b15c', 'volume_name': 'volume-0d7be807-5817-4f1d-a429-8b9efd75b15c', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:41.053703 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75666426-9361-4a73-88a5-64fdf735dd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:41.077637 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75666426-9361-4a73-88a5-64fdf735dd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:41.106382 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfaee6c5-c19a-4c4b-857a-aa342434087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:41.110267 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Volume 0d7be807-5817-4f1d-a429-8b9efd75b15c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d7be807-5817-4f1d-a429-8b9efd75b15c', 'volume_size': 1} Mar 05 21:03:41.113231 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] creating volume 'volume-0d7be807-5817-4f1d-a429-8b9efd75b15c' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:03:41.119291 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:03:41.283478 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:03:41.284423 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:03:41.289054 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfaee6c5-c19a-4c4b-857a-aa342434087b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d7be807-5817-4f1d-a429-8b9efd75b15c', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:41.299440 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b818d1-2429-4df5-a81e-9ad53fc89141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:41.325720 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Volume volume-0d7be807-5817-4f1d-a429-8b9efd75b15c (0d7be807-5817-4f1d-a429-8b9efd75b15c): created successfully Mar 05 21:03:41.335268 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b818d1-2429-4df5-a81e-9ad53fc89141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:41.351010 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Flow 'volume_create_manager' (46e4130c-6110-42a1-8d1d-2c4d179a9649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:03:41.378706 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c63d7828-00ff-4d5c-8e69-9eb6c8a7f595 tempest-TaggedBootDevicesTest_v242-1271501382 None] Created volume successfully. Mar 05 21:03:43.268714 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:03:43.278224 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:03:43.278691 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:03:43.331551 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Flow 'volume_create_manager' (52e69230-e0f1-4f50-95ab-aa803db368be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:03:43.345561 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d614ced7-d74a-40ae-b401-58d8e50c00b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:43.362383 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:03:43.444981 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d614ced7-d74a-40ae-b401-58d8e50c00b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-166649071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=00215bb7-a3ee-4481-8b60-e90a6dd81c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784a2229e2b6445589597e5bf3be6344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:03:43Z,use_quota=True,user_id='5f63dccf0b4843cb8aaeee1070d1f82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:43.456655 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0184309-9313-430a-8921-6524565eaecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:43.467502 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0184309-9313-430a-8921-6524565eaecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:43.499143 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5841a0f-144b-4568-9a2c-9d5e0cbb336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:43.505888 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5841a0f-144b-4568-9a2c-9d5e0cbb336c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00215bb7-a3ee-4481-8b60-e90a6dd81c02', 'volume_name': 'volume-00215bb7-a3ee-4481-8b60-e90a6dd81c02', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:43.521386 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ffebac-5f84-48cb-af0a-e4c2908f391d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:43.526688 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ffebac-5f84-48cb-af0a-e4c2908f391d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:43.534447 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952dacdb-ab43-4f46-961f-101499f5c361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:43.543950 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Volume 00215bb7-a3ee-4481-8b60-e90a6dd81c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00215bb7-a3ee-4481-8b60-e90a6dd81c02', 'volume_size': 1} Mar 05 21:03:43.544983 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] creating volume 'volume-00215bb7-a3ee-4481-8b60-e90a6dd81c02' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:03:43.547027 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:03:43.711932 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:03:43.712551 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:03:43.720643 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952dacdb-ab43-4f46-961f-101499f5c361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00215bb7-a3ee-4481-8b60-e90a6dd81c02', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:43.726782 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb5479b-b390-42c3-861b-290dcb9df259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:03:43.757926 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Volume volume-00215bb7-a3ee-4481-8b60-e90a6dd81c02 (00215bb7-a3ee-4481-8b60-e90a6dd81c02): created successfully Mar 05 21:03:43.772174 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb5479b-b390-42c3-861b-290dcb9df259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:03:43.789389 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Flow 'volume_create_manager' (52e69230-e0f1-4f50-95ab-aa803db368be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:03:43.809845 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c63e1315-2fc3-471c-bead-63554c3858e1 tempest-TaggedBootDevicesTest_v242-1271501382 None] Created volume successfully. Mar 05 21:03:45.614371 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:03:45.614371 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:03:45.660910 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:03:45.728556 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:04:09.508702 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-6073d279-247d-425b-ac9e-29c0716424b2 req-15f1d847-502b-4c30-99fa-b796606dbdc7 tempest-TaggedBootDevicesTest_v242-1271501382 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:04:10.796998 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-6073d279-247d-425b-ac9e-29c0716424b2 req-15f1d847-502b-4c30-99fa-b796606dbdc7 tempest-TaggedBootDevicesTest_v242-1271501382 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.288s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:04:10.798766 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-6073d279-247d-425b-ac9e-29c0716424b2 req-15f1d847-502b-4c30-99fa-b796606dbdc7 tempest-TaggedBootDevicesTest_v242-1271501382 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c4889834-9564-427c-924e-8df6f5bc7738', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'c4889834-9564-427c-924e-8df6f5bc7738', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:04:10.861544 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-6073d279-247d-425b-ac9e-29c0716424b2 req-15f1d847-502b-4c30-99fa-b796606dbdc7 tempest-TaggedBootDevicesTest_v242-1271501382 None] Connection info returned from driver {'name': 'volumes/volume-c4889834-9564-427c-924e-8df6f5bc7738', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c4889834-9564-427c-924e-8df6f5bc7738', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ee075811-cfd8-4c97-8d19-4d16f3867ac8'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:04:10.984273 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-6073d279-247d-425b-ac9e-29c0716424b2 req-15f1d847-502b-4c30-99fa-b796606dbdc7 tempest-TaggedBootDevicesTest_v242-1271501382 None] attachment_update completed successfully. Mar 05 21:04:11.557556 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-6073d279-247d-425b-ac9e-29c0716424b2 req-78dade12-2986-44aa-9b69-6af06879063a tempest-TaggedBootDevicesTest_v242-1271501382 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:04:12.454856 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:04:12.473676 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:04:12.474482 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:04:12.584278 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Flow 'volume_create_manager' (f2e1d8a0-7bea-4257-9599-ea608fc0613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:04:12.621699 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255001a7-048d-418b-a2e5-adb9c73b1f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:04:12.664402 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:04:12.713881 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255001a7-048d-418b-a2e5-adb9c73b1f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1857836510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f864d28a-30a4-4c39-816b-157a4f914240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085ced4ef30745c88d1b33842076f02e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:04:12Z,use_quota=True,user_id='9e2c691e443445a8a79f758dabd9042e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:04:12.742923 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35c7aeb-d000-4c7d-bc5b-7a947821d7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:04:12.761819 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35c7aeb-d000-4c7d-bc5b-7a947821d7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:04:12.785732 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f5e808-449f-45f3-abed-327e0cb33133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:04:12.804665 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f5e808-449f-45f3-abed-327e0cb33133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f864d28a-30a4-4c39-816b-157a4f914240', 'volume_name': 'volume-f864d28a-30a4-4c39-816b-157a4f914240', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:04:12.820670 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e403a6de-ac3d-4d22-b11f-75c19dac34c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:04:12.829085 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e403a6de-ac3d-4d22-b11f-75c19dac34c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:04:12.863844 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5232362a-34d8-4a5b-a56c-7ea10bf20e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:04:12.867406 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Volume f864d28a-30a4-4c39-816b-157a4f914240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f864d28a-30a4-4c39-816b-157a4f914240', 'volume_size': 1} Mar 05 21:04:12.868153 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] creating volume 'volume-f864d28a-30a4-4c39-816b-157a4f914240' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:04:12.869633 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:04:13.080286 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:04:13.080682 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:04:13.084847 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5232362a-34d8-4a5b-a56c-7ea10bf20e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f864d28a-30a4-4c39-816b-157a4f914240', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:04:13.095843 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d4bf5c-b304-4df5-a8e5-dcffe80c7059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:04:13.128866 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Volume volume-f864d28a-30a4-4c39-816b-157a4f914240 (f864d28a-30a4-4c39-816b-157a4f914240): created successfully Mar 05 21:04:13.154997 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d4bf5c-b304-4df5-a8e5-dcffe80c7059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:04:13.180494 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Flow 'volume_create_manager' (f2e1d8a0-7bea-4257-9599-ea608fc0613c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:04:13.210360 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-96f94719-15f8-4837-b631-035ee5246817 tempest-ServerRescueNegativeTestJSON-406228691 None] Created volume successfully. Mar 05 21:04:13.509414 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-6073d279-247d-425b-ac9e-29c0716424b2 req-78dade12-2986-44aa-9b69-6af06879063a tempest-TaggedBootDevicesTest_v242-1271501382 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.956s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:04:13.510104 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-6073d279-247d-425b-ac9e-29c0716424b2 req-78dade12-2986-44aa-9b69-6af06879063a tempest-TaggedBootDevicesTest_v242-1271501382 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0d7be807-5817-4f1d-a429-8b9efd75b15c', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '0d7be807-5817-4f1d-a429-8b9efd75b15c', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:04:13.569218 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-6073d279-247d-425b-ac9e-29c0716424b2 req-78dade12-2986-44aa-9b69-6af06879063a tempest-TaggedBootDevicesTest_v242-1271501382 None] Connection info returned from driver {'name': 'volumes/volume-0d7be807-5817-4f1d-a429-8b9efd75b15c', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0d7be807-5817-4f1d-a429-8b9efd75b15c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1c0b25e7-2a84-42a7-9c8f-e4bc0cc7ab4e'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:04:13.717891 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-6073d279-247d-425b-ac9e-29c0716424b2 req-78dade12-2986-44aa-9b69-6af06879063a tempest-TaggedBootDevicesTest_v242-1271501382 None] attachment_update completed successfully. Mar 05 21:04:14.282414 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-6073d279-247d-425b-ac9e-29c0716424b2 req-9f90dcf3-0257-4710-b212-be8a65c8c756 tempest-TaggedBootDevicesTest_v242-1271501382 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:04:15.799434 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-6073d279-247d-425b-ac9e-29c0716424b2 req-9f90dcf3-0257-4710-b212-be8a65c8c756 tempest-TaggedBootDevicesTest_v242-1271501382 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.517s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:04:15.804083 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-6073d279-247d-425b-ac9e-29c0716424b2 req-9f90dcf3-0257-4710-b212-be8a65c8c756 tempest-TaggedBootDevicesTest_v242-1271501382 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-00215bb7-a3ee-4481-8b60-e90a6dd81c02', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '00215bb7-a3ee-4481-8b60-e90a6dd81c02', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:04:15.913104 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-6073d279-247d-425b-ac9e-29c0716424b2 req-9f90dcf3-0257-4710-b212-be8a65c8c756 tempest-TaggedBootDevicesTest_v242-1271501382 None] Connection info returned from driver {'name': 'volumes/volume-00215bb7-a3ee-4481-8b60-e90a6dd81c02', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '00215bb7-a3ee-4481-8b60-e90a6dd81c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fe1ebf45-0c40-42b6-8ae6-8a0dbe897046'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:04:16.088480 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-6073d279-247d-425b-ac9e-29c0716424b2 req-9f90dcf3-0257-4710-b212-be8a65c8c756 tempest-TaggedBootDevicesTest_v242-1271501382 None] attachment_update completed successfully. Mar 05 21:04:41.668253 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:04:41.674974 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:04:41.675473 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:04:41.726501 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Flow 'volume_create_manager' (674ecc55-9bb1-4207-a9cb-933005210e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:04:41.752868 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c718fa-1a0c-4da9-9955-137f54cd5610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:04:41.766859 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:04:41.798005 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c718fa-1a0c-4da9-9955-137f54cd5610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-865526713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=65350572-d864-493f-aaec-a23a7dfc2714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085ced4ef30745c88d1b33842076f02e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:04:42Z,use_quota=True,user_id='9e2c691e443445a8a79f758dabd9042e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:04:41.813744 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c2a046-cce8-4919-be04-c56f8a2e9261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:04:41.818080 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c2a046-cce8-4919-be04-c56f8a2e9261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:04:41.842846 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4f285b-d73c-49c0-9a74-be945b4f4f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:04:41.847304 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4f285b-d73c-49c0-9a74-be945b4f4f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65350572-d864-493f-aaec-a23a7dfc2714', 'volume_name': 'volume-65350572-d864-493f-aaec-a23a7dfc2714', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:04:41.852520 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0b4ca6-3430-4080-b162-0f49bffcb3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:04:41.869299 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0b4ca6-3430-4080-b162-0f49bffcb3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:04:41.880358 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792ac6a4-4518-40fb-b944-c3390e9e9c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:04:41.881552 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Volume 65350572-d864-493f-aaec-a23a7dfc2714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65350572-d864-493f-aaec-a23a7dfc2714', 'volume_size': 1} Mar 05 21:04:41.881964 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] creating volume 'volume-65350572-d864-493f-aaec-a23a7dfc2714' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:04:41.889716 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:04:41.999799 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:04:42.000313 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:04:42.008357 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792ac6a4-4518-40fb-b944-c3390e9e9c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65350572-d864-493f-aaec-a23a7dfc2714', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:04:42.014825 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a7eec1-35d4-4dec-aaca-f0f65423f8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:04:42.026479 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Volume volume-65350572-d864-493f-aaec-a23a7dfc2714 (65350572-d864-493f-aaec-a23a7dfc2714): created successfully Mar 05 21:04:42.032552 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a7eec1-35d4-4dec-aaca-f0f65423f8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:04:42.040759 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Flow 'volume_create_manager' (674ecc55-9bb1-4207-a9cb-933005210e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:04:42.053432 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b2f601f9-bc24-483f-b171-4028c025d477 tempest-ServerRescueNegativeTestJSON-406228691 None] Created volume successfully. Mar 05 21:04:43.908523 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-a3f1c510-543b-4855-97db-1744c525d4c6 req-db06025d-77d7-4d79-8efa-58cf096769fa tempest-ServerRescueNegativeTestJSON-406228691 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:04:44.996126 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-a3f1c510-543b-4855-97db-1744c525d4c6 req-db06025d-77d7-4d79-8efa-58cf096769fa tempest-ServerRescueNegativeTestJSON-406228691 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.087s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:04:44.996888 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-a3f1c510-543b-4855-97db-1744c525d4c6 req-db06025d-77d7-4d79-8efa-58cf096769fa tempest-ServerRescueNegativeTestJSON-406228691 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-65350572-d864-493f-aaec-a23a7dfc2714', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '65350572-d864-493f-aaec-a23a7dfc2714', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:04:45.038383 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-a3f1c510-543b-4855-97db-1744c525d4c6 req-db06025d-77d7-4d79-8efa-58cf096769fa tempest-ServerRescueNegativeTestJSON-406228691 None] Connection info returned from driver {'name': 'volumes/volume-65350572-d864-493f-aaec-a23a7dfc2714', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '65350572-d864-493f-aaec-a23a7dfc2714', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '720959b1-2db0-43c4-b50e-e2fc5519e206'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:04:45.110104 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-a3f1c510-543b-4855-97db-1744c525d4c6 req-db06025d-77d7-4d79-8efa-58cf096769fa tempest-ServerRescueNegativeTestJSON-406228691 None] attachment_update completed successfully. Mar 05 21:04:45.608886 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:04:45.611262 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:04:45.683764 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:04:45.749494 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:05:13.993203 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:05:14.000237 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:05:14.002160 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:05:14.029615 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Flow 'volume_create_manager' (8baf153a-40ff-4039-930a-df401f1c4cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:05:14.038139 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f43a9f-203e-4828-bcd8-56e450db8cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:05:14.048622 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:05:14.072449 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f43a9f-203e-4828-bcd8-56e450db8cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1530225367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=709d15ba-e7de-47cb-b413-2d77e7440ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f59b6cf41e6d4308819eb264dcaa320e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:05:14Z,use_quota=True,user_id='352a9d7250c742638d90f17006f12c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:05:14.078362 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b0321f-26e1-4e0d-b128-69f9004e45de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:05:14.082777 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b0321f-26e1-4e0d-b128-69f9004e45de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:05:14.088676 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0803e196-7b2e-4bb3-9c2d-2d47d4fe81a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:05:14.093485 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0803e196-7b2e-4bb3-9c2d-2d47d4fe81a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '709d15ba-e7de-47cb-b413-2d77e7440ddd', 'volume_name': 'volume-709d15ba-e7de-47cb-b413-2d77e7440ddd', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:05:14.099029 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49bc281c-effe-4812-a42d-b847ece35605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:05:14.104046 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49bc281c-effe-4812-a42d-b847ece35605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:05:14.109792 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af1b940-5aa6-4b1b-968e-f48f7e7720c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:05:14.111177 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Volume 709d15ba-e7de-47cb-b413-2d77e7440ddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-709d15ba-e7de-47cb-b413-2d77e7440ddd', 'volume_size': 1} Mar 05 21:05:14.111506 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] creating volume 'volume-709d15ba-e7de-47cb-b413-2d77e7440ddd' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:05:14.112706 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:14.251513 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:05:14.251923 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:05:14.256904 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af1b940-5aa6-4b1b-968e-f48f7e7720c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709d15ba-e7de-47cb-b413-2d77e7440ddd', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:05:14.265538 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea5c1e9-bb3a-4b33-9161-2c37a8b78c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:05:14.277331 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Volume volume-709d15ba-e7de-47cb-b413-2d77e7440ddd (709d15ba-e7de-47cb-b413-2d77e7440ddd): created successfully Mar 05 21:05:14.283150 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea5c1e9-bb3a-4b33-9161-2c37a8b78c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:05:14.292257 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Flow 'volume_create_manager' (8baf153a-40ff-4039-930a-df401f1c4cfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:05:14.307659 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-e0a810f4-20c6-4fc7-aa1c-42425764af25 tempest-AttachVolumeTestJSON-1994322257 None] Created volume successfully. Mar 05 21:05:15.580658 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-20d1ebab-e73a-41c1-925c-852d1722dbe4 req-ed67f6a0-4334-48d3-9025-e7a3037c6d64 tempest-AttachVolumeTestJSON-1994322257 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:05:16.417558 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-20d1ebab-e73a-41c1-925c-852d1722dbe4 req-ed67f6a0-4334-48d3-9025-e7a3037c6d64 tempest-AttachVolumeTestJSON-1994322257 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.836s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:05:16.419154 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-20d1ebab-e73a-41c1-925c-852d1722dbe4 req-ed67f6a0-4334-48d3-9025-e7a3037c6d64 tempest-AttachVolumeTestJSON-1994322257 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-709d15ba-e7de-47cb-b413-2d77e7440ddd', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '709d15ba-e7de-47cb-b413-2d77e7440ddd', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:05:16.468354 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-20d1ebab-e73a-41c1-925c-852d1722dbe4 req-ed67f6a0-4334-48d3-9025-e7a3037c6d64 tempest-AttachVolumeTestJSON-1994322257 None] Connection info returned from driver {'name': 'volumes/volume-709d15ba-e7de-47cb-b413-2d77e7440ddd', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '709d15ba-e7de-47cb-b413-2d77e7440ddd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '324a672c-6d0c-47aa-aea0-7c8b2b71bf7e'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:05:16.581728 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-20d1ebab-e73a-41c1-925c-852d1722dbe4 req-ed67f6a0-4334-48d3-9025-e7a3037c6d64 tempest-AttachVolumeTestJSON-1994322257 None] attachment_update completed successfully. Mar 05 21:05:19.166663 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:05:19.171607 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:05:19.172155 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:05:19.198342 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Flow 'volume_create_manager' (b960f6e8-c410-4bf3-8a8d-a15eaf41eca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:05:19.207384 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2283eb0d-cb2c-4c67-9693-4a8e69feaf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:05:19.215979 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:05:19.235945 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2283eb0d-cb2c-4c67-9693-4a8e69feaf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1015396306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e06e2c79-85f3-45fe-82b7-e23e9817cca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f59b6cf41e6d4308819eb264dcaa320e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:05:19Z,use_quota=True,user_id='352a9d7250c742638d90f17006f12c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:05:19.241688 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a706c1-238f-4358-9833-377f7df91f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:05:19.246218 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a706c1-238f-4358-9833-377f7df91f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:05:19.251984 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996bd5da-ef94-47f9-a9ea-e6c4ac788ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:05:19.256618 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996bd5da-ef94-47f9-a9ea-e6c4ac788ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e06e2c79-85f3-45fe-82b7-e23e9817cca9', 'volume_name': 'volume-e06e2c79-85f3-45fe-82b7-e23e9817cca9', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:05:19.263008 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642efc2b-36b1-4b53-b4b2-ade79769bd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:05:19.267958 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642efc2b-36b1-4b53-b4b2-ade79769bd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:05:19.275240 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a23b331-4a4b-47b1-a750-66758897961f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:05:19.278358 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Volume e06e2c79-85f3-45fe-82b7-e23e9817cca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e06e2c79-85f3-45fe-82b7-e23e9817cca9', 'volume_size': 1} Mar 05 21:05:19.279119 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] creating volume 'volume-e06e2c79-85f3-45fe-82b7-e23e9817cca9' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:05:19.280623 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:19.390510 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:05:19.391633 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:05:19.402570 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a23b331-4a4b-47b1-a750-66758897961f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e06e2c79-85f3-45fe-82b7-e23e9817cca9', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:05:19.408808 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e165730-7033-4aa9-b0f0-e07b91b6bd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:05:19.421907 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Volume volume-e06e2c79-85f3-45fe-82b7-e23e9817cca9 (e06e2c79-85f3-45fe-82b7-e23e9817cca9): created successfully Mar 05 21:05:19.429111 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e165730-7033-4aa9-b0f0-e07b91b6bd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:05:19.441160 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Flow 'volume_create_manager' (b960f6e8-c410-4bf3-8a8d-a15eaf41eca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:05:19.458264 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-865e52d3-bfc8-46fb-9169-68ffdb0802dc tempest-AttachVolumeTestJSON-1994322257 None] Created volume successfully. Mar 05 21:05:20.818819 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-6bde9d05-69a8-428a-8858-e2dc2a030bdc req-0031667b-0637-4814-90a5-4842fbb14e40 tempest-AttachVolumeTestJSON-1994322257 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:05:21.653324 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-6bde9d05-69a8-428a-8858-e2dc2a030bdc req-0031667b-0637-4814-90a5-4842fbb14e40 tempest-AttachVolumeTestJSON-1994322257 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.834s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:05:21.654791 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-6bde9d05-69a8-428a-8858-e2dc2a030bdc req-0031667b-0637-4814-90a5-4842fbb14e40 tempest-AttachVolumeTestJSON-1994322257 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e06e2c79-85f3-45fe-82b7-e23e9817cca9', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'e06e2c79-85f3-45fe-82b7-e23e9817cca9', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:05:21.701126 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-6bde9d05-69a8-428a-8858-e2dc2a030bdc req-0031667b-0637-4814-90a5-4842fbb14e40 tempest-AttachVolumeTestJSON-1994322257 None] Connection info returned from driver {'name': 'volumes/volume-e06e2c79-85f3-45fe-82b7-e23e9817cca9', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e06e2c79-85f3-45fe-82b7-e23e9817cca9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '98892269-0f7c-40ac-8df9-0ab3df563628'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:05:21.770540 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-6bde9d05-69a8-428a-8858-e2dc2a030bdc req-0031667b-0637-4814-90a5-4842fbb14e40 tempest-AttachVolumeTestJSON-1994322257 None] attachment_update completed successfully. Mar 05 21:05:22.086661 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-b809894d-1311-4ad9-8c60-bb5dfc85a966 req-ccdbe96c-219b-4de1-a513-9b954f58b54a tempest-ServerRescueNegativeTestJSON-406228691 None] Terminate volume connection completed successfully. Mar 05 21:05:22.087338 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-b809894d-1311-4ad9-8c60-bb5dfc85a966 req-ccdbe96c-219b-4de1-a513-9b954f58b54a tempest-ServerRescueNegativeTestJSON-406228691 None] Deleting attachment 720959b1-2db0-43c4-b50e-e2fc5519e206. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:05:22.717847 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-97d8205b-aa60-4db3-822d-40a5e72f51d7 tempest-ServerRescueNegativeTestJSON-406228691 None] Lock "b'cinder-65350572-d864-493f-aaec-a23a7dfc2714-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:05:22.779044 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-97d8205b-aa60-4db3-822d-40a5e72f51d7 tempest-ServerRescueNegativeTestJSON-406228691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:22.836660 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-97d8205b-aa60-4db3-822d-40a5e72f51d7 tempest-ServerRescueNegativeTestJSON-406228691 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:05:22.837207 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-97d8205b-aa60-4db3-822d-40a5e72f51d7 tempest-ServerRescueNegativeTestJSON-406228691 None] Volume volume-65350572-d864-493f-aaec-a23a7dfc2714 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:05:22.844357 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-97d8205b-aa60-4db3-822d-40a5e72f51d7 tempest-ServerRescueNegativeTestJSON-406228691 None] deleting rbd volume volume-65350572-d864-493f-aaec-a23a7dfc2714 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:05:23.128558 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-97d8205b-aa60-4db3-822d-40a5e72f51d7 tempest-ServerRescueNegativeTestJSON-406228691 None] Created reservations ['413d1b78-e7df-4a94-bdbd-76b91d05935d', '3ac6b26d-c47c-4fbd-9078-89078a09fadb', '07524f7a-f011-4b96-aafd-0f8595dca2d1', '89e81841-3464-4cc0-ad1a-b525c124a605'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:05:23.177984 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-97d8205b-aa60-4db3-822d-40a5e72f51d7 tempest-ServerRescueNegativeTestJSON-406228691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:23.207327 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-97d8205b-aa60-4db3-822d-40a5e72f51d7 tempest-ServerRescueNegativeTestJSON-406228691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:23.246051 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-97d8205b-aa60-4db3-822d-40a5e72f51d7 tempest-ServerRescueNegativeTestJSON-406228691 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:05:23.255833 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-97d8205b-aa60-4db3-822d-40a5e72f51d7 tempest-ServerRescueNegativeTestJSON-406228691 None] Deleted volume successfully. Mar 05 21:05:23.271842 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-97d8205b-aa60-4db3-822d-40a5e72f51d7 tempest-ServerRescueNegativeTestJSON-406228691 None] Lock "b'cinder-65350572-d864-493f-aaec-a23a7dfc2714-delete_volume'" released by "delete_volume" :: held 0.554s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:05:23.923150 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-3705bb13-24d8-4b86-8a37-6fc6e34298bc tempest-ServerRescueNegativeTestJSON-406228691 None] Lock "b'cinder-f864d28a-30a4-4c39-816b-157a4f914240-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:05:23.983984 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3705bb13-24d8-4b86-8a37-6fc6e34298bc tempest-ServerRescueNegativeTestJSON-406228691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:24.038143 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3705bb13-24d8-4b86-8a37-6fc6e34298bc tempest-ServerRescueNegativeTestJSON-406228691 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:05:24.039141 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3705bb13-24d8-4b86-8a37-6fc6e34298bc tempest-ServerRescueNegativeTestJSON-406228691 None] Volume volume-f864d28a-30a4-4c39-816b-157a4f914240 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:05:24.046143 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3705bb13-24d8-4b86-8a37-6fc6e34298bc tempest-ServerRescueNegativeTestJSON-406228691 None] deleting rbd volume volume-f864d28a-30a4-4c39-816b-157a4f914240 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:05:24.367464 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-3705bb13-24d8-4b86-8a37-6fc6e34298bc tempest-ServerRescueNegativeTestJSON-406228691 None] Created reservations ['cf9cb6e2-5e1d-48aa-b589-faeecd51f7f0', '74f89cf5-4e61-4cc9-b762-8f62de32422e', '95b6ea97-4475-4a2f-811e-8757135bfe69', 'f30b12af-6ff9-40e8-a3c4-4ec292d530f2'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:05:24.435570 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3705bb13-24d8-4b86-8a37-6fc6e34298bc tempest-ServerRescueNegativeTestJSON-406228691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:24.494300 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3705bb13-24d8-4b86-8a37-6fc6e34298bc tempest-ServerRescueNegativeTestJSON-406228691 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:24.569939 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-3705bb13-24d8-4b86-8a37-6fc6e34298bc tempest-ServerRescueNegativeTestJSON-406228691 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:05:24.576310 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-3705bb13-24d8-4b86-8a37-6fc6e34298bc tempest-ServerRescueNegativeTestJSON-406228691 None] Deleted volume successfully. Mar 05 21:05:24.598054 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-3705bb13-24d8-4b86-8a37-6fc6e34298bc tempest-ServerRescueNegativeTestJSON-406228691 None] Lock "b'cinder-f864d28a-30a4-4c39-816b-157a4f914240-delete_volume'" released by "delete_volume" :: held 0.675s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:05:25.313393 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-c443fc90-994f-4070-acfe-203e49ba6e03 req-f206dd27-0940-400d-9167-574b738deed6 tempest-AttachVolumeTestJSON-1994322257 None] Terminate volume connection completed successfully. Mar 05 21:05:25.314021 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-c443fc90-994f-4070-acfe-203e49ba6e03 req-f206dd27-0940-400d-9167-574b738deed6 tempest-AttachVolumeTestJSON-1994322257 None] Deleting attachment 324a672c-6d0c-47aa-aea0-7c8b2b71bf7e. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:05:26.846221 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-e84266c1-1d3f-434a-937e-6fb92041f55e req-9e7a0179-615e-439f-aa09-cdf5deb4a1ac tempest-AttachVolumeTestJSON-1994322257 None] Terminate volume connection completed successfully. Mar 05 21:05:26.846945 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-e84266c1-1d3f-434a-937e-6fb92041f55e req-9e7a0179-615e-439f-aa09-cdf5deb4a1ac tempest-AttachVolumeTestJSON-1994322257 None] Deleting attachment 98892269-0f7c-40ac-8df9-0ab3df563628. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:05:36.062348 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-8ec9cbee-888c-469b-ba7e-1987a016e6d1 tempest-AttachVolumeTestJSON-1994322257 None] Lock "b'cinder-e06e2c79-85f3-45fe-82b7-e23e9817cca9-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:05:36.174092 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8ec9cbee-888c-469b-ba7e-1987a016e6d1 tempest-AttachVolumeTestJSON-1994322257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:36.266436 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8ec9cbee-888c-469b-ba7e-1987a016e6d1 tempest-AttachVolumeTestJSON-1994322257 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:05:36.267185 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8ec9cbee-888c-469b-ba7e-1987a016e6d1 tempest-AttachVolumeTestJSON-1994322257 None] Volume volume-e06e2c79-85f3-45fe-82b7-e23e9817cca9 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:05:36.284465 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8ec9cbee-888c-469b-ba7e-1987a016e6d1 tempest-AttachVolumeTestJSON-1994322257 None] deleting rbd volume volume-e06e2c79-85f3-45fe-82b7-e23e9817cca9 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:05:36.764317 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-8ec9cbee-888c-469b-ba7e-1987a016e6d1 tempest-AttachVolumeTestJSON-1994322257 None] Created reservations ['8526a316-f82e-4d62-9d89-781722b6ccd6', '46727dcc-e653-4b44-a4ac-9a2f9d25536e', 'df57cdc7-f5cd-43b4-8096-97ce691e8e7f', '14c5cc02-6a4f-4bdd-a934-8c94359a5a7e'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:05:36.842750 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8ec9cbee-888c-469b-ba7e-1987a016e6d1 tempest-AttachVolumeTestJSON-1994322257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:36.916997 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8ec9cbee-888c-469b-ba7e-1987a016e6d1 tempest-AttachVolumeTestJSON-1994322257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:36.962388 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-8ec9cbee-888c-469b-ba7e-1987a016e6d1 tempest-AttachVolumeTestJSON-1994322257 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:05:36.972864 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8ec9cbee-888c-469b-ba7e-1987a016e6d1 tempest-AttachVolumeTestJSON-1994322257 None] Deleted volume successfully. Mar 05 21:05:36.993644 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-8ec9cbee-888c-469b-ba7e-1987a016e6d1 tempest-AttachVolumeTestJSON-1994322257 None] Lock "b'cinder-e06e2c79-85f3-45fe-82b7-e23e9817cca9-delete_volume'" released by "delete_volume" :: held 0.936s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:05:37.405547 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-2dfb16ac-686a-486d-b8ab-19d8e256c3c3 tempest-AttachVolumeTestJSON-1994322257 None] Lock "b'cinder-709d15ba-e7de-47cb-b413-2d77e7440ddd-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:05:37.477987 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2dfb16ac-686a-486d-b8ab-19d8e256c3c3 tempest-AttachVolumeTestJSON-1994322257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:37.556559 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2dfb16ac-686a-486d-b8ab-19d8e256c3c3 tempest-AttachVolumeTestJSON-1994322257 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:05:37.556990 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2dfb16ac-686a-486d-b8ab-19d8e256c3c3 tempest-AttachVolumeTestJSON-1994322257 None] Volume volume-709d15ba-e7de-47cb-b413-2d77e7440ddd is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:05:37.566134 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2dfb16ac-686a-486d-b8ab-19d8e256c3c3 tempest-AttachVolumeTestJSON-1994322257 None] deleting rbd volume volume-709d15ba-e7de-47cb-b413-2d77e7440ddd {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:05:38.081213 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-2dfb16ac-686a-486d-b8ab-19d8e256c3c3 tempest-AttachVolumeTestJSON-1994322257 None] Created reservations ['87507996-6270-42f6-ba17-0a0151f1da5c', 'd58f2072-f911-4c7f-8467-0556b9b3e962', 'a5fb12f5-49f5-421a-912c-c83dde3bb267', '1c8af604-be24-444a-9f9f-c77d1370338a'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:05:38.140965 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2dfb16ac-686a-486d-b8ab-19d8e256c3c3 tempest-AttachVolumeTestJSON-1994322257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:38.198006 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2dfb16ac-686a-486d-b8ab-19d8e256c3c3 tempest-AttachVolumeTestJSON-1994322257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:38.251751 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-2dfb16ac-686a-486d-b8ab-19d8e256c3c3 tempest-AttachVolumeTestJSON-1994322257 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:05:38.259750 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-2dfb16ac-686a-486d-b8ab-19d8e256c3c3 tempest-AttachVolumeTestJSON-1994322257 None] Deleted volume successfully. Mar 05 21:05:38.282798 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-2dfb16ac-686a-486d-b8ab-19d8e256c3c3 tempest-AttachVolumeTestJSON-1994322257 None] Lock "b'cinder-709d15ba-e7de-47cb-b413-2d77e7440ddd-delete_volume'" released by "delete_volume" :: held 0.878s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:05:38.850204 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-a9298e9a-0a5d-402b-a54a-4ae25150a462 tempest-AttachVolumeTestJSON-1994322257 None] Lock "b'cinder-8607c3b6-20ea-47c0-9fee-9ac4fd535791-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:05:38.923947 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a9298e9a-0a5d-402b-a54a-4ae25150a462 tempest-AttachVolumeTestJSON-1994322257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:39.047500 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a9298e9a-0a5d-402b-a54a-4ae25150a462 tempest-AttachVolumeTestJSON-1994322257 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:05:39.047500 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a9298e9a-0a5d-402b-a54a-4ae25150a462 tempest-AttachVolumeTestJSON-1994322257 None] Volume volume-8607c3b6-20ea-47c0-9fee-9ac4fd535791 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:05:39.074473 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a9298e9a-0a5d-402b-a54a-4ae25150a462 tempest-AttachVolumeTestJSON-1994322257 None] deleting rbd volume volume-8607c3b6-20ea-47c0-9fee-9ac4fd535791 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:05:39.572291 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-a9298e9a-0a5d-402b-a54a-4ae25150a462 tempest-AttachVolumeTestJSON-1994322257 None] Created reservations ['52032a7f-1fd3-42ad-99d6-ace4f52f7838', '9994c8ca-0d75-42bf-ad12-364f4c350332', '60ed1d25-6322-44be-ae2c-74a613c34c30', '32407fd4-b95a-4793-984a-f9e72c747cb1'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:05:39.636276 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a9298e9a-0a5d-402b-a54a-4ae25150a462 tempest-AttachVolumeTestJSON-1994322257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:39.687857 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a9298e9a-0a5d-402b-a54a-4ae25150a462 tempest-AttachVolumeTestJSON-1994322257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:39.761121 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-a9298e9a-0a5d-402b-a54a-4ae25150a462 tempest-AttachVolumeTestJSON-1994322257 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:05:39.767198 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-a9298e9a-0a5d-402b-a54a-4ae25150a462 tempest-AttachVolumeTestJSON-1994322257 None] Deleted volume successfully. Mar 05 21:05:39.799080 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-a9298e9a-0a5d-402b-a54a-4ae25150a462 tempest-AttachVolumeTestJSON-1994322257 None] Lock "b'cinder-8607c3b6-20ea-47c0-9fee-9ac4fd535791-delete_volume'" released by "delete_volume" :: held 0.949s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:05:45.605564 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:05:45.607871 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:45.683350 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:05:45.764802 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:06:45.609818 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:06:45.610487 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:06:45.650457 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:06:45.700820 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:07:26.818621 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:07:26.826563 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:07:26.829023 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:07:26.875853 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Flow 'volume_create_manager' (b63a2af7-58c5-4747-90f8-af81cc17dde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:07:26.898925 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8558bb69-34bd-48f7-a9d1-071aa61a61a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:07:26.915794 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:07:26.968151 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8558bb69-34bd-48f7-a9d1-071aa61a61a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1167075122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1b988a6d-e525-416a-98bd-60d0787e1b67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='def4cea650ac491985dac1868ac5052a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:07:27Z,use_quota=True,user_id='2aa54ee852c148f19a384be2177b19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:07:26.981963 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd696ae-7d17-4366-afb7-d1ac4021d7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:07:26.995418 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd696ae-7d17-4366-afb7-d1ac4021d7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:07:27.003371 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a497af-c023-4687-8500-a38b8779f47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:07:27.023022 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a497af-c023-4687-8500-a38b8779f47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b988a6d-e525-416a-98bd-60d0787e1b67', 'volume_name': 'volume-1b988a6d-e525-416a-98bd-60d0787e1b67', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:07:27.030224 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d9da33-976e-4e16-82fd-cf26e844314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:07:27.043562 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d9da33-976e-4e16-82fd-cf26e844314f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:07:27.055160 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ee32dc-cb62-46b9-9c51-8cf6a0227cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:07:27.063059 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Volume 1b988a6d-e525-416a-98bd-60d0787e1b67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b988a6d-e525-416a-98bd-60d0787e1b67', 'volume_size': 1} Mar 05 21:07:27.065887 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] creating volume 'volume-1b988a6d-e525-416a-98bd-60d0787e1b67' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:07:27.068922 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:07:27.225292 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:07:27.225875 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:07:27.234851 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ee32dc-cb62-46b9-9c51-8cf6a0227cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b988a6d-e525-416a-98bd-60d0787e1b67', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:07:27.246591 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434bc32c-b90a-476a-a0f6-4e36cbc472f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:07:27.271308 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Volume volume-1b988a6d-e525-416a-98bd-60d0787e1b67 (1b988a6d-e525-416a-98bd-60d0787e1b67): created successfully Mar 05 21:07:27.288237 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434bc32c-b90a-476a-a0f6-4e36cbc472f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:07:27.306828 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Flow 'volume_create_manager' (b63a2af7-58c5-4747-90f8-af81cc17dde3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:07:27.331435 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6b2e6fd2-4bf2-4132-ab5f-07374e3a943d tempest-ServersNegativeTestJSON-876211055 None] Created volume successfully. Mar 05 21:07:30.729976 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:07:30.736798 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:07:30.737400 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:07:30.785803 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Flow 'volume_create_manager' (b62acd3c-ca3e-4ded-b17c-413d971dd4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:07:30.829117 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d453d2-5899-458e-ac4b-bba4e9cc1622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:07:30.850876 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:07:30.904736 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d453d2-5899-458e-ac4b-bba4e9cc1622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2049650664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aec7721e-406d-4947-9acc-557054b0a1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='def4cea650ac491985dac1868ac5052a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:07:31Z,use_quota=True,user_id='2aa54ee852c148f19a384be2177b19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:07:30.920692 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad34a298-533c-42ea-8dbe-50ccf04941ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:07:30.933122 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad34a298-533c-42ea-8dbe-50ccf04941ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:07:30.943751 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19138de-7298-4efc-bb8e-cc273add6770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:07:30.951547 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19138de-7298-4efc-bb8e-cc273add6770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aec7721e-406d-4947-9acc-557054b0a1e0', 'volume_name': 'volume-aec7721e-406d-4947-9acc-557054b0a1e0', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:07:30.959196 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5111a2d3-f247-407d-81d4-3c5a81e3ab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:07:30.966677 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5111a2d3-f247-407d-81d4-3c5a81e3ab59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:07:30.975178 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d8c0dc-acc9-4616-98e4-db76822e8db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:07:30.977520 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Volume aec7721e-406d-4947-9acc-557054b0a1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aec7721e-406d-4947-9acc-557054b0a1e0', 'volume_size': 1} Mar 05 21:07:30.978222 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] creating volume 'volume-aec7721e-406d-4947-9acc-557054b0a1e0' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:07:30.979888 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:07:31.169695 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:07:31.170069 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:07:31.174614 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d8c0dc-acc9-4616-98e4-db76822e8db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec7721e-406d-4947-9acc-557054b0a1e0', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:07:31.179928 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed76a57c-0058-45aa-8b06-2beb623f5047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:07:31.209848 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Volume volume-aec7721e-406d-4947-9acc-557054b0a1e0 (aec7721e-406d-4947-9acc-557054b0a1e0): created successfully Mar 05 21:07:31.215375 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed76a57c-0058-45aa-8b06-2beb623f5047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:07:31.221313 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Flow 'volume_create_manager' (b62acd3c-ca3e-4ded-b17c-413d971dd4f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:07:31.247194 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-02e3b93d-c3d4-4161-8fa5-4cbcf57ced83 tempest-ServersNegativeTestJSON-876211055 None] Created volume successfully. Mar 05 21:07:45.611101 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:07:45.622660 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:07:45.754633 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:07:45.866640 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:08:11.006315 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:08:11.015301 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:08:11.015810 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:08:11.078673 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Flow 'volume_create_manager' (cc3a609c-4cd8-46d0-9626-251b416177f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:08:11.102011 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8113b846-d436-42c1-9e5d-f57007305ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:11.115132 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:08:11.165602 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8113b846-d436-42c1-9e5d-f57007305ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-569677090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b22e1911-a4e8-47cf-863e-0a7a04265855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa71bdd8c3394c1ca9fb656a112d9349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:08:11Z,use_quota=True,user_id='d0f84866b0f34e6da2d051b5b3583e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:11.190517 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd7adc9-25e1-40e2-a7bb-e2728c4985bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:11.201376 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd7adc9-25e1-40e2-a7bb-e2728c4985bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:11.220159 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94aef63-259d-41d1-9d33-f74b61724622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:11.359728 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94aef63-259d-41d1-9d33-f74b61724622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b22e1911-a4e8-47cf-863e-0a7a04265855', 'volume_name': 'volume-b22e1911-a4e8-47cf-863e-0a7a04265855', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:11.380173 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60024c67-c4da-4860-a08e-ed15bc6138d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:11.391395 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60024c67-c4da-4860-a08e-ed15bc6138d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:11.401942 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39164402-aeb9-484a-840c-47ba9cd82c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:11.403992 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Volume b22e1911-a4e8-47cf-863e-0a7a04265855: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b22e1911-a4e8-47cf-863e-0a7a04265855', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 21:08:11.404941 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Cloning b22e1911-a4e8-47cf-863e-0a7a04265855 from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 21:08:11.443409 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.037s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:08:11.459948 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 8, 11, 452648)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:08:11.463119 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:08:11.470217 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Found cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 05 21:08:11.483013 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 0.040s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:08:11.493988 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 21:08:11.516195 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 8, 11, 505557)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:08:11.516952 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:08:11.517445 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Creating from source image-volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7 {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 05 21:08:11.547432 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:08:11.644838 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] creating snapshot='volume-b22e1911-a4e8-47cf-863e-0a7a04265855.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 21:08:12.073970 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] cloning 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7@volume-b22e1911-a4e8-47cf-863e-0a7a04265855.clone_snap' to 'volume-b22e1911-a4e8-47cf-863e-0a7a04265855' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 21:08:12.327211 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a.deleted is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:08:12.328549 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:08:12.329033 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:08:12.369521 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 21:08:12.370318 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Marking volume b22e1911-a4e8-47cf-863e-0a7a04265855 as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 21:08:12.383702 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to b22e1911-a4e8-47cf-863e-0a7a04265855. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 21:08:12.384370 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Creating volume glance metadata for volume b22e1911-a4e8-47cf-863e-0a7a04265855 backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 21:08:12.597669 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39164402-aeb9-484a-840c-47ba9cd82c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b22e1911-a4e8-47cf-863e-0a7a04265855', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:12.615440 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a978fe57-3f0a-4dcd-a72f-e538c870d5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:12.644229 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Volume volume-b22e1911-a4e8-47cf-863e-0a7a04265855 (b22e1911-a4e8-47cf-863e-0a7a04265855): created successfully Mar 05 21:08:12.652269 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a978fe57-3f0a-4dcd-a72f-e538c870d5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:12.670933 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Flow 'volume_create_manager' (cc3a609c-4cd8-46d0-9626-251b416177f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:08:12.691634 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-4ccff181-8600-47cd-a894-0fbf51cad23e tempest-TestVolumeBackupRestore-590870803 None] Created volume successfully. Mar 05 21:08:13.774400 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f48a0563-41c4-4631-b675-dab6edc26e20 tempest-TestVolumeBackupRestore-590870803 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-05T21:08:13Z,data_timestamp=2022-03-05T21:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=e6dd2589-6441-4a5d-8b21-aca7be541bc9,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='aa71bdd8c3394c1ca9fb656a112d9349',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d0f84866b0f34e6da2d051b5b3583e13',volume_id=b22e1911-a4e8-47cf-863e-0a7a04265855) Mar 05 21:08:13.785362 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.backup.rpcapi [None req-f48a0563-41c4-4631-b675-dab6edc26e20 tempest-TestVolumeBackupRestore-590870803 None] continue_backup in rpcapi backup_id e6dd2589-6441-4a5d-8b21-aca7be541bc9 {{(pid=134747) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 05 21:08:14.230442 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-f48a0563-41c4-4631-b675-dab6edc26e20 tempest-TestVolumeBackupRestore-590870803 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:08:15.336460 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-f48a0563-41c4-4631-b675-dab6edc26e20 tempest-TestVolumeBackupRestore-590870803 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.106s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:08:15.339004 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f48a0563-41c4-4631-b675-dab6edc26e20 tempest-TestVolumeBackupRestore-590870803 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b22e1911-a4e8-47cf-863e-0a7a04265855', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'b22e1911-a4e8-47cf-863e-0a7a04265855', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:08:15.386476 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f48a0563-41c4-4631-b675-dab6edc26e20 tempest-TestVolumeBackupRestore-590870803 None] Initialize volume connection completed successfully. Mar 05 21:08:24.569644 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f48a0563-41c4-4631-b675-dab6edc26e20 tempest-TestVolumeBackupRestore-590870803 None] Terminate volume connection completed successfully. Mar 05 21:08:24.619933 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f48a0563-41c4-4631-b675-dab6edc26e20 tempest-TestVolumeBackupRestore-590870803 None] Remove volume export completed successfully. Mar 05 21:08:25.741579 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:08:25.746768 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:08:25.747536 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:08:25.773993 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Flow 'volume_create_manager' (015d7732-905b-498f-82fd-24617c64d043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:08:25.782302 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d2cc75-6e67-4430-b9c5-bbb96e536653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:25.790563 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:08:25.817554 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d2cc75-6e67-4430-b9c5-bbb96e536653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:08:25Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_e6dd2589-6441-4a5d-8b21-aca7be541bc9',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=58a73208-a97d-4148-854a-a7d6520bb60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa71bdd8c3394c1ca9fb656a112d9349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:08:26Z,use_quota=True,user_id='d0f84866b0f34e6da2d051b5b3583e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:25.825573 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cd8c98-94cf-43e7-8e07-be9722a9f25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:25.829873 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cd8c98-94cf-43e7-8e07-be9722a9f25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:25.836022 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8150d4-39a4-42ca-bf88-b78622265e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:25.841625 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8150d4-39a4-42ca-bf88-b78622265e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a73208-a97d-4148-854a-a7d6520bb60b', 'volume_name': 'volume-58a73208-a97d-4148-854a-a7d6520bb60b', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:25.848237 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1261414c-5469-4768-8024-70d425e43b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:25.853356 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1261414c-5469-4768-8024-70d425e43b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:25.860276 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e424e4f6-aa77-472d-abde-077f12c4d7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:25.861931 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Volume 58a73208-a97d-4148-854a-a7d6520bb60b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a73208-a97d-4148-854a-a7d6520bb60b', 'volume_size': 1} Mar 05 21:08:25.862529 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] creating volume 'volume-58a73208-a97d-4148-854a-a7d6520bb60b' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:08:25.867597 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:08:25.989457 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:08:25.990079 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:08:25.995762 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e424e4f6-aa77-472d-abde-077f12c4d7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a73208-a97d-4148-854a-a7d6520bb60b', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:26.005200 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b22ed9-e4aa-4865-8e22-524be50e3187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:26.030037 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Volume volume-58a73208-a97d-4148-854a-a7d6520bb60b (58a73208-a97d-4148-854a-a7d6520bb60b): created successfully Mar 05 21:08:26.037156 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b22ed9-e4aa-4865-8e22-524be50e3187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:26.043915 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Flow 'volume_create_manager' (015d7732-905b-498f-82fd-24617c64d043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:08:26.061216 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Created volume successfully. Mar 05 21:08:26.913028 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:08:27.916399 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.013s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:08:27.917870 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-58a73208-a97d-4148-854a-a7d6520bb60b', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '58a73208-a97d-4148-854a-a7d6520bb60b', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:08:27.941958 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Initialize volume connection completed successfully. Mar 05 21:08:33.196569 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6865bcce-b306-4432-976e-bc0276b6f0af tempest-GroupsV314Test-83073754 None] Group tempest-GroupsV314Test-Group-1444755491: creating Mar 05 21:08:33.241871 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6865bcce-b306-4432-976e-bc0276b6f0af tempest-GroupsV314Test-83073754 None] Group tempest-GroupsV314Test-Group-1444755491: created successfully Mar 05 21:08:33.255383 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6865bcce-b306-4432-976e-bc0276b6f0af tempest-GroupsV314Test-83073754 None] Create group completed successfully. Mar 05 21:08:34.792601 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Terminate volume connection completed successfully. Mar 05 21:08:34.816445 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-4f85034d-c0a9-4fc3-810e-5d4bc8b2b9ce tempest-TestVolumeBackupRestore-590870803 None] Remove volume export completed successfully. Mar 05 21:08:34.847252 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:08:34.854787 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:08:34.855396 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:08:34.895709 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Flow 'volume_create_manager' (888ded82-2ef7-4449-bfc3-8f581db59880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:08:34.902993 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf19ac78-1357-42f2-8913-82c1bf98fb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:34.919177 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:08:34.941051 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf19ac78-1357-42f2-8913-82c1bf98fb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-1371369403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=941ecea9-995b-48d0-bbde-dc743c398265,host='ncdv-master-1@ceph#ceph',id=0ffa6dfb-6422-4691-be74-3149b2772ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7ee8d654e64a2b8b3901f31ef0a765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:08:35Z,use_quota=True,user_id='cf769b3abd7c4691b4278e165bbd5a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c959576-9fd2-46ec-ad7d-5d44865cc7c6),volume_type_id=1c959576-9fd2-46ec-ad7d-5d44865cc7c6)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:34.948513 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02685766-abdd-43be-9ff3-a739631eaff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:34.953212 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02685766-abdd-43be-9ff3-a739631eaff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:34.959714 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f211042b-9c68-4470-b54a-424e17906e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:34.964585 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f211042b-9c68-4470-b54a-424e17906e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ffa6dfb-6422-4691-be74-3149b2772ec1', 'volume_name': 'volume-0ffa6dfb-6422-4691-be74-3149b2772ec1', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:34.970075 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa7c1f2-4a26-4051-846a-5455894ad4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:34.974620 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa7c1f2-4a26-4051-846a-5455894ad4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:34.979735 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42d8044-4627-4f80-82e2-9c41a60c2eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:34.981096 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Volume 0ffa6dfb-6422-4691-be74-3149b2772ec1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ffa6dfb-6422-4691-be74-3149b2772ec1', 'volume_size': 1} Mar 05 21:08:34.981668 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] creating volume 'volume-0ffa6dfb-6422-4691-be74-3149b2772ec1' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:08:34.983027 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:08:35.110963 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] extra_specs: {} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:08:35.111349 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] extra_specs: {} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:08:35.116305 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42d8044-4627-4f80-82e2-9c41a60c2eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ffa6dfb-6422-4691-be74-3149b2772ec1', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:35.127313 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57264bee-1c6b-4f53-8607-bee7b98eb7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:08:35.186637 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Volume volume-0ffa6dfb-6422-4691-be74-3149b2772ec1 (0ffa6dfb-6422-4691-be74-3149b2772ec1): created successfully Mar 05 21:08:35.192059 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57264bee-1c6b-4f53-8607-bee7b98eb7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:08:35.201345 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Flow 'volume_create_manager' (888ded82-2ef7-4449-bfc3-8f581db59880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:08:35.220566 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-e9dae03b-1d2f-49d3-948f-d79a699739ab tempest-GroupsV314Test-83073754 None] Created volume successfully. Mar 05 21:08:36.913266 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-eb093a6b-de58-41d2-9f6a-7d5f9145ef6e tempest-GroupsV314Test-83073754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:08:36.988951 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-eb093a6b-de58-41d2-9f6a-7d5f9145ef6e tempest-GroupsV314Test-83073754 None] creating snapshot='volume-debaf331-4a06-4ba4-ac46-7570e7609020.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 21:08:37.254149 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-eb093a6b-de58-41d2-9f6a-7d5f9145ef6e tempest-GroupsV314Test-83073754 None] cloning 'volume-0ffa6dfb-6422-4691-be74-3149b2772ec1@volume-debaf331-4a06-4ba4-ac46-7570e7609020.clone_snap' to 'volume-debaf331-4a06-4ba4-ac46-7570e7609020' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 21:08:37.371897 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-eb093a6b-de58-41d2-9f6a-7d5f9145ef6e tempest-GroupsV314Test-83073754 None] Volume volume-0ffa6dfb-6422-4691-be74-3149b2772ec1 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:08:37.383720 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-eb093a6b-de58-41d2-9f6a-7d5f9145ef6e tempest-GroupsV314Test-83073754 None] extra_specs: {} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:08:37.384018 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-eb093a6b-de58-41d2-9f6a-7d5f9145ef6e tempest-GroupsV314Test-83073754 None] extra_specs: {} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:08:37.416022 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-eb093a6b-de58-41d2-9f6a-7d5f9145ef6e tempest-GroupsV314Test-83073754 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 21:08:37.497793 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-eb093a6b-de58-41d2-9f6a-7d5f9145ef6e tempest-GroupsV314Test-83073754 None] Create group from source-group-941ecea9-995b-48d0-bbde-dc743c398265 completed successfully. Mar 05 21:08:38.555033 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b351a7c-c2ed-4778-8931-dfbccfbf8a52 tempest-GroupsV314Test-83073754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:08:38.671149 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b351a7c-c2ed-4778-8931-dfbccfbf8a52 tempest-GroupsV314Test-83073754 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:08:38.681797 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b351a7c-c2ed-4778-8931-dfbccfbf8a52 tempest-GroupsV314Test-83073754 None] deleting rbd volume volume-debaf331-4a06-4ba4-ac46-7570e7609020 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:08:39.102531 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b351a7c-c2ed-4778-8931-dfbccfbf8a52 tempest-GroupsV314Test-83073754 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 21:08:39.135012 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b351a7c-c2ed-4778-8931-dfbccfbf8a52 tempest-GroupsV314Test-83073754 None] Volume volume-0ffa6dfb-6422-4691-be74-3149b2772ec1 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:08:39.135726 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b351a7c-c2ed-4778-8931-dfbccfbf8a52 tempest-GroupsV314Test-83073754 None] deleting parent snapshot volume-debaf331-4a06-4ba4-ac46-7570e7609020.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 21:08:39.416914 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-8b351a7c-c2ed-4778-8931-dfbccfbf8a52 tempest-GroupsV314Test-83073754 None] Created reservations ['d417271f-5bbb-4651-9931-3fe06c952b5b'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:08:39.440026 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-8b351a7c-c2ed-4778-8931-dfbccfbf8a52 tempest-GroupsV314Test-83073754 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-306869074 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-306869074, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:08:39.440970 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-8b351a7c-c2ed-4778-8931-dfbccfbf8a52 tempest-GroupsV314Test-83073754 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-306869074 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-306869074, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:08:39.459354 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-8b351a7c-c2ed-4778-8931-dfbccfbf8a52 tempest-GroupsV314Test-83073754 None] Created reservations ['b774a749-3748-482a-8f01-3e2bc87af1c7', '21e259a5-a05d-4fe3-be97-8622bd38fb42', 'f018c00f-9986-47fa-aff7-eca7d348aebc', '00d05493-f6ab-4b46-907d-ea5daa6fc8b7'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:08:39.636271 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b351a7c-c2ed-4778-8931-dfbccfbf8a52 tempest-GroupsV314Test-83073754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:08:39.734614 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b351a7c-c2ed-4778-8931-dfbccfbf8a52 tempest-GroupsV314Test-83073754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:08:39.819515 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-8b351a7c-c2ed-4778-8931-dfbccfbf8a52 tempest-GroupsV314Test-83073754 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:08:39.825620 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8b351a7c-c2ed-4778-8931-dfbccfbf8a52 tempest-GroupsV314Test-83073754 None] Delete group completed successfully. Mar 05 21:08:40.127560 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b0054a4-b0a5-4628-88c8-3a98847685bb tempest-GroupsV314Test-83073754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:08:40.231246 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b0054a4-b0a5-4628-88c8-3a98847685bb tempest-GroupsV314Test-83073754 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:08:40.232026 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b0054a4-b0a5-4628-88c8-3a98847685bb tempest-GroupsV314Test-83073754 None] Volume volume-0ffa6dfb-6422-4691-be74-3149b2772ec1 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:08:40.249637 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b0054a4-b0a5-4628-88c8-3a98847685bb tempest-GroupsV314Test-83073754 None] deleting rbd volume volume-0ffa6dfb-6422-4691-be74-3149b2772ec1 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:08:40.819308 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-8b0054a4-b0a5-4628-88c8-3a98847685bb tempest-GroupsV314Test-83073754 None] Created reservations ['cf15e00d-59a4-49b7-a5be-109b112fb9d6'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:08:40.879065 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-8b0054a4-b0a5-4628-88c8-3a98847685bb tempest-GroupsV314Test-83073754 None] Created reservations ['029e6dc6-ecb2-4662-ba38-f9b7d58bb335', 'dc142417-fcda-4d15-91f7-0d6d428ad6dc', '22ffdb3a-788a-4525-a28d-4c214c8577ce', 'a3633d9e-bbdd-48c2-97ba-7ee96548c918'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:08:40.999585 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b0054a4-b0a5-4628-88c8-3a98847685bb tempest-GroupsV314Test-83073754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:08:41.074514 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b0054a4-b0a5-4628-88c8-3a98847685bb tempest-GroupsV314Test-83073754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:08:41.132513 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-8b0054a4-b0a5-4628-88c8-3a98847685bb tempest-GroupsV314Test-83073754 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:08:41.145504 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8b0054a4-b0a5-4628-88c8-3a98847685bb tempest-GroupsV314Test-83073754 None] Delete group completed successfully. Mar 05 21:08:43.592181 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-76455f84-c475-463a-8ab5-c527aff22749 req-be3e2a9f-d5b8-4e5a-bdce-baa5cf452367 tempest-TestVolumeBackupRestore-590870803 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:08:44.855619 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-76455f84-c475-463a-8ab5-c527aff22749 req-be3e2a9f-d5b8-4e5a-bdce-baa5cf452367 tempest-TestVolumeBackupRestore-590870803 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.263s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:08:44.857086 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-76455f84-c475-463a-8ab5-c527aff22749 req-be3e2a9f-d5b8-4e5a-bdce-baa5cf452367 tempest-TestVolumeBackupRestore-590870803 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-58a73208-a97d-4148-854a-a7d6520bb60b', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '58a73208-a97d-4148-854a-a7d6520bb60b', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:08:44.896321 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-76455f84-c475-463a-8ab5-c527aff22749 req-be3e2a9f-d5b8-4e5a-bdce-baa5cf452367 tempest-TestVolumeBackupRestore-590870803 None] Connection info returned from driver {'name': 'volumes/volume-58a73208-a97d-4148-854a-a7d6520bb60b', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '58a73208-a97d-4148-854a-a7d6520bb60b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ff8f41ee-907e-4b94-afb6-1111eee3f3e5'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:08:44.969725 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-76455f84-c475-463a-8ab5-c527aff22749 req-be3e2a9f-d5b8-4e5a-bdce-baa5cf452367 tempest-TestVolumeBackupRestore-590870803 None] attachment_update completed successfully. Mar 05 21:08:45.613594 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:08:45.615432 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:08:45.696131 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:08:45.774729 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:09:10.859432 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-c7215f89-2998-40f3-babd-b3a62303910c req-0fd87399-542d-43f5-a357-e0c4bb879f64 tempest-TaggedBootDevicesTest_v242-1271501382 None] Terminate volume connection completed successfully. Mar 05 21:09:10.860909 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-c7215f89-2998-40f3-babd-b3a62303910c req-0fd87399-542d-43f5-a357-e0c4bb879f64 tempest-TaggedBootDevicesTest_v242-1271501382 None] Deleting attachment ee075811-cfd8-4c97-8d19-4d16f3867ac8. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:09:11.126907 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-c7215f89-2998-40f3-babd-b3a62303910c req-32535d9d-a94d-4e00-b350-03f16af0fa18 tempest-TaggedBootDevicesTest_v242-1271501382 None] Terminate volume connection completed successfully. Mar 05 21:09:11.126907 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-c7215f89-2998-40f3-babd-b3a62303910c req-32535d9d-a94d-4e00-b350-03f16af0fa18 tempest-TaggedBootDevicesTest_v242-1271501382 None] Deleting attachment 1c0b25e7-2a84-42a7-9c8f-e4bc0cc7ab4e. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:09:11.397366 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-c7215f89-2998-40f3-babd-b3a62303910c req-dc9d200a-1ba1-407c-8779-a7fae9b314c8 tempest-TaggedBootDevicesTest_v242-1271501382 None] Terminate volume connection completed successfully. Mar 05 21:09:11.399285 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-c7215f89-2998-40f3-babd-b3a62303910c req-dc9d200a-1ba1-407c-8779-a7fae9b314c8 tempest-TaggedBootDevicesTest_v242-1271501382 None] Deleting attachment fe1ebf45-0c40-42b6-8ae6-8a0dbe897046. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:09:13.401966 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:09:13.409862 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:09:13.410547 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:09:13.465217 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Flow 'volume_create_manager' (9e789f8b-e9e1-4b31-a76e-0347a7eac206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:09:13.478660 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73cae08-8776-493b-97d1-31cdfcf29bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:13.493576 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:09:13.522892 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73cae08-8776-493b-97d1-31cdfcf29bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1094693946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4952f95c-11ee-434f-b64f-20edc88f3765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ed6e0ab11f49978fb5a8a38d4dfc5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:09:13Z,use_quota=True,user_id='73060cd697164413b1cf3d33899c7dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f44aa6e3-b829-41e5-847a-49bc34680ee0),volume_type_id=f44aa6e3-b829-41e5-847a-49bc34680ee0)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:13.535326 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4a95c4-0c54-4d68-83cb-dac539621d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:13.541724 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4a95c4-0c54-4d68-83cb-dac539621d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:13.555576 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86043545-f7de-40fd-aecf-88a7f9878622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:13.567662 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86043545-f7de-40fd-aecf-88a7f9878622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4952f95c-11ee-434f-b64f-20edc88f3765', 'volume_name': 'volume-4952f95c-11ee-434f-b64f-20edc88f3765', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:13.579389 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c4785b-a7b8-417b-b961-791de2b76c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:13.584959 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c4785b-a7b8-417b-b961-791de2b76c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:13.591368 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32b973b-5231-4fc0-b880-a31d0c295a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:13.592876 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Volume 4952f95c-11ee-434f-b64f-20edc88f3765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4952f95c-11ee-434f-b64f-20edc88f3765', 'volume_size': 1} Mar 05 21:09:13.593434 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] creating volume 'volume-4952f95c-11ee-434f-b64f-20edc88f3765' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:09:13.598781 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:13.755421 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:09:13.755835 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:09:13.759855 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32b973b-5231-4fc0-b880-a31d0c295a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4952f95c-11ee-434f-b64f-20edc88f3765', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:13.772316 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8421dbc4-5343-4168-850d-bdd4cb4ea7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:13.800168 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Volume volume-4952f95c-11ee-434f-b64f-20edc88f3765 (4952f95c-11ee-434f-b64f-20edc88f3765): created successfully Mar 05 21:09:13.804711 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8421dbc4-5343-4168-850d-bdd4cb4ea7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:13.826548 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Flow 'volume_create_manager' (9e789f8b-e9e1-4b31-a76e-0347a7eac206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:09:13.852455 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-e297344b-ee3f-4e51-9ff6-11110388403e tempest-VolumeTypesTest-1998249138 None] Created volume successfully. Mar 05 21:09:14.914944 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c2029d53-8074-46f8-bdd7-1a8b2bd90f13 tempest-VolumeTypesTest-1998249138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:14.976151 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c2029d53-8074-46f8-bdd7-1a8b2bd90f13 tempest-VolumeTypesTest-1998249138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:15.045553 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-c2029d53-8074-46f8-bdd7-1a8b2bd90f13 tempest-VolumeTypesTest-1998249138 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:09:15.053607 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c2029d53-8074-46f8-bdd7-1a8b2bd90f13 tempest-VolumeTypesTest-1998249138 None] Retype volume completed successfully. Mar 05 21:09:17.505798 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-d676c8f1-41ec-463d-8e4d-d72a51f13006 tempest-VolumeTypesTest-1998249138 None] Lock "b'cinder-4952f95c-11ee-434f-b64f-20edc88f3765-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:09:17.586282 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d676c8f1-41ec-463d-8e4d-d72a51f13006 tempest-VolumeTypesTest-1998249138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:17.663334 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d676c8f1-41ec-463d-8e4d-d72a51f13006 tempest-VolumeTypesTest-1998249138 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:09:17.663981 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d676c8f1-41ec-463d-8e4d-d72a51f13006 tempest-VolumeTypesTest-1998249138 None] Volume volume-4952f95c-11ee-434f-b64f-20edc88f3765 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:09:17.674473 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d676c8f1-41ec-463d-8e4d-d72a51f13006 tempest-VolumeTypesTest-1998249138 None] deleting rbd volume volume-4952f95c-11ee-434f-b64f-20edc88f3765 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:09:18.052995 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-d676c8f1-41ec-463d-8e4d-d72a51f13006 tempest-VolumeTypesTest-1998249138 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-292187579 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-292187579, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:09:18.053952 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-d676c8f1-41ec-463d-8e4d-d72a51f13006 tempest-VolumeTypesTest-1998249138 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-292187579 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-292187579, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:09:18.080653 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-d676c8f1-41ec-463d-8e4d-d72a51f13006 tempest-VolumeTypesTest-1998249138 None] Created reservations ['df08929b-4e8d-4499-a45f-72fff2f0de87', '20a964d7-812c-426d-a33d-7165e4fa8112', '99ee4087-99e1-40ae-aa22-0f10039a6ffd', '7d374625-26a3-4faf-adfa-07fffc63b798'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:09:18.142095 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d676c8f1-41ec-463d-8e4d-d72a51f13006 tempest-VolumeTypesTest-1998249138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:18.209524 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d676c8f1-41ec-463d-8e4d-d72a51f13006 tempest-VolumeTypesTest-1998249138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:18.279182 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-d676c8f1-41ec-463d-8e4d-d72a51f13006 tempest-VolumeTypesTest-1998249138 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:09:18.284954 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d676c8f1-41ec-463d-8e4d-d72a51f13006 tempest-VolumeTypesTest-1998249138 None] Deleted volume successfully. Mar 05 21:09:18.308195 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-d676c8f1-41ec-463d-8e4d-d72a51f13006 tempest-VolumeTypesTest-1998249138 None] Lock "b'cinder-4952f95c-11ee-434f-b64f-20edc88f3765-delete_volume'" released by "delete_volume" :: held 0.802s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:09:27.293825 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-6439eba6-28a3-4c5b-aa6a-5c09eb6db4ac tempest-TaggedBootDevicesTest_v242-1271501382 None] Lock "b'cinder-00215bb7-a3ee-4481-8b60-e90a6dd81c02-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:09:27.396647 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6439eba6-28a3-4c5b-aa6a-5c09eb6db4ac tempest-TaggedBootDevicesTest_v242-1271501382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:27.521237 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6439eba6-28a3-4c5b-aa6a-5c09eb6db4ac tempest-TaggedBootDevicesTest_v242-1271501382 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:09:27.521962 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6439eba6-28a3-4c5b-aa6a-5c09eb6db4ac tempest-TaggedBootDevicesTest_v242-1271501382 None] Volume volume-00215bb7-a3ee-4481-8b60-e90a6dd81c02 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:09:27.542229 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6439eba6-28a3-4c5b-aa6a-5c09eb6db4ac tempest-TaggedBootDevicesTest_v242-1271501382 None] deleting rbd volume volume-00215bb7-a3ee-4481-8b60-e90a6dd81c02 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:09:28.129491 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-6439eba6-28a3-4c5b-aa6a-5c09eb6db4ac tempest-TaggedBootDevicesTest_v242-1271501382 None] Created reservations ['e3041a79-f644-4f63-8a5f-fd1fb2221447', '6e453c16-b5f4-489c-8c30-e6e682eeb7eb', 'abacbeed-5e7d-4e19-bb84-ea6000fbb022', 'f63af629-39b8-4813-a955-19d950148012'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:09:28.261108 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6439eba6-28a3-4c5b-aa6a-5c09eb6db4ac tempest-TaggedBootDevicesTest_v242-1271501382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:28.350363 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6439eba6-28a3-4c5b-aa6a-5c09eb6db4ac tempest-TaggedBootDevicesTest_v242-1271501382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:28.440115 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-6439eba6-28a3-4c5b-aa6a-5c09eb6db4ac tempest-TaggedBootDevicesTest_v242-1271501382 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:09:28.445836 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6439eba6-28a3-4c5b-aa6a-5c09eb6db4ac tempest-TaggedBootDevicesTest_v242-1271501382 None] Deleted volume successfully. Mar 05 21:09:28.470399 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-6439eba6-28a3-4c5b-aa6a-5c09eb6db4ac tempest-TaggedBootDevicesTest_v242-1271501382 None] Lock "b'cinder-00215bb7-a3ee-4481-8b60-e90a6dd81c02-delete_volume'" released by "delete_volume" :: held 1.176s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:09:28.702756 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:09:28.721224 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:09:28.722043 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:09:28.786124 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Flow 'volume_create_manager' (9b1855b7-fd4c-4215-8065-3a27ede0baf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:09:28.806880 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02287e2-7676-4c75-b9d5-5028be587785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:28.831976 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:09:28.844099 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ac553026-d437-4867-9843-66c07441d1b9 tempest-TaggedBootDevicesTest_v242-1271501382 None] Lock "b'cinder-0d7be807-5817-4f1d-a429-8b9efd75b15c-delete_volume'" acquired by "delete_volume" :: waited 0.148s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:09:28.865781 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02287e2-7676-4c75-b9d5-5028be587785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1971088557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7415431b-6312-4edb-9a69-a3a621dd7ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4d92586d654a0ab7a99a2f8764bf96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:09:29Z,use_quota=True,user_id='47d19c4547d842da92fb1d989788c632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:28.878841 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5773dc02-55bb-487c-9095-2c74573a0c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:28.885442 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5773dc02-55bb-487c-9095-2c74573a0c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:28.899470 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3ec26d-23aa-435c-902e-33cbdb3f5393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:28.904064 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3ec26d-23aa-435c-902e-33cbdb3f5393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7415431b-6312-4edb-9a69-a3a621dd7ad5', 'volume_name': 'volume-7415431b-6312-4edb-9a69-a3a621dd7ad5', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:28.910589 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0397af5b-2f89-4ad3-a1e7-0bcb270af3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:28.923175 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0397af5b-2f89-4ad3-a1e7-0bcb270af3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:28.930198 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9333f8-6e52-47a6-98b8-9b65908dcbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:28.931729 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Volume 7415431b-6312-4edb-9a69-a3a621dd7ad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7415431b-6312-4edb-9a69-a3a621dd7ad5', 'volume_size': 1} Mar 05 21:09:28.932318 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] creating volume 'volume-7415431b-6312-4edb-9a69-a3a621dd7ad5' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:09:28.933596 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:29.030556 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ac553026-d437-4867-9843-66c07441d1b9 tempest-TaggedBootDevicesTest_v242-1271501382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:29.134076 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ac553026-d437-4867-9843-66c07441d1b9 tempest-TaggedBootDevicesTest_v242-1271501382 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:09:29.134712 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ac553026-d437-4867-9843-66c07441d1b9 tempest-TaggedBootDevicesTest_v242-1271501382 None] Volume volume-0d7be807-5817-4f1d-a429-8b9efd75b15c is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:09:29.158954 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ac553026-d437-4867-9843-66c07441d1b9 tempest-TaggedBootDevicesTest_v242-1271501382 None] deleting rbd volume volume-0d7be807-5817-4f1d-a429-8b9efd75b15c {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:09:29.168022 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:09:29.168661 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:09:29.174270 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9333f8-6e52-47a6-98b8-9b65908dcbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7415431b-6312-4edb-9a69-a3a621dd7ad5', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:29.204072 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112d511e-ffbc-420b-a7a5-3bdd1684b9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:29.264908 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Volume volume-7415431b-6312-4edb-9a69-a3a621dd7ad5 (7415431b-6312-4edb-9a69-a3a621dd7ad5): created successfully Mar 05 21:09:29.287048 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112d511e-ffbc-420b-a7a5-3bdd1684b9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:29.307884 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Flow 'volume_create_manager' (9b1855b7-fd4c-4215-8065-3a27ede0baf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:09:29.343101 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-be97b670-a43e-4467-902a-efa323592a88 tempest-VolumesBackupsAdminTest-1154175086 None] Created volume successfully. Mar 05 21:09:29.674497 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-ac553026-d437-4867-9843-66c07441d1b9 tempest-TaggedBootDevicesTest_v242-1271501382 None] Created reservations ['0511b890-3e35-4148-8cd8-9ae523f37557', '6b831ac9-ea5d-4371-a4d2-ff764176e699', '5733ddeb-8c1d-4c1f-a40a-163b81494d00', '17cd850d-7849-442a-81e9-8208a69f230f'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:09:29.800520 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ac553026-d437-4867-9843-66c07441d1b9 tempest-TaggedBootDevicesTest_v242-1271501382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:29.877447 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ac553026-d437-4867-9843-66c07441d1b9 tempest-TaggedBootDevicesTest_v242-1271501382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:29.935432 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-ac553026-d437-4867-9843-66c07441d1b9 tempest-TaggedBootDevicesTest_v242-1271501382 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:09:29.940521 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ac553026-d437-4867-9843-66c07441d1b9 tempest-TaggedBootDevicesTest_v242-1271501382 None] Deleted volume successfully. Mar 05 21:09:29.961478 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ac553026-d437-4867-9843-66c07441d1b9 tempest-TaggedBootDevicesTest_v242-1271501382 None] Lock "b'cinder-0d7be807-5817-4f1d-a429-8b9efd75b15c-delete_volume'" released by "delete_volume" :: held 1.117s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:09:29.996244 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-512422be-eefc-4dc1-9b56-c9a72b9586d8 tempest-TaggedBootDevicesTest_v242-1271501382 None] Lock "b'cinder-c4889834-9564-427c-924e-8df6f5bc7738-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:09:30.061927 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-512422be-eefc-4dc1-9b56-c9a72b9586d8 tempest-TaggedBootDevicesTest_v242-1271501382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:30.162594 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-512422be-eefc-4dc1-9b56-c9a72b9586d8 tempest-TaggedBootDevicesTest_v242-1271501382 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:09:30.174073 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-512422be-eefc-4dc1-9b56-c9a72b9586d8 tempest-TaggedBootDevicesTest_v242-1271501382 None] deleting rbd volume volume-c4889834-9564-427c-924e-8df6f5bc7738 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:09:30.199570 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-338271a6-50fa-4ce9-ab70-39e1703ebf7d tempest-VolumesBackupsAdminTest-1154175086 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-05T21:09:29Z,data_timestamp=2022-03-05T21:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1008800290',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=abb3d0ba-0786-4b6f-90fa-1ca659bb2e19,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='0f4d92586d654a0ab7a99a2f8764bf96',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='47d19c4547d842da92fb1d989788c632',volume_id=7415431b-6312-4edb-9a69-a3a621dd7ad5) Mar 05 21:09:30.201598 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.backup.rpcapi [None req-338271a6-50fa-4ce9-ab70-39e1703ebf7d tempest-VolumesBackupsAdminTest-1154175086 None] continue_backup in rpcapi backup_id abb3d0ba-0786-4b6f-90fa-1ca659bb2e19 {{(pid=134747) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 05 21:09:30.591063 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-338271a6-50fa-4ce9-ab70-39e1703ebf7d tempest-VolumesBackupsAdminTest-1154175086 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:09:30.637042 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-512422be-eefc-4dc1-9b56-c9a72b9586d8 tempest-TaggedBootDevicesTest_v242-1271501382 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 21:09:30.686204 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-512422be-eefc-4dc1-9b56-c9a72b9586d8 tempest-TaggedBootDevicesTest_v242-1271501382 None] deleting parent snapshot volume-c4889834-9564-427c-924e-8df6f5bc7738.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 21:09:31.383633 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-512422be-eefc-4dc1-9b56-c9a72b9586d8 tempest-TaggedBootDevicesTest_v242-1271501382 None] Created reservations ['b6327c24-637b-4173-94c0-e8e2e40307e7', 'bd6823c3-0754-42ac-a99e-68fa9a563ba0', '411a6358-5635-4841-aae2-80a8442ef2ae', '5f4b9667-a479-442f-a2a4-d865180d71da'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:09:31.499194 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-512422be-eefc-4dc1-9b56-c9a72b9586d8 tempest-TaggedBootDevicesTest_v242-1271501382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:31.584629 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-512422be-eefc-4dc1-9b56-c9a72b9586d8 tempest-TaggedBootDevicesTest_v242-1271501382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:31.652523 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-512422be-eefc-4dc1-9b56-c9a72b9586d8 tempest-TaggedBootDevicesTest_v242-1271501382 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:09:31.666858 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-512422be-eefc-4dc1-9b56-c9a72b9586d8 tempest-TaggedBootDevicesTest_v242-1271501382 None] Deleted volume successfully. Mar 05 21:09:31.683014 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-512422be-eefc-4dc1-9b56-c9a72b9586d8 tempest-TaggedBootDevicesTest_v242-1271501382 None] Lock "b'cinder-c4889834-9564-427c-924e-8df6f5bc7738-delete_volume'" released by "delete_volume" :: held 1.687s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:09:32.175442 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-338271a6-50fa-4ce9-ab70-39e1703ebf7d tempest-VolumesBackupsAdminTest-1154175086 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.584s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:09:32.176982 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-338271a6-50fa-4ce9-ab70-39e1703ebf7d tempest-VolumesBackupsAdminTest-1154175086 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7415431b-6312-4edb-9a69-a3a621dd7ad5', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '7415431b-6312-4edb-9a69-a3a621dd7ad5', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:09:32.204586 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-338271a6-50fa-4ce9-ab70-39e1703ebf7d tempest-VolumesBackupsAdminTest-1154175086 None] Initialize volume connection completed successfully. Mar 05 21:09:34.704747 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-338271a6-50fa-4ce9-ab70-39e1703ebf7d tempest-VolumesBackupsAdminTest-1154175086 None] Terminate volume connection completed successfully. Mar 05 21:09:34.752688 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-338271a6-50fa-4ce9-ab70-39e1703ebf7d tempest-VolumesBackupsAdminTest-1154175086 None] Remove volume export completed successfully. Mar 05 21:09:38.152544 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:09:38.160515 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:09:38.161276 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:09:38.186608 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Flow 'volume_create_manager' (8f3d54d1-7d9e-42e9-9de0-4b94b7e41ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:09:38.196055 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ce2e48-6c3d-4017-8704-223efa8af835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:38.206180 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:09:38.227221 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ce2e48-6c3d-4017-8704-223efa8af835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:09:38Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_abb3d0ba-0786-4b6f-90fa-1ca659bb2e19',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=010285b6-3707-4982-bf57-a118b6f26b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4d92586d654a0ab7a99a2f8764bf96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:09:38Z,use_quota=True,user_id='47d19c4547d842da92fb1d989788c632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:38.234795 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce99e49-35dc-4271-9579-ef348efdaa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:38.240935 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce99e49-35dc-4271-9579-ef348efdaa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:38.246972 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d273c103-3ce2-40d1-a2af-1ee886952369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:38.252094 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d273c103-3ce2-40d1-a2af-1ee886952369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010285b6-3707-4982-bf57-a118b6f26b0c', 'volume_name': 'volume-010285b6-3707-4982-bf57-a118b6f26b0c', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:38.259630 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410ee1ac-48ac-43c6-ac9a-b498e5c68281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:38.264285 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410ee1ac-48ac-43c6-ac9a-b498e5c68281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:38.271004 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd2fe57-05f9-4f40-96fd-3654a41bbd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:38.272382 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Volume 010285b6-3707-4982-bf57-a118b6f26b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010285b6-3707-4982-bf57-a118b6f26b0c', 'volume_size': 1} Mar 05 21:09:38.272940 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] creating volume 'volume-010285b6-3707-4982-bf57-a118b6f26b0c' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:09:38.274198 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:38.413202 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:09:38.414282 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:09:38.423523 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd2fe57-05f9-4f40-96fd-3654a41bbd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010285b6-3707-4982-bf57-a118b6f26b0c', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:38.431725 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33e9ebc-ca69-4061-b30c-566980a934ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:38.446421 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Volume volume-010285b6-3707-4982-bf57-a118b6f26b0c (010285b6-3707-4982-bf57-a118b6f26b0c): created successfully Mar 05 21:09:38.453960 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33e9ebc-ca69-4061-b30c-566980a934ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:38.466984 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Flow 'volume_create_manager' (8f3d54d1-7d9e-42e9-9de0-4b94b7e41ba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:09:38.481847 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Created volume successfully. Mar 05 21:09:39.341397 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:09:40.226060 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.884s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:09:40.226943 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-010285b6-3707-4982-bf57-a118b6f26b0c', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '010285b6-3707-4982-bf57-a118b6f26b0c', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:09:40.247980 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Initialize volume connection completed successfully. Mar 05 21:09:41.579103 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Terminate volume connection completed successfully. Mar 05 21:09:41.622255 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8b06cde2-c7ab-4397-b5bc-dedda5124ce8 tempest-VolumesBackupsAdminTest-1154175086 None] Remove volume export completed successfully. Mar 05 21:09:42.542330 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-27053a4a-1ba4-4c26-8b5a-726ef920a001 tempest-VolumesBackupsAdminTest-1154175086 None] Lock "b'cinder-010285b6-3707-4982-bf57-a118b6f26b0c-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:09:42.645028 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-27053a4a-1ba4-4c26-8b5a-726ef920a001 tempest-VolumesBackupsAdminTest-1154175086 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:43.329811 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-27053a4a-1ba4-4c26-8b5a-726ef920a001 tempest-VolumesBackupsAdminTest-1154175086 None] Volume volume-010285b6-3707-4982-bf57-a118b6f26b0c is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:09:43.404380 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-27053a4a-1ba4-4c26-8b5a-726ef920a001 tempest-VolumesBackupsAdminTest-1154175086 None] deleting rbd volume volume-010285b6-3707-4982-bf57-a118b6f26b0c {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:09:44.311269 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-27053a4a-1ba4-4c26-8b5a-726ef920a001 tempest-VolumesBackupsAdminTest-1154175086 None] Created reservations ['269b492b-8f60-44fb-86ba-a5d73d204adc', '9517ffd9-4db5-4344-a3aa-af443cf6a224', '7b641958-1c80-4c95-b6e0-771eb37c38e3', '211fdedc-f804-45c0-87ac-3719ca5abc34'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:09:44.398241 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-27053a4a-1ba4-4c26-8b5a-726ef920a001 tempest-VolumesBackupsAdminTest-1154175086 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:44.482119 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-27053a4a-1ba4-4c26-8b5a-726ef920a001 tempest-VolumesBackupsAdminTest-1154175086 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:44.545080 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-27053a4a-1ba4-4c26-8b5a-726ef920a001 tempest-VolumesBackupsAdminTest-1154175086 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:09:44.562058 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-27053a4a-1ba4-4c26-8b5a-726ef920a001 tempest-VolumesBackupsAdminTest-1154175086 None] Deleted volume successfully. Mar 05 21:09:44.589240 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-27053a4a-1ba4-4c26-8b5a-726ef920a001 tempest-VolumesBackupsAdminTest-1154175086 None] Lock "b'cinder-010285b6-3707-4982-bf57-a118b6f26b0c-delete_volume'" released by "delete_volume" :: held 2.047s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:09:45.611148 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:09:45.612666 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:45.676894 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:45.744194 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:09:46.446304 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:09:46.457461 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:09:46.459512 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:09:46.487571 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Flow 'volume_create_manager' (f1e43da0-38cf-4439-ad98-6824560c1872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:09:46.495418 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190a2041-4e72-4f59-a898-506c2ad2dae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:46.504783 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:09:46.521922 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190a2041-4e72-4f59-a898-506c2ad2dae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1070628216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d62e8383-bc33-4341-9525-48f0aef7a585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4d92586d654a0ab7a99a2f8764bf96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:09:46Z,use_quota=True,user_id='47d19c4547d842da92fb1d989788c632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:46.528512 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ef79a0-57f3-46bb-a115-b2b482763cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:46.534533 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ef79a0-57f3-46bb-a115-b2b482763cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:46.540879 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfbf2f4-8492-4bab-8b79-fab29aceca95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:46.545990 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfbf2f4-8492-4bab-8b79-fab29aceca95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd62e8383-bc33-4341-9525-48f0aef7a585', 'volume_name': 'volume-d62e8383-bc33-4341-9525-48f0aef7a585', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:46.552086 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ce2f69-41b6-4c83-bf32-ce3281a1640e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:46.556723 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ce2f69-41b6-4c83-bf32-ce3281a1640e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:46.562503 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4967db2-7887-497c-9512-551b752319b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:46.563803 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Volume d62e8383-bc33-4341-9525-48f0aef7a585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d62e8383-bc33-4341-9525-48f0aef7a585', 'volume_size': 1} Mar 05 21:09:46.564457 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] creating volume 'volume-d62e8383-bc33-4341-9525-48f0aef7a585' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:09:46.565589 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:46.653272 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:09:46.653904 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:09:46.658346 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4967db2-7887-497c-9512-551b752319b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62e8383-bc33-4341-9525-48f0aef7a585', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:46.663277 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40340a83-f267-4118-947b-118539df2382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:09:46.677906 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Volume volume-d62e8383-bc33-4341-9525-48f0aef7a585 (d62e8383-bc33-4341-9525-48f0aef7a585): created successfully Mar 05 21:09:46.683655 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40340a83-f267-4118-947b-118539df2382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:09:46.693262 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Flow 'volume_create_manager' (f1e43da0-38cf-4439-ad98-6824560c1872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:09:46.709423 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b69d095d-fedb-47cd-b0bb-41ec3e1877c6 tempest-VolumesBackupsAdminTest-1154175086 None] Created volume successfully. Mar 05 21:09:47.862423 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-914b4cc8-619e-4e2c-bf74-a6438ec87881 tempest-VolumesBackupsAdminTest-1154175086 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-05T21:09:47Z,data_timestamp=2022-03-05T21:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-656813056',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=2a50b36e-fb78-4798-a0f2-627dd997003e,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='0f4d92586d654a0ab7a99a2f8764bf96',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='47d19c4547d842da92fb1d989788c632',volume_id=d62e8383-bc33-4341-9525-48f0aef7a585) Mar 05 21:09:47.869955 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.backup.rpcapi [None req-914b4cc8-619e-4e2c-bf74-a6438ec87881 tempest-VolumesBackupsAdminTest-1154175086 None] continue_backup in rpcapi backup_id 2a50b36e-fb78-4798-a0f2-627dd997003e {{(pid=134747) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 05 21:09:48.278416 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-914b4cc8-619e-4e2c-bf74-a6438ec87881 tempest-VolumesBackupsAdminTest-1154175086 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:09:49.278999 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-914b4cc8-619e-4e2c-bf74-a6438ec87881 tempest-VolumesBackupsAdminTest-1154175086 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.000s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:09:49.282582 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-914b4cc8-619e-4e2c-bf74-a6438ec87881 tempest-VolumesBackupsAdminTest-1154175086 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d62e8383-bc33-4341-9525-48f0aef7a585', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'd62e8383-bc33-4341-9525-48f0aef7a585', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:09:49.302712 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-914b4cc8-619e-4e2c-bf74-a6438ec87881 tempest-VolumesBackupsAdminTest-1154175086 None] Initialize volume connection completed successfully. Mar 05 21:09:51.247484 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-914b4cc8-619e-4e2c-bf74-a6438ec87881 tempest-VolumesBackupsAdminTest-1154175086 None] Terminate volume connection completed successfully. Mar 05 21:09:51.270636 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-914b4cc8-619e-4e2c-bf74-a6438ec87881 tempest-VolumesBackupsAdminTest-1154175086 None] Remove volume export completed successfully. Mar 05 21:09:55.807323 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-86aadc57-14ad-4f11-86be-7cf7fa91166a tempest-VolumesBackupsAdminTest-1154175086 None] Lock "b'cinder-d62e8383-bc33-4341-9525-48f0aef7a585-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:09:55.879413 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-86aadc57-14ad-4f11-86be-7cf7fa91166a tempest-VolumesBackupsAdminTest-1154175086 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:56.130249 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-86aadc57-14ad-4f11-86be-7cf7fa91166a tempest-VolumesBackupsAdminTest-1154175086 None] Volume volume-d62e8383-bc33-4341-9525-48f0aef7a585 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:09:56.178743 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-86aadc57-14ad-4f11-86be-7cf7fa91166a tempest-VolumesBackupsAdminTest-1154175086 None] deleting rbd volume volume-d62e8383-bc33-4341-9525-48f0aef7a585 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:09:56.830611 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-86aadc57-14ad-4f11-86be-7cf7fa91166a tempest-VolumesBackupsAdminTest-1154175086 None] Created reservations ['21bee9f9-aa6d-41a6-aeb3-cb65dbefd892', 'e842e4ba-4730-453b-982e-680af0febb06', '088463f6-4745-43eb-bc75-3ae0a32fccf4', 'a6431165-e6e4-47d6-afd2-8e6db801780b'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:09:56.966172 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-86aadc57-14ad-4f11-86be-7cf7fa91166a tempest-VolumesBackupsAdminTest-1154175086 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:57.040079 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-86aadc57-14ad-4f11-86be-7cf7fa91166a tempest-VolumesBackupsAdminTest-1154175086 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:57.103617 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-86aadc57-14ad-4f11-86be-7cf7fa91166a tempest-VolumesBackupsAdminTest-1154175086 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:09:57.126045 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-86aadc57-14ad-4f11-86be-7cf7fa91166a tempest-VolumesBackupsAdminTest-1154175086 None] Deleted volume successfully. Mar 05 21:09:57.160482 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-206629ed-d649-4119-87ba-00f5c80fa8b8 tempest-VolumesBackupsAdminTest-1154175086 None] Lock "b'cinder-7415431b-6312-4edb-9a69-a3a621dd7ad5-delete_volume'" acquired by "delete_volume" :: waited 0.051s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:09:57.189186 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-86aadc57-14ad-4f11-86be-7cf7fa91166a tempest-VolumesBackupsAdminTest-1154175086 None] Lock "b'cinder-d62e8383-bc33-4341-9525-48f0aef7a585-delete_volume'" released by "delete_volume" :: held 1.381s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:09:57.269998 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-206629ed-d649-4119-87ba-00f5c80fa8b8 tempest-VolumesBackupsAdminTest-1154175086 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:58.228433 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-206629ed-d649-4119-87ba-00f5c80fa8b8 tempest-VolumesBackupsAdminTest-1154175086 None] Volume volume-7415431b-6312-4edb-9a69-a3a621dd7ad5 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:09:58.277371 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-206629ed-d649-4119-87ba-00f5c80fa8b8 tempest-VolumesBackupsAdminTest-1154175086 None] deleting rbd volume volume-7415431b-6312-4edb-9a69-a3a621dd7ad5 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:09:58.953756 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-206629ed-d649-4119-87ba-00f5c80fa8b8 tempest-VolumesBackupsAdminTest-1154175086 None] Created reservations ['41c2cb3c-39ae-491a-afd7-b6c18471a23c', '1db6ff6e-18f0-468f-8897-ce921fe5ffd4', '51c51e9b-859b-40db-ac8e-88bbd35532f3', '2820d91b-7835-4863-8edb-353e437fc127'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:09:59.014035 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-206629ed-d649-4119-87ba-00f5c80fa8b8 tempest-VolumesBackupsAdminTest-1154175086 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:59.102199 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-206629ed-d649-4119-87ba-00f5c80fa8b8 tempest-VolumesBackupsAdminTest-1154175086 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:09:59.176514 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-206629ed-d649-4119-87ba-00f5c80fa8b8 tempest-VolumesBackupsAdminTest-1154175086 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:09:59.184852 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-206629ed-d649-4119-87ba-00f5c80fa8b8 tempest-VolumesBackupsAdminTest-1154175086 None] Deleted volume successfully. Mar 05 21:09:59.211013 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-206629ed-d649-4119-87ba-00f5c80fa8b8 tempest-VolumesBackupsAdminTest-1154175086 None] Lock "b'cinder-7415431b-6312-4edb-9a69-a3a621dd7ad5-delete_volume'" released by "delete_volume" :: held 2.051s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:10:07.532881 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:10:07.538604 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:10:07.539177 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:10:07.566054 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Flow 'volume_create_manager' (2ad93d48-6091-4802-8297-9f3e29ee3ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:10:07.574320 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702dcae5-f3de-405d-a297-0fa5940501d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:10:07.582606 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:10:07.614075 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702dcae5-f3de-405d-a297-0fa5940501d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-562314161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=17eda1c2-97cb-4c19-8837-b5cf9dcba614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa4a03f39214b9bbffa3e84961b6148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:10:07Z,use_quota=True,user_id='2727b6a9d5454249abbf945cf50beb1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:10:07.630827 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cddea0-ba2e-4904-badf-342f51785e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:10:07.637128 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cddea0-ba2e-4904-badf-342f51785e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:10:07.646257 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27ba1cc-7f64-42dc-a056-812ab888ea68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:10:07.656563 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27ba1cc-7f64-42dc-a056-812ab888ea68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17eda1c2-97cb-4c19-8837-b5cf9dcba614', 'volume_name': 'volume-17eda1c2-97cb-4c19-8837-b5cf9dcba614', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:10:07.687870 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c022aa5-9e6c-4d5c-86e5-43308b24fe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:10:07.696247 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c022aa5-9e6c-4d5c-86e5-43308b24fe32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:10:07.721823 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f541c87f-409a-44aa-b5bc-19a2621efc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:10:07.726744 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Volume 17eda1c2-97cb-4c19-8837-b5cf9dcba614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17eda1c2-97cb-4c19-8837-b5cf9dcba614', 'volume_size': 1} Mar 05 21:10:07.727520 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] creating volume 'volume-17eda1c2-97cb-4c19-8837-b5cf9dcba614' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:10:07.732268 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:07.913849 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:10:07.915052 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:10:07.919915 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f541c87f-409a-44aa-b5bc-19a2621efc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17eda1c2-97cb-4c19-8837-b5cf9dcba614', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:10:07.925856 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c24323-2e46-48fa-9d0e-4f21232918d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:10:07.959097 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Volume volume-17eda1c2-97cb-4c19-8837-b5cf9dcba614 (17eda1c2-97cb-4c19-8837-b5cf9dcba614): created successfully Mar 05 21:10:07.970040 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c24323-2e46-48fa-9d0e-4f21232918d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:10:07.989516 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Flow 'volume_create_manager' (2ad93d48-6091-4802-8297-9f3e29ee3ae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:10:08.026815 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-2eca08ee-177d-45ae-a0c8-8c89aaf61a20 tempest-AbsoluteLimitsTests-824730978 None] Created volume successfully. Mar 05 21:10:08.809697 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-5a126ceb-a8f7-4b81-a5ff-92578f122d53 tempest-AbsoluteLimitsTests-824730978 None] Lock "b'cinder-17eda1c2-97cb-4c19-8837-b5cf9dcba614-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:10:08.875294 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5a126ceb-a8f7-4b81-a5ff-92578f122d53 tempest-AbsoluteLimitsTests-824730978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:09.008247 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5a126ceb-a8f7-4b81-a5ff-92578f122d53 tempest-AbsoluteLimitsTests-824730978 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:10:09.008766 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5a126ceb-a8f7-4b81-a5ff-92578f122d53 tempest-AbsoluteLimitsTests-824730978 None] Volume volume-17eda1c2-97cb-4c19-8837-b5cf9dcba614 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:10:09.037684 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5a126ceb-a8f7-4b81-a5ff-92578f122d53 tempest-AbsoluteLimitsTests-824730978 None] deleting rbd volume volume-17eda1c2-97cb-4c19-8837-b5cf9dcba614 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:10:09.669665 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-5a126ceb-a8f7-4b81-a5ff-92578f122d53 tempest-AbsoluteLimitsTests-824730978 None] Created reservations ['a0ecdeeb-ec6c-4f8c-b3b3-35649e77b69e', '8e99b660-7327-4167-af1e-1d20d09c41ff', '98033b01-bbb2-47a9-a1ca-91e58b97bcc4', '340d050a-17ad-4de1-b154-2e9be35da988'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:10:09.752672 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5a126ceb-a8f7-4b81-a5ff-92578f122d53 tempest-AbsoluteLimitsTests-824730978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:09.821198 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5a126ceb-a8f7-4b81-a5ff-92578f122d53 tempest-AbsoluteLimitsTests-824730978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:09.902460 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-5a126ceb-a8f7-4b81-a5ff-92578f122d53 tempest-AbsoluteLimitsTests-824730978 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:10:09.913503 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-5a126ceb-a8f7-4b81-a5ff-92578f122d53 tempest-AbsoluteLimitsTests-824730978 None] Deleted volume successfully. Mar 05 21:10:09.935221 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-5a126ceb-a8f7-4b81-a5ff-92578f122d53 tempest-AbsoluteLimitsTests-824730978 None] Lock "b'cinder-17eda1c2-97cb-4c19-8837-b5cf9dcba614-delete_volume'" released by "delete_volume" :: held 1.125s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:10:15.299687 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:10:15.304452 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:10:15.305223 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:10:15.329573 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Flow 'volume_create_manager' (b9da9112-ce04-4224-bcde-4d8e9433ec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:10:15.341115 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a880b4-028a-4312-b432-76a9bd8ccc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:10:15.350181 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:10:15.377687 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a880b4-028a-4312-b432-76a9bd8ccc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1724397430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c7135dac-6503-4851-a404-83a57ba4edc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a7966b7e04467f9767cd9a39d17501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:10:15Z,use_quota=True,user_id='964c3879e8494da6a6dd6cdc3aade56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:10:15.384803 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c57579-df9f-4d39-8ccf-128114392fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:10:15.391338 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c57579-df9f-4d39-8ccf-128114392fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:10:15.398277 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0c1395-0026-41d9-831b-1b11d35649bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:10:15.404121 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0c1395-0026-41d9-831b-1b11d35649bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7135dac-6503-4851-a404-83a57ba4edc3', 'volume_name': 'volume-c7135dac-6503-4851-a404-83a57ba4edc3', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:10:15.410390 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba1bed4-34d9-4e9e-8d5f-9e08efc4db09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:10:15.415412 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba1bed4-34d9-4e9e-8d5f-9e08efc4db09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:10:15.421440 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4833d27-dce9-4ea2-b1f0-30a21b63ae9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:10:15.423023 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Volume c7135dac-6503-4851-a404-83a57ba4edc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7135dac-6503-4851-a404-83a57ba4edc3', 'volume_size': 1} Mar 05 21:10:15.423861 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] creating volume 'volume-c7135dac-6503-4851-a404-83a57ba4edc3' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:10:15.425288 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:15.519996 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:10:15.520286 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:10:15.526593 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4833d27-dce9-4ea2-b1f0-30a21b63ae9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7135dac-6503-4851-a404-83a57ba4edc3', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:10:15.536494 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37981eb-f36c-4ff6-a38f-edc52d3c1e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:10:15.552718 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Volume volume-c7135dac-6503-4851-a404-83a57ba4edc3 (c7135dac-6503-4851-a404-83a57ba4edc3): created successfully Mar 05 21:10:15.561742 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37981eb-f36c-4ff6-a38f-edc52d3c1e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:10:15.576222 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Flow 'volume_create_manager' (b9da9112-ce04-4224-bcde-4d8e9433ec2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:10:15.595519 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-2d012033-a9bc-49a5-b182-5166880c8d24 tempest-VolumesSnapshotListTestJSON-1975472198 None] Created volume successfully. Mar 05 21:10:15.871482 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-d9edd40e-fd05-4060-a2de-55c9fc817790 tempest-ServersNegativeTestJSON-876211055 None] Lock "b'cinder-aec7721e-406d-4947-9acc-557054b0a1e0-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:10:15.954447 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d9edd40e-fd05-4060-a2de-55c9fc817790 tempest-ServersNegativeTestJSON-876211055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:16.097695 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d9edd40e-fd05-4060-a2de-55c9fc817790 tempest-ServersNegativeTestJSON-876211055 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:10:16.098131 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d9edd40e-fd05-4060-a2de-55c9fc817790 tempest-ServersNegativeTestJSON-876211055 None] Volume volume-aec7721e-406d-4947-9acc-557054b0a1e0 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:10:16.119015 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d9edd40e-fd05-4060-a2de-55c9fc817790 tempest-ServersNegativeTestJSON-876211055 None] deleting rbd volume volume-aec7721e-406d-4947-9acc-557054b0a1e0 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:10:16.706508 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c22e200e-ab84-4d7b-8b2e-72e4639bb959 tempest-VolumesSnapshotListTestJSON-1975472198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:16.898296 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-d9edd40e-fd05-4060-a2de-55c9fc817790 tempest-ServersNegativeTestJSON-876211055 None] Created reservations ['964bed36-9962-490f-ba48-cb2304fda7bc', 'b1901ccf-3fa7-4a60-8eb3-27b7b64cd464', 'b43dde35-e5b3-4463-96bb-6e515f981b52', '37418ee9-53a6-4268-9fe8-545a98e78068'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:10:16.972518 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d9edd40e-fd05-4060-a2de-55c9fc817790 tempest-ServersNegativeTestJSON-876211055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:17.060600 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d9edd40e-fd05-4060-a2de-55c9fc817790 tempest-ServersNegativeTestJSON-876211055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:17.166739 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-d9edd40e-fd05-4060-a2de-55c9fc817790 tempest-ServersNegativeTestJSON-876211055 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:10:17.188804 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d9edd40e-fd05-4060-a2de-55c9fc817790 tempest-ServersNegativeTestJSON-876211055 None] Deleted volume successfully. Mar 05 21:10:17.218629 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-8851d79a-61f2-4416-af16-2e6fb3581f1a tempest-ServersNegativeTestJSON-876211055 None] Lock "b'cinder-1b988a6d-e525-416a-98bd-60d0787e1b67-delete_volume'" acquired by "delete_volume" :: waited 0.046s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:10:17.231350 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-d9edd40e-fd05-4060-a2de-55c9fc817790 tempest-ServersNegativeTestJSON-876211055 None] Lock "b'cinder-aec7721e-406d-4947-9acc-557054b0a1e0-delete_volume'" released by "delete_volume" :: held 1.359s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:10:17.297802 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8851d79a-61f2-4416-af16-2e6fb3581f1a tempest-ServersNegativeTestJSON-876211055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:17.410058 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8851d79a-61f2-4416-af16-2e6fb3581f1a tempest-ServersNegativeTestJSON-876211055 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:10:17.411112 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8851d79a-61f2-4416-af16-2e6fb3581f1a tempest-ServersNegativeTestJSON-876211055 None] Volume volume-1b988a6d-e525-416a-98bd-60d0787e1b67 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:10:17.422083 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8851d79a-61f2-4416-af16-2e6fb3581f1a tempest-ServersNegativeTestJSON-876211055 None] deleting rbd volume volume-1b988a6d-e525-416a-98bd-60d0787e1b67 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:10:17.610362 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c22e200e-ab84-4d7b-8b2e-72e4639bb959 tempest-VolumesSnapshotListTestJSON-1975472198 None] Create snapshot completed successfully Mar 05 21:10:18.177482 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9b05b13e-2bef-411b-8187-8d990cd73f97 tempest-VolumesSnapshotListTestJSON-1975472198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:18.349617 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-8851d79a-61f2-4416-af16-2e6fb3581f1a tempest-ServersNegativeTestJSON-876211055 None] Created reservations ['97f8aa60-c7fe-4b15-b56d-4c0df79c35b6', 'b75670f9-3788-49e7-9e76-db857dd95a05', '9c9ab8b6-e2f3-4954-ab8d-eb9a7d7f6e2e', '7b3a4b11-c03c-4dbe-9e2a-33e1f219d61c'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:10:18.447361 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8851d79a-61f2-4416-af16-2e6fb3581f1a tempest-ServersNegativeTestJSON-876211055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:18.515984 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8851d79a-61f2-4416-af16-2e6fb3581f1a tempest-ServersNegativeTestJSON-876211055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:18.588451 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-8851d79a-61f2-4416-af16-2e6fb3581f1a tempest-ServersNegativeTestJSON-876211055 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:10:18.593276 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8851d79a-61f2-4416-af16-2e6fb3581f1a tempest-ServersNegativeTestJSON-876211055 None] Deleted volume successfully. Mar 05 21:10:18.615174 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-8851d79a-61f2-4416-af16-2e6fb3581f1a tempest-ServersNegativeTestJSON-876211055 None] Lock "b'cinder-1b988a6d-e525-416a-98bd-60d0787e1b67-delete_volume'" released by "delete_volume" :: held 1.396s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:10:19.482316 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-9b05b13e-2bef-411b-8187-8d990cd73f97 tempest-VolumesSnapshotListTestJSON-1975472198 None] Create snapshot completed successfully Mar 05 21:10:20.472034 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-988556d3-616e-4095-a062-b2d3eda32a2e tempest-VolumesSnapshotListTestJSON-1975472198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:21.469017 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-988556d3-616e-4095-a062-b2d3eda32a2e tempest-VolumesSnapshotListTestJSON-1975472198 None] Create snapshot completed successfully Mar 05 21:10:21.814040 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-2d401b1e-57b2-4001-a602-cfa3b8adce24 req-4426397c-bb58-4030-a179-ae6e7ec822e1 tempest-TestVolumeBackupRestore-590870803 None] Terminate volume connection completed successfully. Mar 05 21:10:21.814646 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-2d401b1e-57b2-4001-a602-cfa3b8adce24 req-4426397c-bb58-4030-a179-ae6e7ec822e1 tempest-TestVolumeBackupRestore-590870803 None] Deleting attachment ff8f41ee-907e-4b94-afb6-1111eee3f3e5. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:10:23.492995 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-bdf9d74e-4954-4045-b109-d53c33989afa tempest-VolumesSnapshotListTestJSON-1975472198 None] Lock "b'cinder-1c952724-7b54-4823-a28a-2d752f355cfd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:10:23.494849 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-bdf9d74e-4954-4045-b109-d53c33989afa tempest-VolumesSnapshotListTestJSON-1975472198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:24.560910 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-bdf9d74e-4954-4045-b109-d53c33989afa tempest-VolumesSnapshotListTestJSON-1975472198 None] Created reservations ['54d46b85-665f-4cca-b980-7bae5d332ff8', '544b1429-eec3-47e6-baeb-d8d88756db33', '57d217b9-d2c9-4900-8bcd-c72215fb6aa7', '4f5f3ae6-29cf-48eb-9fb1-391daa3a14fc'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:10:24.721186 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-bdf9d74e-4954-4045-b109-d53c33989afa tempest-VolumesSnapshotListTestJSON-1975472198 None] Delete snapshot completed successfully. Mar 05 21:10:24.725028 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-063f7c89-b2a1-4b78-9ef8-ff364b81d013 tempest-TestVolumeBackupRestore-590870803 None] Lock "b'cinder-58a73208-a97d-4148-854a-a7d6520bb60b-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:10:24.739975 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-bdf9d74e-4954-4045-b109-d53c33989afa tempest-VolumesSnapshotListTestJSON-1975472198 None] Lock "b'cinder-1c952724-7b54-4823-a28a-2d752f355cfd-delete_snapshot'" released by "delete_snapshot" :: held 1.246s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:10:24.815213 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-063f7c89-b2a1-4b78-9ef8-ff364b81d013 tempest-TestVolumeBackupRestore-590870803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:25.434501 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-063f7c89-b2a1-4b78-9ef8-ff364b81d013 tempest-TestVolumeBackupRestore-590870803 None] Volume volume-58a73208-a97d-4148-854a-a7d6520bb60b is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:10:25.469782 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-063f7c89-b2a1-4b78-9ef8-ff364b81d013 tempest-TestVolumeBackupRestore-590870803 None] deleting rbd volume volume-58a73208-a97d-4148-854a-a7d6520bb60b {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:10:25.510315 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-bad98588-6cfd-4563-870b-584148b94042 tempest-TestVolumeBackupRestore-590870803 None] Lock "b'cinder-b22e1911-a4e8-47cf-863e-0a7a04265855-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:10:25.557920 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-bad98588-6cfd-4563-870b-584148b94042 tempest-TestVolumeBackupRestore-590870803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:26.644064 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-bad98588-6cfd-4563-870b-584148b94042 tempest-TestVolumeBackupRestore-590870803 None] deleting rbd volume volume-b22e1911-a4e8-47cf-863e-0a7a04265855 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:10:26.667935 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-1c809ebb-fb5b-4392-bed9-bf607277fff9 tempest-VolumesSnapshotListTestJSON-1975472198 None] Lock "b'cinder-05463a62-d1ff-438c-91c3-e80406a71912-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:10:26.673551 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1c809ebb-fb5b-4392-bed9-bf607277fff9 tempest-VolumesSnapshotListTestJSON-1975472198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:26.961296 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-063f7c89-b2a1-4b78-9ef8-ff364b81d013 tempest-TestVolumeBackupRestore-590870803 None] Created reservations ['50290440-3fc6-4b92-80e0-c7bee3a70978', 'f82bd8d0-0b6f-4351-ae88-ea09dd1ac0f0', 'a8de95ff-6b14-4d39-90e4-b5339cc37b7b', '26d6202b-8ebb-4c4b-82e0-5a958b744147'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:10:27.161112 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-063f7c89-b2a1-4b78-9ef8-ff364b81d013 tempest-TestVolumeBackupRestore-590870803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:27.259480 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-063f7c89-b2a1-4b78-9ef8-ff364b81d013 tempest-TestVolumeBackupRestore-590870803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:27.315786 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-063f7c89-b2a1-4b78-9ef8-ff364b81d013 tempest-TestVolumeBackupRestore-590870803 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:10:27.318339 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-bad98588-6cfd-4563-870b-584148b94042 tempest-TestVolumeBackupRestore-590870803 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 21:10:27.375381 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-bad98588-6cfd-4563-870b-584148b94042 tempest-TestVolumeBackupRestore-590870803 None] deleting parent snapshot volume-b22e1911-a4e8-47cf-863e-0a7a04265855.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 21:10:28.589375 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-063f7c89-b2a1-4b78-9ef8-ff364b81d013 tempest-TestVolumeBackupRestore-590870803 None] Deleted volume successfully. Mar 05 21:10:28.658541 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-063f7c89-b2a1-4b78-9ef8-ff364b81d013 tempest-TestVolumeBackupRestore-590870803 None] Lock "b'cinder-58a73208-a97d-4148-854a-a7d6520bb60b-delete_volume'" released by "delete_volume" :: held 3.933s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:10:28.720689 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-bad98588-6cfd-4563-870b-584148b94042 tempest-TestVolumeBackupRestore-590870803 None] Created reservations ['523dd452-9380-4a09-b03d-b1d4a791f654', 'e3f6d4ca-a91e-4bbe-85a1-10b57a8e44b6', 'e3d31bee-8e68-4ffb-bb97-637e74632eeb', '68ac607c-6e25-4ec7-89e8-421063f3f264'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:10:28.778256 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-1c809ebb-fb5b-4392-bed9-bf607277fff9 tempest-VolumesSnapshotListTestJSON-1975472198 None] Created reservations ['93be6668-57ed-4e30-94b2-cb970f91978e', 'f46a41e3-66e5-4b07-bf02-8eb046298f9d', '27284f92-7ef3-4048-8a48-3ad80935f901', '92af227b-14ca-4f6c-8e61-03c82a2a292b'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:10:28.836954 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-bad98588-6cfd-4563-870b-584148b94042 tempest-TestVolumeBackupRestore-590870803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:28.925077 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-bad98588-6cfd-4563-870b-584148b94042 tempest-TestVolumeBackupRestore-590870803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:29.014986 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-bad98588-6cfd-4563-870b-584148b94042 tempest-TestVolumeBackupRestore-590870803 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:10:29.024107 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-bad98588-6cfd-4563-870b-584148b94042 tempest-TestVolumeBackupRestore-590870803 None] Deleted volume successfully. Mar 05 21:10:29.047340 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-bad98588-6cfd-4563-870b-584148b94042 tempest-TestVolumeBackupRestore-590870803 None] Lock "b'cinder-b22e1911-a4e8-47cf-863e-0a7a04265855-delete_volume'" released by "delete_volume" :: held 3.540s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:10:29.052583 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-1c809ebb-fb5b-4392-bed9-bf607277fff9 tempest-VolumesSnapshotListTestJSON-1975472198 None] Delete snapshot completed successfully. Mar 05 21:10:29.087330 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-1c809ebb-fb5b-4392-bed9-bf607277fff9 tempest-VolumesSnapshotListTestJSON-1975472198 None] Lock "b'cinder-05463a62-d1ff-438c-91c3-e80406a71912-delete_snapshot'" released by "delete_snapshot" :: held 2.416s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:10:29.127977 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-d34494e5-7402-4653-99a2-acc09ac28a28 tempest-VolumesSnapshotListTestJSON-1975472198 None] Lock "b'cinder-f7f60ea0-8303-405d-a28b-cd6489e5be2e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.025s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:10:29.129382 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d34494e5-7402-4653-99a2-acc09ac28a28 tempest-VolumesSnapshotListTestJSON-1975472198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:29.736137 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-d34494e5-7402-4653-99a2-acc09ac28a28 tempest-VolumesSnapshotListTestJSON-1975472198 None] Created reservations ['c33919cc-7227-40f9-b4b1-22fe92cdcf84', '77d5aeb6-aa86-409d-99e7-cf4823525d5b', '2c39e90f-8561-4d25-b0e6-5437ead9479f', '0ee2b0c5-0ead-4077-ad42-7b6294d84d32'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:10:29.818406 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d34494e5-7402-4653-99a2-acc09ac28a28 tempest-VolumesSnapshotListTestJSON-1975472198 None] Delete snapshot completed successfully. Mar 05 21:10:29.823356 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-d34494e5-7402-4653-99a2-acc09ac28a28 tempest-VolumesSnapshotListTestJSON-1975472198 None] Lock "b'cinder-f7f60ea0-8303-405d-a28b-cd6489e5be2e-delete_snapshot'" released by "delete_snapshot" :: held 0.695s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:10:30.361217 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-427d2afc-9669-458b-88f5-f2476b11f898 tempest-VolumesSnapshotListTestJSON-1975472198 None] Lock "b'cinder-c7135dac-6503-4851-a404-83a57ba4edc3-delete_volume'" acquired by "delete_volume" :: waited 0.062s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:10:30.572905 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-427d2afc-9669-458b-88f5-f2476b11f898 tempest-VolumesSnapshotListTestJSON-1975472198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:30.711995 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-427d2afc-9669-458b-88f5-f2476b11f898 tempest-VolumesSnapshotListTestJSON-1975472198 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:10:30.712406 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-427d2afc-9669-458b-88f5-f2476b11f898 tempest-VolumesSnapshotListTestJSON-1975472198 None] Volume volume-c7135dac-6503-4851-a404-83a57ba4edc3 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:10:30.725721 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-427d2afc-9669-458b-88f5-f2476b11f898 tempest-VolumesSnapshotListTestJSON-1975472198 None] deleting rbd volume volume-c7135dac-6503-4851-a404-83a57ba4edc3 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:10:31.271902 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-427d2afc-9669-458b-88f5-f2476b11f898 tempest-VolumesSnapshotListTestJSON-1975472198 None] Created reservations ['5b96b91e-96fe-41ce-91fd-4b4a9f839b80', 'b48da58e-3992-4c72-8f3a-f921f2c99524', '5fc4fe0c-c069-41d9-91af-00f5f441f97b', '810157bf-0775-413a-92be-d4457f338ab9'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:10:31.377266 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-427d2afc-9669-458b-88f5-f2476b11f898 tempest-VolumesSnapshotListTestJSON-1975472198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:31.459629 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-427d2afc-9669-458b-88f5-f2476b11f898 tempest-VolumesSnapshotListTestJSON-1975472198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:31.531327 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-427d2afc-9669-458b-88f5-f2476b11f898 tempest-VolumesSnapshotListTestJSON-1975472198 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:10:31.535504 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-427d2afc-9669-458b-88f5-f2476b11f898 tempest-VolumesSnapshotListTestJSON-1975472198 None] Deleted volume successfully. Mar 05 21:10:31.557062 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-427d2afc-9669-458b-88f5-f2476b11f898 tempest-VolumesSnapshotListTestJSON-1975472198 None] Lock "b'cinder-c7135dac-6503-4851-a404-83a57ba4edc3-delete_volume'" released by "delete_volume" :: held 1.197s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:10:45.614402 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:10:45.615252 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:45.707232 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:10:45.778362 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:11:45.614151 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:11:45.615545 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:11:45.684968 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:11:45.768436 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:12:11.922794 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:12:11.946704 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:12:11.949785 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:12:11.986004 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Flow 'volume_create_manager' (c0ac2b81-1283-4c69-85fc-05eaf97710c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:12:11.996821 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b385301-c4f9-449d-baaa-8591a77636dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:12.004191 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:12:12.021938 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b385301-c4f9-449d-baaa-8591a77636dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-513056617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0a4054d8-18e9-4856-b7b4-20817b2ed9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73f6888043940b9b1344c6998b423da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:12:12Z,use_quota=True,user_id='8bee90d7a5af4246b85ff0cb89217700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:12.028967 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a195a7ea-2f1f-4472-a1fb-1b485d6187f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:12.033419 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a195a7ea-2f1f-4472-a1fb-1b485d6187f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:12.039658 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1831f2ac-d16b-4be9-87f6-ba07b07f50b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:12.044804 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1831f2ac-d16b-4be9-87f6-ba07b07f50b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a4054d8-18e9-4856-b7b4-20817b2ed9e5', 'volume_name': 'volume-0a4054d8-18e9-4856-b7b4-20817b2ed9e5', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:12.049861 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7067c3e-9412-44bd-8fb2-e9021f8134e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:12.054282 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7067c3e-9412-44bd-8fb2-e9021f8134e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:12.059954 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0dd441-504d-423f-87a8-2c5eb3fee44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:12.061146 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Volume 0a4054d8-18e9-4856-b7b4-20817b2ed9e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a4054d8-18e9-4856-b7b4-20817b2ed9e5', 'volume_size': 1} Mar 05 21:12:12.062761 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] creating volume 'volume-0a4054d8-18e9-4856-b7b4-20817b2ed9e5' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:12:12.064436 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:12.195884 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:12:12.196230 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:12:12.200740 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0dd441-504d-423f-87a8-2c5eb3fee44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a4054d8-18e9-4856-b7b4-20817b2ed9e5', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:12.211953 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9df5c35-7f67-4f57-bcfb-c5e5be2b755b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:12.231506 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Volume volume-0a4054d8-18e9-4856-b7b4-20817b2ed9e5 (0a4054d8-18e9-4856-b7b4-20817b2ed9e5): created successfully Mar 05 21:12:12.235913 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9df5c35-7f67-4f57-bcfb-c5e5be2b755b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:12.248117 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Flow 'volume_create_manager' (c0ac2b81-1283-4c69-85fc-05eaf97710c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:12:12.266359 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f44d2df0-700b-43ee-8338-c2410e600cb8 tempest-AttachVolumeNegativeTest-1565771773 None] Created volume successfully. Mar 05 21:12:13.714586 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-4635e491-1666-4ff9-b5f8-b1ce92b7ffa2 req-735bb2f8-7f9f-40ff-9cba-14afc32d73b7 tempest-AttachVolumeNegativeTest-1565771773 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:12:15.063003 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-4635e491-1666-4ff9-b5f8-b1ce92b7ffa2 req-735bb2f8-7f9f-40ff-9cba-14afc32d73b7 tempest-AttachVolumeNegativeTest-1565771773 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.348s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:12:15.063853 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-4635e491-1666-4ff9-b5f8-b1ce92b7ffa2 req-735bb2f8-7f9f-40ff-9cba-14afc32d73b7 tempest-AttachVolumeNegativeTest-1565771773 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0a4054d8-18e9-4856-b7b4-20817b2ed9e5', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '0a4054d8-18e9-4856-b7b4-20817b2ed9e5', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:12:15.100821 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-4635e491-1666-4ff9-b5f8-b1ce92b7ffa2 req-735bb2f8-7f9f-40ff-9cba-14afc32d73b7 tempest-AttachVolumeNegativeTest-1565771773 None] Connection info returned from driver {'name': 'volumes/volume-0a4054d8-18e9-4856-b7b4-20817b2ed9e5', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0a4054d8-18e9-4856-b7b4-20817b2ed9e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dc2ef730-7790-481d-bb37-8224b73b0f9f'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:12:15.181300 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-4635e491-1666-4ff9-b5f8-b1ce92b7ffa2 req-735bb2f8-7f9f-40ff-9cba-14afc32d73b7 tempest-AttachVolumeNegativeTest-1565771773 None] attachment_update completed successfully. Mar 05 21:12:26.285911 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c42ffc9a-ca00-4a90-8444-614425c83c0d tempest-GroupSnapshotsV319Test-797685107 None] Group tempest-GroupSnapshotsV319Test-Group-2073023601: creating Mar 05 21:12:26.307262 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c42ffc9a-ca00-4a90-8444-614425c83c0d tempest-GroupSnapshotsV319Test-797685107 None] Group tempest-GroupSnapshotsV319Test-Group-2073023601: created successfully Mar 05 21:12:26.320986 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c42ffc9a-ca00-4a90-8444-614425c83c0d tempest-GroupSnapshotsV319Test-797685107 None] Create group completed successfully. Mar 05 21:12:27.923930 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:12:27.927501 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:12:27.936053 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:12:27.990951 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Flow 'volume_create_manager' (9c9f2866-4d90-44ba-a905-6c2c9d7898cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:12:28.000616 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2320ff-13d7-43f4-8141-684e937f08ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:28.021033 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:12:28.042598 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2320ff-13d7-43f4-8141-684e937f08ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-2094225591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f13c0d04-da57-4779-b2c4-16756e18286f,host='ncdv-master-1@ceph#ceph',id=b1a71d5c-f2d8-4b16-a8e8-701b7b926cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08c9a12b459f419a9939dda81ec27120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:12:28Z,use_quota=True,user_id='2e858eb473bb4a8b9da97035a0c3ef26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25ea5a4c-9f1b-470b-9bb7-edd5f9b0b787),volume_type_id=25ea5a4c-9f1b-470b-9bb7-edd5f9b0b787)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:28.048802 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6ac4ce-6479-4f11-8010-fdc51dc57425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:28.065647 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6ac4ce-6479-4f11-8010-fdc51dc57425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:28.070971 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb6a7e7-8e1d-49b7-aa9b-4e9bfc000494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:28.083635 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb6a7e7-8e1d-49b7-aa9b-4e9bfc000494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1a71d5c-f2d8-4b16-a8e8-701b7b926cbf', 'volume_name': 'volume-b1a71d5c-f2d8-4b16-a8e8-701b7b926cbf', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:28.088808 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b946e8a4-c1f7-4e7d-96b9-33444130602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:28.104989 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b946e8a4-c1f7-4e7d-96b9-33444130602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:28.110501 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40c6210-0a76-4cb5-ad00-9ac01ed027ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:28.111550 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Volume b1a71d5c-f2d8-4b16-a8e8-701b7b926cbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1a71d5c-f2d8-4b16-a8e8-701b7b926cbf', 'volume_size': 1} Mar 05 21:12:28.111994 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] creating volume 'volume-b1a71d5c-f2d8-4b16-a8e8-701b7b926cbf' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:12:28.113123 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:28.252428 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] extra_specs: {} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:12:28.253057 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] extra_specs: {} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:12:28.256986 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40c6210-0a76-4cb5-ad00-9ac01ed027ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1a71d5c-f2d8-4b16-a8e8-701b7b926cbf', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:28.262401 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e84f48e-e294-4537-a59f-8655c1f480f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:28.283598 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Volume volume-b1a71d5c-f2d8-4b16-a8e8-701b7b926cbf (b1a71d5c-f2d8-4b16-a8e8-701b7b926cbf): created successfully Mar 05 21:12:28.287260 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e84f48e-e294-4537-a59f-8655c1f480f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:28.303476 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Flow 'volume_create_manager' (9c9f2866-4d90-44ba-a905-6c2c9d7898cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:12:28.325490 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-14b3febf-287f-487f-9b31-882e1b0ebb53 tempest-GroupSnapshotsV319Test-797685107 None] Created volume successfully. Mar 05 21:12:29.202391 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-7123767c-387e-4cab-8429-bfaa9e498142 tempest-GroupSnapshotsV319Test-797685107 None] GroupSnapshot 8f4cf245-0fe3-4696-a1e4-a7eec62729f1: creating. Mar 05 21:12:29.289259 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7123767c-387e-4cab-8429-bfaa9e498142 tempest-GroupSnapshotsV319Test-797685107 None] Group snapshot 8f4cf245-0fe3-4696-a1e4-a7eec62729f1: creating. {{(pid=134747) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Mar 05 21:12:29.318613 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-7123767c-387e-4cab-8429-bfaa9e498142 tempest-GroupSnapshotsV319Test-797685107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:30.084262 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-7123767c-387e-4cab-8429-bfaa9e498142 tempest-GroupSnapshotsV319Test-797685107 None] group_snapshot 8f4cf245-0fe3-4696-a1e4-a7eec62729f1: created successfully Mar 05 21:12:30.844085 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d3864c92-d6ff-4580-aee8-2e1971748682 tempest-GroupSnapshotsV319Test-797685107 None] group_snapshot 8f4cf245-0fe3-4696-a1e4-a7eec62729f1: deleting Mar 05 21:12:30.875482 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d3864c92-d6ff-4580-aee8-2e1971748682 tempest-GroupSnapshotsV319Test-797685107 None] group_snapshot 8f4cf245-0fe3-4696-a1e4-a7eec62729f1: deleting {{(pid=134747) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Mar 05 21:12:30.915717 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d3864c92-d6ff-4580-aee8-2e1971748682 tempest-GroupSnapshotsV319Test-797685107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:32.144014 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-d3864c92-d6ff-4580-aee8-2e1971748682 tempest-GroupSnapshotsV319Test-797685107 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1814524803 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1814524803, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:12:32.144818 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-d3864c92-d6ff-4580-aee8-2e1971748682 tempest-GroupSnapshotsV319Test-797685107 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1814524803 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1814524803, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:12:32.167629 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-d3864c92-d6ff-4580-aee8-2e1971748682 tempest-GroupSnapshotsV319Test-797685107 None] Created reservations ['c8e14565-13ba-49a3-9ae8-585e2eb2d02e', 'eb71d5fb-79de-46c6-8890-44829d4cdce2', 'd6795fad-6b36-4f68-a292-74c8ca4999b6', 'af6a7fa0-7b35-421f-b8cb-ccb178428bb3'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:12:32.236838 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d3864c92-d6ff-4580-aee8-2e1971748682 tempest-GroupSnapshotsV319Test-797685107 None] group_snapshot 8f4cf245-0fe3-4696-a1e4-a7eec62729f1: deleted successfully Mar 05 21:12:32.953249 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:12:32.959867 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:12:32.960447 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:12:33.005157 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Flow 'volume_create_manager' (fe0a8436-5b8c-4965-b4e6-50f31a40f8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:12:33.013967 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127ca951-9c31-4ce9-a459-c65c0e9e30d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:33.022209 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:12:33.046886 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127ca951-9c31-4ce9-a459-c65c0e9e30d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1048578522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e28a20a7-45f6-4921-9f87-076085057103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1b37634bef4eefa974dfc8912e8556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:12:33Z,use_quota=True,user_id='469bc2b7ea9e4727a0f0356e9a08dcb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:33.058584 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3bc55b-7d56-447f-b3cb-ca854d69b727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:33.062191 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3bc55b-7d56-447f-b3cb-ca854d69b727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:33.068791 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc62fca1-ff63-41ed-b562-326a8c1e6622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:33.074843 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc62fca1-ff63-41ed-b562-326a8c1e6622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e28a20a7-45f6-4921-9f87-076085057103', 'volume_name': 'volume-e28a20a7-45f6-4921-9f87-076085057103', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:33.080245 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e76198a-a7b3-48da-bb9d-40cc6ceeb7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:33.084536 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e76198a-a7b3-48da-bb9d-40cc6ceeb7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:33.090169 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df12147c-9ad3-4adb-b701-c5c72e20f20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:33.091936 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Volume e28a20a7-45f6-4921-9f87-076085057103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e28a20a7-45f6-4921-9f87-076085057103', 'volume_size': 1} Mar 05 21:12:33.092652 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] creating volume 'volume-e28a20a7-45f6-4921-9f87-076085057103' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:12:33.095573 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:33.227092 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:12:33.228507 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:12:33.235194 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df12147c-9ad3-4adb-b701-c5c72e20f20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e28a20a7-45f6-4921-9f87-076085057103', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:33.250058 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e43ef02-e0e7-41ce-a6f2-2372403a94ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:33.287022 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Volume volume-e28a20a7-45f6-4921-9f87-076085057103 (e28a20a7-45f6-4921-9f87-076085057103): created successfully Mar 05 21:12:33.293954 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e43ef02-e0e7-41ce-a6f2-2372403a94ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:33.302430 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Flow 'volume_create_manager' (fe0a8436-5b8c-4965-b4e6-50f31a40f8d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:12:33.323762 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c5d137e2-2a86-425f-9830-c082059a5421 tempest-AttachVolumeShelveTestJSON-1318940295 None] Created volume successfully. Mar 05 21:12:33.714194 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5682465e-efd2-43ed-bb8c-5e68f4e69f01 tempest-GroupSnapshotsV319Test-797685107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:33.811791 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5682465e-efd2-43ed-bb8c-5e68f4e69f01 tempest-GroupSnapshotsV319Test-797685107 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:12:33.812255 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5682465e-efd2-43ed-bb8c-5e68f4e69f01 tempest-GroupSnapshotsV319Test-797685107 None] Volume volume-b1a71d5c-f2d8-4b16-a8e8-701b7b926cbf is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:12:33.818663 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5682465e-efd2-43ed-bb8c-5e68f4e69f01 tempest-GroupSnapshotsV319Test-797685107 None] deleting rbd volume volume-b1a71d5c-f2d8-4b16-a8e8-701b7b926cbf {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:12:34.240918 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-5682465e-efd2-43ed-bb8c-5e68f4e69f01 tempest-GroupSnapshotsV319Test-797685107 None] Created reservations ['1ed837c9-76aa-43e3-b43c-2295ab49b0de'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:12:34.259090 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-5682465e-efd2-43ed-bb8c-5e68f4e69f01 tempest-GroupSnapshotsV319Test-797685107 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1814524803 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1814524803, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:12:34.277154 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-5682465e-efd2-43ed-bb8c-5e68f4e69f01 tempest-GroupSnapshotsV319Test-797685107 None] Created reservations ['0798777d-53c6-4ad6-bb23-731fbf0426cc', '06505cda-b4ec-4cf7-aa64-6aea6bc440a5', 'ae8a525e-b266-4cb3-8f6b-8d32dbc991f2', '8b8a3a7b-df50-4d56-b6bc-142c7b5dd119'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:12:34.370494 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5682465e-efd2-43ed-bb8c-5e68f4e69f01 tempest-GroupSnapshotsV319Test-797685107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:34.451904 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5682465e-efd2-43ed-bb8c-5e68f4e69f01 tempest-GroupSnapshotsV319Test-797685107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:34.533100 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-5682465e-efd2-43ed-bb8c-5e68f4e69f01 tempest-GroupSnapshotsV319Test-797685107 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:12:34.538658 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-5682465e-efd2-43ed-bb8c-5e68f4e69f01 tempest-GroupSnapshotsV319Test-797685107 None] Delete group completed successfully. Mar 05 21:12:42.766283 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-7251c65a-b248-4d33-b22d-0fa7f13a4222 tempest-GroupsTest-2021729372 None] Group tempest-Group1-201499236: creating Mar 05 21:12:42.799005 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-7251c65a-b248-4d33-b22d-0fa7f13a4222 tempest-GroupsTest-2021729372 None] Group tempest-Group1-201499236: created successfully Mar 05 21:12:42.817673 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-7251c65a-b248-4d33-b22d-0fa7f13a4222 tempest-GroupsTest-2021729372 None] Create group completed successfully. Mar 05 21:12:44.134227 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ba91f2bf-441d-4d80-b669-d7fb70ce9b7d tempest-GroupsTest-2021729372 None] Group tempest-Group2-1367776827: creating Mar 05 21:12:44.162407 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ba91f2bf-441d-4d80-b669-d7fb70ce9b7d tempest-GroupsTest-2021729372 None] Group tempest-Group2-1367776827: created successfully Mar 05 21:12:44.180987 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ba91f2bf-441d-4d80-b669-d7fb70ce9b7d tempest-GroupsTest-2021729372 None] Create group completed successfully. Mar 05 21:12:45.614725 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:12:45.616120 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:45.733230 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:45.817379 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:12:45.876559 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:12:45.919355 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:12:45.920747 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:12:45.980043 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Flow 'volume_create_manager' (dc41ece1-c79b-471c-8556-763f70927c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:12:45.996142 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8364f6-d40d-461f-afc5-d3f12df50042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:46.019384 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:12:46.052205 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8364f6-d40d-461f-afc5-d3f12df50042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-94703220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56e65782-df28-4e5a-84ac-cd217dfd83dd,host='ncdv-master-1@ceph#ceph',id=7a92ca3c-c5f9-4b26-ae97-d5e08efc4e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75762d520f3b47998dcad5cf538b950c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:12:46Z,use_quota=True,user_id='98f04fc36394425598efe261e76eae62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d494a307-00e8-46c7-9e80-6f619aa54b07),volume_type_id=d494a307-00e8-46c7-9e80-6f619aa54b07)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:46.068038 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a746bd-958f-40e1-924e-90d97c3737f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:46.085225 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a746bd-958f-40e1-924e-90d97c3737f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:46.091450 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aac9bdd-7473-486e-94cd-013942c61acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:46.109832 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aac9bdd-7473-486e-94cd-013942c61acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a92ca3c-c5f9-4b26-ae97-d5e08efc4e39', 'volume_name': 'volume-7a92ca3c-c5f9-4b26-ae97-d5e08efc4e39', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:46.149450 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae0c2202-0230-4893-ac7e-22492558f616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:46.160100 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae0c2202-0230-4893-ac7e-22492558f616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:46.178175 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42daf8e8-7889-4ec2-b5aa-a1a207ad890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:46.179578 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Volume 7a92ca3c-c5f9-4b26-ae97-d5e08efc4e39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a92ca3c-c5f9-4b26-ae97-d5e08efc4e39', 'volume_size': 1} Mar 05 21:12:46.180105 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] creating volume 'volume-7a92ca3c-c5f9-4b26-ae97-d5e08efc4e39' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:12:46.181276 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:46.336034 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:12:46.342461 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:12:46.344805 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:12:46.387304 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Flow 'volume_create_manager' (ff4fe9e9-618d-4789-a341-db9b2b10b468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:12:46.395817 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f2a2f0-b7ba-48f5-8833-c3c209778599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:46.416274 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] extra_specs: {} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:12:46.417533 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] extra_specs: {} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:12:46.421598 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42daf8e8-7889-4ec2-b5aa-a1a207ad890e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a92ca3c-c5f9-4b26-ae97-d5e08efc4e39', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:46.426746 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644630c7-210d-4fe6-ac3b-206efeccf3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:46.442125 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:12:46.460671 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Volume volume-7a92ca3c-c5f9-4b26-ae97-d5e08efc4e39 (7a92ca3c-c5f9-4b26-ae97-d5e08efc4e39): created successfully Mar 05 21:12:46.466251 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644630c7-210d-4fe6-ac3b-206efeccf3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:46.472367 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Flow 'volume_create_manager' (dc41ece1-c79b-471c-8556-763f70927c90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:12:46.491302 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f2a2f0-b7ba-48f5-8833-c3c209778599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-595320173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c41f3467-bd6d-4ccd-9615-95e24e4a1f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e8d430cf044c53b14c5592b2a76519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:12:46Z,use_quota=True,user_id='1311d1d0286f4c76a56dc16db4a6f8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:46.503491 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7fe27dd-7ec0-44bb-b7da-4090a828d097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:46.508327 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7fe27dd-7ec0-44bb-b7da-4090a828d097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:46.516213 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1761f268-2cbd-4d90-b5fa-638d7d53e827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:46.521133 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1761f268-2cbd-4d90-b5fa-638d7d53e827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41f3467-bd6d-4ccd-9615-95e24e4a1f9b', 'volume_name': 'volume-c41f3467-bd6d-4ccd-9615-95e24e4a1f9b', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:46.541892 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87b5b7a-7309-427c-b021-6e3b2772cb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:46.545390 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87b5b7a-7309-427c-b021-6e3b2772cb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:46.550432 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc633d4-1ea3-4ca6-8fa4-3ecbee1faf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:46.551700 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Volume c41f3467-bd6d-4ccd-9615-95e24e4a1f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41f3467-bd6d-4ccd-9615-95e24e4a1f9b', 'volume_size': 1} Mar 05 21:12:46.552244 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] creating volume 'volume-c41f3467-bd6d-4ccd-9615-95e24e4a1f9b' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:12:46.553016 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:46.597911 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-0bd1b30a-b0d5-4c30-866e-49fc2bdb9a43 tempest-GroupsTest-2021729372 None] Created volume successfully. Mar 05 21:12:46.656534 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:12:46.657814 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:12:46.662174 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc633d4-1ea3-4ca6-8fa4-3ecbee1faf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41f3467-bd6d-4ccd-9615-95e24e4a1f9b', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:46.668456 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a6a6e3-09d7-45ed-be09-a5a4c2b35b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:46.680944 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Volume volume-c41f3467-bd6d-4ccd-9615-95e24e4a1f9b (c41f3467-bd6d-4ccd-9615-95e24e4a1f9b): created successfully Mar 05 21:12:46.687732 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a6a6e3-09d7-45ed-be09-a5a4c2b35b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:46.696338 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Flow 'volume_create_manager' (ff4fe9e9-618d-4789-a341-db9b2b10b468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:12:46.708181 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-dffb9432-9197-4c34-b90f-a4eb767d9999 tempest-VolumesDeleteCascade-1886072177 None] Created volume successfully. Mar 05 21:12:47.461341 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1a95930-2d88-40c7-bab0-9bf3b37e13a0 tempest-VolumesDeleteCascade-1886072177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:47.835454 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b9bd58f2-ba76-4c59-9c41-f32fe90bde52 tempest-GroupsTest-2021729372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:47.943835 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b9bd58f2-ba76-4c59-9c41-f32fe90bde52 tempest-GroupsTest-2021729372 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:12:47.944574 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b9bd58f2-ba76-4c59-9c41-f32fe90bde52 tempest-GroupsTest-2021729372 None] Volume volume-7a92ca3c-c5f9-4b26-ae97-d5e08efc4e39 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:12:47.964857 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b9bd58f2-ba76-4c59-9c41-f32fe90bde52 tempest-GroupsTest-2021729372 None] deleting rbd volume volume-7a92ca3c-c5f9-4b26-ae97-d5e08efc4e39 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:12:48.385163 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-b9bd58f2-ba76-4c59-9c41-f32fe90bde52 tempest-GroupsTest-2021729372 None] Created reservations ['12bc32c1-8ab2-495c-b864-62e022039ec4'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:12:48.412515 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-b9bd58f2-ba76-4c59-9c41-f32fe90bde52 tempest-GroupsTest-2021729372 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1683501280 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1683501280, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:12:48.413573 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-b9bd58f2-ba76-4c59-9c41-f32fe90bde52 tempest-GroupsTest-2021729372 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1683501280 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1683501280, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:12:48.440985 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-b9bd58f2-ba76-4c59-9c41-f32fe90bde52 tempest-GroupsTest-2021729372 None] Created reservations ['20eecd44-9176-467b-8651-ff1aff1d9062', '2862a038-6255-4efc-87ec-fdaf74fc955e', '85ed1a61-343a-4540-a8a0-488ca7d218e4', '293adaaf-c68c-4604-a204-67d8a3af0807'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:12:48.621347 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b9bd58f2-ba76-4c59-9c41-f32fe90bde52 tempest-GroupsTest-2021729372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:48.684911 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b9bd58f2-ba76-4c59-9c41-f32fe90bde52 tempest-GroupsTest-2021729372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:48.754343 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-b9bd58f2-ba76-4c59-9c41-f32fe90bde52 tempest-GroupsTest-2021729372 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:12:48.762133 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b9bd58f2-ba76-4c59-9c41-f32fe90bde52 tempest-GroupsTest-2021729372 None] Delete group completed successfully. Mar 05 21:12:48.837877 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-e1a95930-2d88-40c7-bab0-9bf3b37e13a0 tempest-VolumesDeleteCascade-1886072177 None] Create snapshot completed successfully Mar 05 21:12:49.225120 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-f22dcaa7-df36-4121-88a6-489f1a94cd4b tempest-GroupsTest-2021729372 None] Created reservations ['d51acdb9-2df2-4834-97e8-c36a52d44ee7'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:12:49.299833 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f22dcaa7-df36-4121-88a6-489f1a94cd4b tempest-GroupsTest-2021729372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:49.367725 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f22dcaa7-df36-4121-88a6-489f1a94cd4b tempest-GroupsTest-2021729372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:49.454186 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-f22dcaa7-df36-4121-88a6-489f1a94cd4b tempest-GroupsTest-2021729372 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:12:49.458497 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f22dcaa7-df36-4121-88a6-489f1a94cd4b tempest-GroupsTest-2021729372 None] Delete group completed successfully. Mar 05 21:12:49.844311 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-442d2ed7-1b9d-4094-b6b2-7064fe624756 tempest-VolumesDeleteCascade-1886072177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:50.808639 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-442d2ed7-1b9d-4094-b6b2-7064fe624756 tempest-VolumesDeleteCascade-1886072177 None] Create snapshot completed successfully Mar 05 21:12:51.084231 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Lock "b'cinder-c41f3467-bd6d-4ccd-9615-95e24e4a1f9b-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:12:51.205658 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Performing cascade delete. {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/manager.py:963}} Mar 05 21:12:51.263096 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Lock "b'cinder-c5cd74fb-c612-42e1-ad39-c0a6047e5d80-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.038s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:12:51.269854 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-55be679d-8449-4069-920c-d907841761c1 tempest-GroupsTest-2021729372 None] Group tempest-GroupsTest-Group-886509247: creating Mar 05 21:12:51.298590 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:51.421005 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-55be679d-8449-4069-920c-d907841761c1 tempest-GroupsTest-2021729372 None] Group tempest-GroupsTest-Group-886509247: created successfully Mar 05 21:12:51.431426 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-55be679d-8449-4069-920c-d907841761c1 tempest-GroupsTest-2021729372 None] Create group completed successfully. Mar 05 21:12:52.769223 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Created reservations ['c6d82447-688d-4992-b66b-7ca8ff1eb659', '197e2d79-92c4-484a-8820-efc9efe96dde', '4a57cc3b-f158-4317-8341-48cf1105925d', '783b3f15-e4de-4b88-a10d-8c41bc5a4b7f'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:12:52.869728 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Delete snapshot completed successfully. Mar 05 21:12:52.876541 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Lock "b'cinder-c5cd74fb-c612-42e1-ad39-c0a6047e5d80-delete_snapshot'" released by "delete_snapshot" :: held 1.614s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:12:52.903529 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Lock "b'cinder-fbba9a51-89ae-4512-a698-c90f7fc38638-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.023s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:12:52.937870 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:53.153034 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:12:53.159762 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:12:53.160733 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:12:53.195358 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Flow 'volume_create_manager' (358f6e0a-52c9-411e-93d9-7f774787872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:12:53.208082 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372fc285-55a8-4892-9054-0af253aa45f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:53.218111 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:12:53.242153 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372fc285-55a8-4892-9054-0af253aa45f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1687434963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db794ff2-a76b-4d5c-8ed3-1f7fdf4eb33a,host='ncdv-master-1@ceph#ceph',id=7abc9409-951f-4308-ab63-f12264dd221e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75762d520f3b47998dcad5cf538b950c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:12:53Z,use_quota=True,user_id='98f04fc36394425598efe261e76eae62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18625285-a18d-44f3-8bf3-0a7f4cdf9f27),volume_type_id=18625285-a18d-44f3-8bf3-0a7f4cdf9f27)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:53.249617 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644c6409-e218-4449-b467-52e438ee04ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:53.258554 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644c6409-e218-4449-b467-52e438ee04ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:53.265993 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e1175b-5b79-4728-84f6-092b56b6d5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:53.270978 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e1175b-5b79-4728-84f6-092b56b6d5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7abc9409-951f-4308-ab63-f12264dd221e', 'volume_name': 'volume-7abc9409-951f-4308-ab63-f12264dd221e', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:53.279543 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7234dfa8-4b73-4400-bc1f-9915e00c694f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:53.284353 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7234dfa8-4b73-4400-bc1f-9915e00c694f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:53.290122 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a32cecd-2d06-4928-8353-09345a655d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:53.292317 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Volume 7abc9409-951f-4308-ab63-f12264dd221e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7abc9409-951f-4308-ab63-f12264dd221e', 'volume_size': 1} Mar 05 21:12:53.293004 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] creating volume 'volume-7abc9409-951f-4308-ab63-f12264dd221e' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:12:53.294228 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:53.432677 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] extra_specs: {} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:12:53.433087 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] extra_specs: {} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:12:53.437294 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a32cecd-2d06-4928-8353-09345a655d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abc9409-951f-4308-ab63-f12264dd221e', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:53.454821 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109ff709-4a90-4822-9402-dda98271bae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:53.495087 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Volume volume-7abc9409-951f-4308-ab63-f12264dd221e (7abc9409-951f-4308-ab63-f12264dd221e): created successfully Mar 05 21:12:53.499294 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109ff709-4a90-4822-9402-dda98271bae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:53.513509 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Flow 'volume_create_manager' (358f6e0a-52c9-411e-93d9-7f774787872f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:12:53.539253 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-12737b0b-99b7-473d-98c2-e8cd0ce6bcb6 tempest-GroupsTest-2021729372 None] Created volume successfully. Mar 05 21:12:53.795827 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Created reservations ['03089b35-8a3b-41b8-936b-090258deff3a', '624070c8-ec3c-4aff-ab9f-842384dd0835', '47506600-ab8c-4bcf-8e66-7ace3ff60ce7', 'a2221d0b-0162-4a47-a03b-1b976a45f6d8'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:12:53.861637 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Delete snapshot completed successfully. Mar 05 21:12:53.867220 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Lock "b'cinder-fbba9a51-89ae-4512-a698-c90f7fc38638-delete_snapshot'" released by "delete_snapshot" :: held 0.964s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:12:53.868176 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Snapshots deleted, issuing volume delete {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/manager.py:978}} Mar 05 21:12:53.870070 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:53.987558 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:12:53.987832 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Volume volume-c41f3467-bd6d-4ccd-9615-95e24e4a1f9b is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:12:54.012195 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] deleting rbd volume volume-c41f3467-bd6d-4ccd-9615-95e24e4a1f9b {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:12:54.637114 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Created reservations ['49abad06-1cf2-48e0-9bbc-04a789d10544', '9f5004a1-4fc1-4c0f-af76-b3b9eb674d0e', 'da73b29a-008e-40f3-8262-8219b0015d88', 'b3b39d38-2006-4115-a3d4-15f81f7e5d91'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:12:54.742751 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:54.845972 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:54.989819 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:12:54.995688 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Deleted volume successfully. Mar 05 21:12:55.037261 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e5ac3911-3b50-4c11-9eae-773a84445206 tempest-VolumesDeleteCascade-1886072177 None] Lock "b'cinder-c41f3467-bd6d-4ccd-9615-95e24e4a1f9b-delete_volume'" released by "delete_volume" :: held 3.953s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:12:55.137395 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:12:55.145643 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:12:55.146475 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:12:55.175518 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Flow 'volume_create_manager' (f191df15-aed4-4989-8e6e-6edaf4d4165f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:12:55.183899 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b63b56-4737-4c09-87e2-0fc1348871c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:55.192232 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:12:55.210687 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b63b56-4737-4c09-87e2-0fc1348871c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-560027324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db794ff2-a76b-4d5c-8ed3-1f7fdf4eb33a,host='ncdv-master-1@ceph#ceph',id=e567c936-1f5c-4d0b-bde7-9b3b388b693d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75762d520f3b47998dcad5cf538b950c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:12:55Z,use_quota=True,user_id='98f04fc36394425598efe261e76eae62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18625285-a18d-44f3-8bf3-0a7f4cdf9f27),volume_type_id=18625285-a18d-44f3-8bf3-0a7f4cdf9f27)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:55.217430 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2d65f6-8a17-480a-a0d9-43281a4c115c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:55.222306 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2d65f6-8a17-480a-a0d9-43281a4c115c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:55.232036 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1ee63d-bd68-4c7c-925a-e30ce864ee80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:55.237182 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1ee63d-bd68-4c7c-925a-e30ce864ee80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e567c936-1f5c-4d0b-bde7-9b3b388b693d', 'volume_name': 'volume-e567c936-1f5c-4d0b-bde7-9b3b388b693d', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:55.245023 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267fb660-ae65-4ec8-946b-c0ea89193e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:55.269085 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267fb660-ae65-4ec8-946b-c0ea89193e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:55.289739 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62ff4b2-5a70-4cca-a182-b3cde4d16737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:55.292544 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Volume e567c936-1f5c-4d0b-bde7-9b3b388b693d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e567c936-1f5c-4d0b-bde7-9b3b388b693d', 'volume_size': 1} Mar 05 21:12:55.293453 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] creating volume 'volume-e567c936-1f5c-4d0b-bde7-9b3b388b693d' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:12:55.295124 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:12:55.418461 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] extra_specs: {} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:12:55.418940 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] extra_specs: {} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:12:55.423560 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62ff4b2-5a70-4cca-a182-b3cde4d16737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e567c936-1f5c-4d0b-bde7-9b3b388b693d', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:55.429804 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed617dc-0ca9-42a2-bfed-42a2a55cd28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:12:55.445561 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Volume volume-e567c936-1f5c-4d0b-bde7-9b3b388b693d (e567c936-1f5c-4d0b-bde7-9b3b388b693d): created successfully Mar 05 21:12:55.453875 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed617dc-0ca9-42a2-bfed-42a2a55cd28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:12:55.466852 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Flow 'volume_create_manager' (f191df15-aed4-4989-8e6e-6edaf4d4165f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:12:55.500904 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d49bb6cd-8c1a-4249-9a52-b4f5573192f1 tempest-GroupsTest-2021729372 None] Created volume successfully. Mar 05 21:12:56.327847 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-a234c57a-3db1-4b5c-b420-ef06cf763f92 tempest-GroupsTest-2021729372 None] Update group completed successfully. Mar 05 21:12:57.959864 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b8e8d777-a97d-4874-ad74-e3bfec493e59 tempest-GroupsTest-2021729372 None] Update group completed successfully. Mar 05 21:12:59.990340 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:00.131918 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:13:00.132766 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] Volume volume-7abc9409-951f-4308-ab63-f12264dd221e is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:13:00.152526 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] deleting rbd volume volume-7abc9409-951f-4308-ab63-f12264dd221e {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:13:00.629835 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:00.732622 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:13:00.733049 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] Volume volume-e567c936-1f5c-4d0b-bde7-9b3b388b693d is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:13:00.753090 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] deleting rbd volume volume-e567c936-1f5c-4d0b-bde7-9b3b388b693d {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:13:01.459457 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] Created reservations ['1cad7fc1-facd-4aac-9c26-9afc409776d2'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:01.569094 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1209286191 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1209286191, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:13:01.576877 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1209286191 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1209286191, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:13:01.613618 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] Created reservations ['ecc81811-d3f7-400d-b75b-98241e937770', '5cf488e4-574d-43b2-a624-73da9866d9f7', '2ed7251e-36cc-496f-80c8-7510d47924bf', 'a92dca90-4817-4f18-b19e-a924f8f6044b'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:01.940144 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] Created reservations ['04e99a04-1a83-497c-a726-595e58b051aa', '110172c3-9283-47d1-a1cb-a4ac63e13cbf', '0a12bc26-640c-45ab-8a60-50c302719425', 'f6c986fa-812a-46f4-9e3d-67405d101619'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:02.182521 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:02.319343 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:02.408615 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:13:02.436219 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-eee7c4b2-da69-4e0c-ae62-bd590716c57e tempest-GroupSnapshotsTest-1430122540 None] Group tempest-GroupSnapshotsTest-Group-1581141010: creating Mar 05 21:13:02.438279 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-68e79a2e-fb3e-4d93-b885-69bb6c7778d0 tempest-GroupsTest-2021729372 None] Delete group completed successfully. Mar 05 21:13:02.479813 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-eee7c4b2-da69-4e0c-ae62-bd590716c57e tempest-GroupSnapshotsTest-1430122540 None] Group tempest-GroupSnapshotsTest-Group-1581141010: created successfully Mar 05 21:13:02.495799 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-eee7c4b2-da69-4e0c-ae62-bd590716c57e tempest-GroupSnapshotsTest-1430122540 None] Create group completed successfully. Mar 05 21:13:02.936964 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:13:02.947135 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:13:02.951569 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:13:02.995192 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Flow 'volume_create_manager' (259d3b13-4ef0-4fa8-ada6-b29cc72ad8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:13:03.011556 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f92abe-a848-4bac-b8a9-d31463970c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:03.045108 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:13:03.070019 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f92abe-a848-4bac-b8a9-d31463970c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-425027944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c892a60c-7706-469a-ba8c-f52ad4e0338b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6813d01c694475a2a3645008b1c369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:13:03Z,use_quota=True,user_id='9a5fca5fc43f4bd5971397ba20da0bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:03.078853 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70a7f93-a2cb-417d-972c-0d9e066c11c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:03.084521 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70a7f93-a2cb-417d-972c-0d9e066c11c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:03.091664 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cc6f02-7088-4cd8-ba1b-c8752ad55f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:03.097023 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cc6f02-7088-4cd8-ba1b-c8752ad55f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c892a60c-7706-469a-ba8c-f52ad4e0338b', 'volume_name': 'volume-c892a60c-7706-469a-ba8c-f52ad4e0338b', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:03.104098 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f102a799-0824-45a6-8aa1-8005a7ad37db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:03.108741 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f102a799-0824-45a6-8aa1-8005a7ad37db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:03.116574 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b40a93-707f-4406-8121-2b6025826b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:03.118801 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Volume c892a60c-7706-469a-ba8c-f52ad4e0338b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c892a60c-7706-469a-ba8c-f52ad4e0338b', 'volume_size': 1} Mar 05 21:13:03.120338 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] creating volume 'volume-c892a60c-7706-469a-ba8c-f52ad4e0338b' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:13:03.121433 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:03.272672 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:13:03.273143 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:13:03.277691 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b40a93-707f-4406-8121-2b6025826b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c892a60c-7706-469a-ba8c-f52ad4e0338b', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:03.287241 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ee74f7-4468-4d14-98ef-029cff18c354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:03.307222 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Volume volume-c892a60c-7706-469a-ba8c-f52ad4e0338b (c892a60c-7706-469a-ba8c-f52ad4e0338b): created successfully Mar 05 21:13:03.315199 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ee74f7-4468-4d14-98ef-029cff18c354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:03.329756 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Flow 'volume_create_manager' (259d3b13-4ef0-4fa8-ada6-b29cc72ad8fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:13:03.366129 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-cbbbfb57-0812-4414-a69e-6afed87c35be tempest-VolumesActionsTest-1075133775 None] Created volume successfully. Mar 05 21:13:04.331792 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:13:04.346516 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:13:04.349677 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:13:04.416317 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Flow 'volume_create_manager' (eec3e0cd-8475-409d-9e18-d20f93f30822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:13:04.432241 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23eeacec-dd45-4f29-931d-270b9de11d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:04.451605 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:13:04.495155 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23eeacec-dd45-4f29-931d-270b9de11d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-415019017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=422c82f0-31a1-4603-9507-17788c07285a,host='ncdv-master-1@ceph#ceph',id=b900d676-b354-430c-989f-5af736d0f732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e437b46d75485cb231d9a73fb90e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:13:04Z,use_quota=True,user_id='d14b9b77c3ed4b3b81671fe7f90f23d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29dc6c70-404b-454c-a832-6c47019f73bc),volume_type_id=29dc6c70-404b-454c-a832-6c47019f73bc)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:04.508469 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a624ae-3165-434a-a732-250df59f85b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:04.515960 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a624ae-3165-434a-a732-250df59f85b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:04.523699 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2fbb4e-8289-490e-8b4b-44709482768b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:04.533721 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2fbb4e-8289-490e-8b4b-44709482768b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b900d676-b354-430c-989f-5af736d0f732', 'volume_name': 'volume-b900d676-b354-430c-989f-5af736d0f732', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:04.543019 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aaf7921-3ac9-4f7f-96dd-e2ae218e46bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:04.549417 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aaf7921-3ac9-4f7f-96dd-e2ae218e46bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:04.556214 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007dae6c-2fc2-4536-adc6-73ad8a53fbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:04.558319 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Volume b900d676-b354-430c-989f-5af736d0f732: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b900d676-b354-430c-989f-5af736d0f732', 'volume_size': 1} Mar 05 21:13:04.559620 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] creating volume 'volume-b900d676-b354-430c-989f-5af736d0f732' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:13:04.560841 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:04.718876 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] extra_specs: {} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:13:04.719655 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] extra_specs: {} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:13:04.723523 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007dae6c-2fc2-4536-adc6-73ad8a53fbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b900d676-b354-430c-989f-5af736d0f732', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:04.738592 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521ed07c-0ed6-4cb6-acfc-7cbf60813b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:04.761407 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Volume volume-b900d676-b354-430c-989f-5af736d0f732 (b900d676-b354-430c-989f-5af736d0f732): created successfully Mar 05 21:13:04.766154 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521ed07c-0ed6-4cb6-acfc-7cbf60813b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:04.777098 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Flow 'volume_create_manager' (eec3e0cd-8475-409d-9e18-d20f93f30822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:13:04.810061 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-7ca86c45-5ee2-46d8-a1b8-a8e4a8f902b5 tempest-GroupSnapshotsTest-1430122540 None] Created volume successfully. Mar 05 21:13:05.820057 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6d1c8303-7405-49e5-a0d6-97ccdb6460ed tempest-GroupSnapshotsTest-1430122540 None] GroupSnapshot 0502c670-29b0-4df5-a42f-188d11dcfeb4: creating. Mar 05 21:13:05.869149 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6d1c8303-7405-49e5-a0d6-97ccdb6460ed tempest-GroupSnapshotsTest-1430122540 None] Group snapshot 0502c670-29b0-4df5-a42f-188d11dcfeb4: creating. {{(pid=134747) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Mar 05 21:13:05.924484 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6d1c8303-7405-49e5-a0d6-97ccdb6460ed tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:07.310383 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6d1c8303-7405-49e5-a0d6-97ccdb6460ed tempest-GroupSnapshotsTest-1430122540 None] group_snapshot 0502c670-29b0-4df5-a42f-188d11dcfeb4: created successfully Mar 05 21:13:09.177961 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6ac2935e-cd13-41eb-9afc-1fea82e0771e tempest-GroupSnapshotsTest-1430122540 None] cloning volumes/volume-b900d676-b354-430c-989f-5af736d0f732@snapshot-f4e55d17-f7e6-454b-b112-fa9f90a61333 to volume-b7c88bf5-e6ce-42e6-ac1a-84a174b16736 {{(pid=134747) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Mar 05 21:13:09.181840 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6ac2935e-cd13-41eb-9afc-1fea82e0771e tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:09.283096 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6ac2935e-cd13-41eb-9afc-1fea82e0771e tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:09.574065 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6ac2935e-cd13-41eb-9afc-1fea82e0771e tempest-GroupSnapshotsTest-1430122540 None] extra_specs: {} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:13:09.574580 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6ac2935e-cd13-41eb-9afc-1fea82e0771e tempest-GroupSnapshotsTest-1430122540 None] extra_specs: {} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:13:09.581417 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6ac2935e-cd13-41eb-9afc-1fea82e0771e tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:09.656129 ncdv-master-1 cinder-volume[134747]: WARNING cinder.volume.drivers.rbd [None req-6ac2935e-cd13-41eb-9afc-1fea82e0771e tempest-GroupSnapshotsTest-1430122540 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError Mar 05 21:13:09.869185 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6ac2935e-cd13-41eb-9afc-1fea82e0771e tempest-GroupSnapshotsTest-1430122540 None] Create group from source-snapshot-0502c670-29b0-4df5-a42f-188d11dcfeb4 completed successfully. Mar 05 21:13:11.207101 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8c77953f-d5a7-4001-8480-32748c87433d tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:11.364585 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8c77953f-d5a7-4001-8480-32748c87433d tempest-GroupSnapshotsTest-1430122540 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:13:11.378141 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8c77953f-d5a7-4001-8480-32748c87433d tempest-GroupSnapshotsTest-1430122540 None] deleting rbd volume volume-b7c88bf5-e6ce-42e6-ac1a-84a174b16736 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:13:11.891689 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-8c77953f-d5a7-4001-8480-32748c87433d tempest-GroupSnapshotsTest-1430122540 None] Created reservations ['1ccb557b-0b2a-4620-9f21-3b57926ef105'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:11.925935 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-8c77953f-d5a7-4001-8480-32748c87433d tempest-GroupSnapshotsTest-1430122540 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-423220790 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-423220790, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:13:11.927108 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-8c77953f-d5a7-4001-8480-32748c87433d tempest-GroupSnapshotsTest-1430122540 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-423220790 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-423220790, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:13:11.948518 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-8c77953f-d5a7-4001-8480-32748c87433d tempest-GroupSnapshotsTest-1430122540 None] Created reservations ['dab11a38-1664-42d7-8b19-fa4ea5f53f65', 'af95085b-c69c-4e11-96e7-9c25ed336eb9', '76359f0d-1d71-4d0d-bb49-1c3fbdc83cb2', 'cb820361-127a-4842-9e68-b461e1716760'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:12.133167 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8c77953f-d5a7-4001-8480-32748c87433d tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:12.219352 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8c77953f-d5a7-4001-8480-32748c87433d tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:12.317418 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-8c77953f-d5a7-4001-8480-32748c87433d tempest-GroupSnapshotsTest-1430122540 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:13:12.323346 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8c77953f-d5a7-4001-8480-32748c87433d tempest-GroupSnapshotsTest-1430122540 None] Delete group completed successfully. Mar 05 21:13:12.485236 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-da293d37-88b7-40bd-b0f2-e8730237dcd0 tempest-GroupSnapshotsTest-1430122540 None] group_snapshot 0502c670-29b0-4df5-a42f-188d11dcfeb4: deleting Mar 05 21:13:12.520896 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-da293d37-88b7-40bd-b0f2-e8730237dcd0 tempest-GroupSnapshotsTest-1430122540 None] group_snapshot 0502c670-29b0-4df5-a42f-188d11dcfeb4: deleting {{(pid=134747) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Mar 05 21:13:12.571623 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-da293d37-88b7-40bd-b0f2-e8730237dcd0 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:13.371775 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-da293d37-88b7-40bd-b0f2-e8730237dcd0 tempest-GroupSnapshotsTest-1430122540 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-423220790 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-423220790, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:13:13.426570 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-da293d37-88b7-40bd-b0f2-e8730237dcd0 tempest-GroupSnapshotsTest-1430122540 None] Created reservations ['2ca9f424-2321-4b6d-ac88-e7b4f3505b74', '90048184-a97f-49ef-b208-dddc632edfd9', '0d38a2f6-19e2-4699-ba5f-e03e3105f89a', '374b8144-913a-4cd0-a6a2-af8ba1dea16f'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:13.522588 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-da293d37-88b7-40bd-b0f2-e8730237dcd0 tempest-GroupSnapshotsTest-1430122540 None] group_snapshot 0502c670-29b0-4df5-a42f-188d11dcfeb4: deleted successfully Mar 05 21:13:14.287920 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-95c8cf20-ad3b-4c37-8ce2-8e9ae10c02c2 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:14.380289 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-95c8cf20-ad3b-4c37-8ce2-8e9ae10c02c2 tempest-GroupSnapshotsTest-1430122540 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:13:14.382186 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-95c8cf20-ad3b-4c37-8ce2-8e9ae10c02c2 tempest-GroupSnapshotsTest-1430122540 None] Volume volume-b900d676-b354-430c-989f-5af736d0f732 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:13:14.395861 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-95c8cf20-ad3b-4c37-8ce2-8e9ae10c02c2 tempest-GroupSnapshotsTest-1430122540 None] deleting rbd volume volume-b900d676-b354-430c-989f-5af736d0f732 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:13:14.854875 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-95c8cf20-ad3b-4c37-8ce2-8e9ae10c02c2 tempest-GroupSnapshotsTest-1430122540 None] Created reservations ['f1c284be-484a-493e-ac73-65f66a797892'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:14.898559 ncdv-master-1 cinder-volume[134747]: WARNING cinder.db.sqlalchemy.api [None req-95c8cf20-ad3b-4c37-8ce2-8e9ae10c02c2 tempest-GroupSnapshotsTest-1430122540 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-423220790'] Mar 05 21:13:14.907126 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-95c8cf20-ad3b-4c37-8ce2-8e9ae10c02c2 tempest-GroupSnapshotsTest-1430122540 None] Created reservations ['186c7365-6fa1-4e2e-85f2-853cd7a4113a', '47bd139c-13fd-4d47-81dd-fb8116e10d27', '5c0bfa48-b8d1-4c33-9f8a-f88c2a5e1f72', '877f437e-4aa7-4892-9147-503216db9cc5'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:15.101453 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-95c8cf20-ad3b-4c37-8ce2-8e9ae10c02c2 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:15.177869 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-95c8cf20-ad3b-4c37-8ce2-8e9ae10c02c2 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:15.299248 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-95c8cf20-ad3b-4c37-8ce2-8e9ae10c02c2 tempest-GroupSnapshotsTest-1430122540 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:13:15.303441 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-95c8cf20-ad3b-4c37-8ce2-8e9ae10c02c2 tempest-GroupSnapshotsTest-1430122540 None] Delete group completed successfully. Mar 05 21:13:16.005870 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-bfb9f514-49c5-4ad8-8852-c6402eeb384f tempest-GroupSnapshotsTest-1430122540 None] Group tempest-GroupSnapshotsTest-Group-904263310: creating Mar 05 21:13:16.026107 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-bfb9f514-49c5-4ad8-8852-c6402eeb384f tempest-GroupSnapshotsTest-1430122540 None] Group tempest-GroupSnapshotsTest-Group-904263310: created successfully Mar 05 21:13:16.034506 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-bfb9f514-49c5-4ad8-8852-c6402eeb384f tempest-GroupSnapshotsTest-1430122540 None] Create group completed successfully. Mar 05 21:13:17.793336 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:13:17.800602 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:13:17.801362 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:13:17.829898 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Flow 'volume_create_manager' (e3b8cfd1-30b3-4791-8de3-d108e6e4a2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:13:17.836849 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27eb2227-2dfa-4795-bd03-06e9b41aaf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:17.844716 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:13:17.862443 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27eb2227-2dfa-4795-bd03-06e9b41aaf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1457150440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ba8286c-d2a5-49d3-9735-eb18d5f299a9,host='ncdv-master-1@ceph#ceph',id=904adb6e-500c-4882-a458-a305a2730c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e437b46d75485cb231d9a73fb90e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:13:18Z,use_quota=True,user_id='d14b9b77c3ed4b3b81671fe7f90f23d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e0a5c43-213e-48e1-a999-9b0ea9b0edcf),volume_type_id=0e0a5c43-213e-48e1-a999-9b0ea9b0edcf)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:17.871056 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa827f99-1329-4ad1-9223-f115e7de738e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:17.879443 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa827f99-1329-4ad1-9223-f115e7de738e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:17.886988 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdd2a25-a8d6-40e3-a543-9d3c62f155fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:17.892068 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdd2a25-a8d6-40e3-a543-9d3c62f155fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '904adb6e-500c-4882-a458-a305a2730c24', 'volume_name': 'volume-904adb6e-500c-4882-a458-a305a2730c24', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:17.898230 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed904cc9-7192-46b4-b2e2-32e74f675e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:17.903609 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed904cc9-7192-46b4-b2e2-32e74f675e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:17.910893 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab703b7-cfdf-4c76-a142-a6f3da44c36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:17.912435 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Volume 904adb6e-500c-4882-a458-a305a2730c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-904adb6e-500c-4882-a458-a305a2730c24', 'volume_size': 1} Mar 05 21:13:17.912984 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] creating volume 'volume-904adb6e-500c-4882-a458-a305a2730c24' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:13:17.914203 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:17.998946 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] extra_specs: {} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:13:17.999337 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] extra_specs: {} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:13:18.003195 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab703b7-cfdf-4c76-a142-a6f3da44c36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-904adb6e-500c-4882-a458-a305a2730c24', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:18.008031 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0c6b24-31f6-4e1a-9ae9-f370217f337e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:18.018843 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Volume volume-904adb6e-500c-4882-a458-a305a2730c24 (904adb6e-500c-4882-a458-a305a2730c24): created successfully Mar 05 21:13:18.023135 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0c6b24-31f6-4e1a-9ae9-f370217f337e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:18.030107 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Flow 'volume_create_manager' (e3b8cfd1-30b3-4791-8de3-d108e6e4a2f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:13:18.041807 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-a78e8705-86ad-4ebe-bbf7-52f20d49874a tempest-GroupSnapshotsTest-1430122540 None] Created volume successfully. Mar 05 21:13:19.388379 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:13:19.392944 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:13:19.393602 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:13:19.420634 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Flow 'volume_create_manager' (d6b4cba1-fdfb-436b-ad31-6c919da9646e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:13:19.440907 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2121e80f-b180-4edf-a920-d9fc69429c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:19.449240 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:13:19.475724 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2121e80f-b180-4edf-a920-d9fc69429c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-817663366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ba8286c-d2a5-49d3-9735-eb18d5f299a9,host='ncdv-master-1@ceph#ceph',id=c0456e2f-375b-493b-a76a-a50588167e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e437b46d75485cb231d9a73fb90e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:13:19Z,use_quota=True,user_id='d14b9b77c3ed4b3b81671fe7f90f23d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e0a5c43-213e-48e1-a999-9b0ea9b0edcf),volume_type_id=0e0a5c43-213e-48e1-a999-9b0ea9b0edcf)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:19.484277 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02bb953e-9e0d-44c9-a87d-155732951a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:19.501437 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02bb953e-9e0d-44c9-a87d-155732951a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:19.507776 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71484566-4d14-4b20-b8fc-fdcbb528776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:19.515276 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71484566-4d14-4b20-b8fc-fdcbb528776d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0456e2f-375b-493b-a76a-a50588167e65', 'volume_name': 'volume-c0456e2f-375b-493b-a76a-a50588167e65', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:19.522127 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61872e9e-4a20-499b-92c3-073474ac30fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:19.526992 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61872e9e-4a20-499b-92c3-073474ac30fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:19.536679 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00911f1e-e9d8-4b21-b53a-b124ede55a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:19.538066 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Volume c0456e2f-375b-493b-a76a-a50588167e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0456e2f-375b-493b-a76a-a50588167e65', 'volume_size': 1} Mar 05 21:13:19.538583 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] creating volume 'volume-c0456e2f-375b-493b-a76a-a50588167e65' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:13:19.540443 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:19.629892 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] extra_specs: {} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:13:19.631071 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] extra_specs: {} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:13:19.635412 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00911f1e-e9d8-4b21-b53a-b124ede55a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0456e2f-375b-493b-a76a-a50588167e65', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:19.641858 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de64cbe8-fd21-4ddc-92dc-14fac6c0ec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:19.654296 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Volume volume-c0456e2f-375b-493b-a76a-a50588167e65 (c0456e2f-375b-493b-a76a-a50588167e65): created successfully Mar 05 21:13:19.658722 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de64cbe8-fd21-4ddc-92dc-14fac6c0ec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:19.666913 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Flow 'volume_create_manager' (d6b4cba1-fdfb-436b-ad31-6c919da9646e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:13:19.677362 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-edbad9a1-174f-4a82-adba-1ff6bc094678 tempest-GroupSnapshotsTest-1430122540 None] Created volume successfully. Mar 05 21:13:20.751915 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-2c00dc94-adea-4c80-bea9-f3c4331a8a5c tempest-GroupSnapshotsTest-1430122540 None] Update group completed successfully. Mar 05 21:13:21.304641 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-e9f51d6c-0fd9-489d-aacb-a86ccab332f2 req-bf626a4a-0002-484e-b0bb-fdb4572676cc tempest-AttachVolumeShelveTestJSON-1318940295 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:13:21.371404 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-4516f75f-3ba6-40b5-ba3a-c2b5d3dd4fb8 tempest-VolumesActionsTest-1075133775 None] Lock "b'cinder-c892a60c-7706-469a-ba8c-f52ad4e0338b'" acquired by "attach_volume" :: waited 0.030s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:13:21.449781 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-4516f75f-3ba6-40b5-ba3a-c2b5d3dd4fb8 tempest-VolumesActionsTest-1075133775 None] Attaching volume c892a60c-7706-469a-ba8c-f52ad4e0338b to instance eade4ef9-e6d1-4f9c-82be-8616813b5aef at mountpoint /dev/sdb on host None. Mar 05 21:13:21.522163 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-4516f75f-3ba6-40b5-ba3a-c2b5d3dd4fb8 tempest-VolumesActionsTest-1075133775 None] Attach volume completed successfully. Mar 05 21:13:21.533769 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-4516f75f-3ba6-40b5-ba3a-c2b5d3dd4fb8 tempest-VolumesActionsTest-1075133775 None] Lock "b'cinder-c892a60c-7706-469a-ba8c-f52ad4e0338b'" released by "attach_volume" :: held 0.162s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:13:21.737991 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b71ce436-be23-4035-ace1-607a35eae050 tempest-VolumesActionsTest-1075133775 None] Lock "b'cinder-c892a60c-7706-469a-ba8c-f52ad4e0338b-detach_volume'" acquired by "detach_volume" :: waited 0.008s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:13:21.738484 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b71ce436-be23-4035-ace1-607a35eae050 tempest-VolumesActionsTest-1075133775 None] Detaching volume c892a60c-7706-469a-ba8c-f52ad4e0338b from instance eade4ef9-e6d1-4f9c-82be-8616813b5aef. Mar 05 21:13:21.812509 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b71ce436-be23-4035-ace1-607a35eae050 tempest-VolumesActionsTest-1075133775 None] Detach volume completed successfully. Mar 05 21:13:21.818333 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b71ce436-be23-4035-ace1-607a35eae050 tempest-VolumesActionsTest-1075133775 None] Lock "b'cinder-c892a60c-7706-469a-ba8c-f52ad4e0338b-detach_volume'" released by "detach_volume" :: held 0.080s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:13:22.266579 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-1d04ca4f-3381-4438-b071-32e1c52bebe0 tempest-GroupSnapshotsTest-1430122540 None] Update group completed successfully. Mar 05 21:13:22.749794 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-e9f51d6c-0fd9-489d-aacb-a86ccab332f2 req-bf626a4a-0002-484e-b0bb-fdb4572676cc tempest-AttachVolumeShelveTestJSON-1318940295 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.446s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:13:22.751065 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-e9f51d6c-0fd9-489d-aacb-a86ccab332f2 req-bf626a4a-0002-484e-b0bb-fdb4572676cc tempest-AttachVolumeShelveTestJSON-1318940295 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e28a20a7-45f6-4921-9f87-076085057103', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'e28a20a7-45f6-4921-9f87-076085057103', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:13:22.798655 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-e9f51d6c-0fd9-489d-aacb-a86ccab332f2 req-bf626a4a-0002-484e-b0bb-fdb4572676cc tempest-AttachVolumeShelveTestJSON-1318940295 None] Connection info returned from driver {'name': 'volumes/volume-e28a20a7-45f6-4921-9f87-076085057103', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e28a20a7-45f6-4921-9f87-076085057103', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3b6ef4c4-7613-46a6-8821-7ce67f72b3af'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:13:22.973217 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-e9f51d6c-0fd9-489d-aacb-a86ccab332f2 req-bf626a4a-0002-484e-b0bb-fdb4572676cc tempest-AttachVolumeShelveTestJSON-1318940295 None] attachment_update completed successfully. Mar 05 21:13:23.515086 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8d4b45c3-1234-470e-aefd-45612a1899ba tempest-GroupSnapshotsTest-1430122540 None] Update group completed successfully. Mar 05 21:13:24.515335 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-2b8adbd6-e22a-49cf-847b-2eb31aa68bea req-e34a8eed-298c-446e-8288-d95fce250254 tempest-AttachVolumeNegativeTest-1565771773 None] Terminate volume connection completed successfully. Mar 05 21:13:24.515931 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-2b8adbd6-e22a-49cf-847b-2eb31aa68bea req-e34a8eed-298c-446e-8288-d95fce250254 tempest-AttachVolumeNegativeTest-1565771773 None] Deleting attachment dc2ef730-7790-481d-bb37-8224b73b0f9f. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:13:24.953946 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-da4606c6-0908-4f2c-80e5-36abf8b4324d tempest-GroupSnapshotsTest-1430122540 None] Update group completed successfully. Mar 05 21:13:25.183744 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:13:25.204128 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:13:25.204867 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:13:25.244750 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Flow 'volume_create_manager' (46ce95d2-4881-4fb8-a752-ceb8c246b3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:13:25.253148 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99811cc2-9056-49ca-866c-642e10397a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:25.267220 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:13:25.314678 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99811cc2-9056-49ca-866c-642e10397a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1700270841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6ce293e8-05a2-45e3-8bc8-bcff8368f16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa832ddc5a8c41608563cac2bebb8e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:13:25Z,use_quota=True,user_id='f6601c3201374e4aad637374f4d44e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:25.327975 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8fcd2fa-5f81-4c0b-974b-1ca3bdb87814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:25.339053 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8fcd2fa-5f81-4c0b-974b-1ca3bdb87814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:25.353729 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142a363d-09ce-49e1-b6a4-58ee45a28ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:25.509206 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142a363d-09ce-49e1-b6a4-58ee45a28ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ce293e8-05a2-45e3-8bc8-bcff8368f16d', 'volume_name': 'volume-6ce293e8-05a2-45e3-8bc8-bcff8368f16d', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:25.519231 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aea5878-be59-4593-82fa-8a149bdb5c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:25.525058 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aea5878-be59-4593-82fa-8a149bdb5c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:25.531735 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd4c13b-e91d-4647-9305-57a99e5574df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:25.532925 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Volume 6ce293e8-05a2-45e3-8bc8-bcff8368f16d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ce293e8-05a2-45e3-8bc8-bcff8368f16d', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 21:13:25.533781 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Cloning 6ce293e8-05a2-45e3-8bc8-bcff8368f16d from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 21:13:25.546536 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:13:25.559438 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 13, 25, 552678)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:13:25.561097 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:13:25.561930 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Found cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 05 21:13:25.567143 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 0.021s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:13:25.568531 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 21:13:25.585294 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 13, 25, 582044)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:13:25.585734 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:13:25.587226 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Creating from source image-volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7 {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 05 21:13:25.602915 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:25.686080 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] creating snapshot='volume-6ce293e8-05a2-45e3-8bc8-bcff8368f16d.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 21:13:26.198169 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] cloning 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7@volume-6ce293e8-05a2-45e3-8bc8-bcff8368f16d.clone_snap' to 'volume-6ce293e8-05a2-45e3-8bc8-bcff8368f16d' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 21:13:26.413096 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a.deleted is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:13:26.414796 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:13:26.415790 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:13:26.448229 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 21:13:26.449311 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Marking volume 6ce293e8-05a2-45e3-8bc8-bcff8368f16d as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 21:13:26.461811 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to 6ce293e8-05a2-45e3-8bc8-bcff8368f16d. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 21:13:26.463579 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Creating volume glance metadata for volume 6ce293e8-05a2-45e3-8bc8-bcff8368f16d backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 21:13:26.542243 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ad02176e-aabe-4eaf-b28a-0d2d685b5c4b tempest-GroupSnapshotsTest-1430122540 None] GroupSnapshot 4e26ce0c-7275-4b8f-ab19-6fe468722287: creating. Mar 05 21:13:26.581690 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd4c13b-e91d-4647-9305-57a99e5574df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce293e8-05a2-45e3-8bc8-bcff8368f16d', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:26.588196 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98250ff8-af37-48d3-bd8c-cb4d72ad6a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:26.599783 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad02176e-aabe-4eaf-b28a-0d2d685b5c4b tempest-GroupSnapshotsTest-1430122540 None] Group snapshot 4e26ce0c-7275-4b8f-ab19-6fe468722287: creating. {{(pid=134747) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Mar 05 21:13:26.604058 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Volume volume-6ce293e8-05a2-45e3-8bc8-bcff8368f16d (6ce293e8-05a2-45e3-8bc8-bcff8368f16d): created successfully Mar 05 21:13:26.608631 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98250ff8-af37-48d3-bd8c-cb4d72ad6a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:26.614746 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Flow 'volume_create_manager' (46ce95d2-4881-4fb8-a752-ceb8c246b3ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:13:26.637102 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ad02176e-aabe-4eaf-b28a-0d2d685b5c4b tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:26.705863 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f3a200fb-f5e2-4f84-bbe7-9405e3ff642a tempest-VolumesImageMetadata-398329222 None] Created volume successfully. Mar 05 21:13:27.741273 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ad02176e-aabe-4eaf-b28a-0d2d685b5c4b tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:27.948103 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-20c59fcc-8f62-4b2d-9bcf-f06d7a45ece6 tempest-VolumesImageMetadata-398329222 None] Lock "b'cinder-6ce293e8-05a2-45e3-8bc8-bcff8368f16d-delete_volume'" acquired by "delete_volume" :: waited 0.061s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:13:28.057006 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-20c59fcc-8f62-4b2d-9bcf-f06d7a45ece6 tempest-VolumesImageMetadata-398329222 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:28.230060 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-20c59fcc-8f62-4b2d-9bcf-f06d7a45ece6 tempest-VolumesImageMetadata-398329222 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:13:28.250849 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-20c59fcc-8f62-4b2d-9bcf-f06d7a45ece6 tempest-VolumesImageMetadata-398329222 None] deleting rbd volume volume-6ce293e8-05a2-45e3-8bc8-bcff8368f16d {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:13:28.643431 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-20c59fcc-8f62-4b2d-9bcf-f06d7a45ece6 tempest-VolumesImageMetadata-398329222 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 21:13:28.751185 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-20c59fcc-8f62-4b2d-9bcf-f06d7a45ece6 tempest-VolumesImageMetadata-398329222 None] deleting parent snapshot volume-6ce293e8-05a2-45e3-8bc8-bcff8368f16d.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 21:13:29.826389 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-20c59fcc-8f62-4b2d-9bcf-f06d7a45ece6 tempest-VolumesImageMetadata-398329222 None] Created reservations ['5c593184-c3b5-440f-83bb-ed42553f6dc0', 'd34aefbc-2321-4d55-8007-a47fe541d05c', '5cc42d82-c6c1-41bc-b2a7-68de42da8cc1', '0d6c2f83-c0f5-4eb3-8f46-b75330b2bc23'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:29.923869 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-20c59fcc-8f62-4b2d-9bcf-f06d7a45ece6 tempest-VolumesImageMetadata-398329222 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:29.983129 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-20c59fcc-8f62-4b2d-9bcf-f06d7a45ece6 tempest-VolumesImageMetadata-398329222 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:30.056181 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-20c59fcc-8f62-4b2d-9bcf-f06d7a45ece6 tempest-VolumesImageMetadata-398329222 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:13:30.078919 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-20c59fcc-8f62-4b2d-9bcf-f06d7a45ece6 tempest-VolumesImageMetadata-398329222 None] Deleted volume successfully. Mar 05 21:13:30.135782 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-20c59fcc-8f62-4b2d-9bcf-f06d7a45ece6 tempest-VolumesImageMetadata-398329222 None] Lock "b'cinder-6ce293e8-05a2-45e3-8bc8-bcff8368f16d-delete_volume'" released by "delete_volume" :: held 2.188s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:13:30.161670 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ad02176e-aabe-4eaf-b28a-0d2d685b5c4b tempest-GroupSnapshotsTest-1430122540 None] group_snapshot 4e26ce0c-7275-4b8f-ab19-6fe468722287: created successfully Mar 05 21:13:31.054049 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-bbbd90c3-1e7a-48ad-8b59-b58091e35e96 tempest-GroupSnapshotsTest-1430122540 None] group_snapshot 4e26ce0c-7275-4b8f-ab19-6fe468722287: deleting Mar 05 21:13:31.120040 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-bbbd90c3-1e7a-48ad-8b59-b58091e35e96 tempest-GroupSnapshotsTest-1430122540 None] group_snapshot 4e26ce0c-7275-4b8f-ab19-6fe468722287: deleting {{(pid=134747) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Mar 05 21:13:31.156652 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-bbbd90c3-1e7a-48ad-8b59-b58091e35e96 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:31.802209 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-bbbd90c3-1e7a-48ad-8b59-b58091e35e96 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:32.998180 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-bbbd90c3-1e7a-48ad-8b59-b58091e35e96 tempest-GroupSnapshotsTest-1430122540 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-390818332 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-390818332, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:13:32.999023 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-bbbd90c3-1e7a-48ad-8b59-b58091e35e96 tempest-GroupSnapshotsTest-1430122540 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-390818332 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-390818332, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:13:33.077086 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-bbbd90c3-1e7a-48ad-8b59-b58091e35e96 tempest-GroupSnapshotsTest-1430122540 None] Created reservations ['99d172f9-8c8a-4d17-ab41-a388b93ec768', '9b1cb539-8311-4407-b1f6-01b649fd656e', 'c1ced503-b226-47ef-b8ef-53e727bbb5a5', 'b03a6f07-97c7-43c7-be81-ffc17c14b86b'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:33.270671 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-bbbd90c3-1e7a-48ad-8b59-b58091e35e96 tempest-GroupSnapshotsTest-1430122540 None] Created reservations ['cc47c06c-ae9e-4f3d-a26b-e86b07037ba9', '394b3f2f-55cb-467d-854f-35fd83438b84', '9ae08261-cb27-4f36-9415-a0343147ac98', '93c10371-a6ba-4809-8058-e3758b7767ec'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:33.384547 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-bbbd90c3-1e7a-48ad-8b59-b58091e35e96 tempest-GroupSnapshotsTest-1430122540 None] group_snapshot 4e26ce0c-7275-4b8f-ab19-6fe468722287: deleted successfully Mar 05 21:13:34.490756 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:34.609957 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:13:34.610678 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] Volume volume-904adb6e-500c-4882-a458-a305a2730c24 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:13:34.622429 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] deleting rbd volume volume-904adb6e-500c-4882-a458-a305a2730c24 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:13:35.061777 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:35.164818 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:13:35.165275 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] Volume volume-c0456e2f-375b-493b-a76a-a50588167e65 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:13:35.176755 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] deleting rbd volume volume-c0456e2f-375b-493b-a76a-a50588167e65 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:13:35.713233 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] Created reservations ['4aae6ff9-94ea-4839-be06-e78e9ce8ab9a'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:35.785964 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-390818332 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-390818332, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:13:35.793872 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:13:35.798316 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:13:35.799032 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:13:35.826373 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Flow 'volume_create_manager' (a5b98f75-c6a6-4680-8ff9-f4d699577329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:13:35.834945 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22752130-dc06-4f91-9e2b-cfc5d778288f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:35.846831 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:13:35.875129 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22752130-dc06-4f91-9e2b-cfc5d778288f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-692841482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e84f04a8-be34-4486-bdd8-9e937a491071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887fb3d0d7634607b0fb6283496d1ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:13:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:13:36Z,use_quota=True,user_id='f1081ade8cdf4e9b907565b5bfab5c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:35.881572 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fffd22f9-0686-48c4-948e-469c74600031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:35.894237 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fffd22f9-0686-48c4-948e-469c74600031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:35.900476 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f19aa1-1061-478b-90f0-abea3ea0acda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:35.912994 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f19aa1-1061-478b-90f0-abea3ea0acda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84f04a8-be34-4486-bdd8-9e937a491071', 'volume_name': 'volume-e84f04a8-be34-4486-bdd8-9e937a491071', 'volume_size': 2}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:35.919119 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7058dc-fcef-4132-b219-adfdba7402e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:35.923830 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7058dc-fcef-4132-b219-adfdba7402e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:35.929206 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a40163-3b51-481b-8bea-68066c540f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:35.931228 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Volume e84f04a8-be34-4486-bdd8-9e937a491071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84f04a8-be34-4486-bdd8-9e937a491071', 'volume_size': 2} Mar 05 21:13:35.931888 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] creating volume 'volume-e84f04a8-be34-4486-bdd8-9e937a491071' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:13:35.933155 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:36.012601 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] Created reservations ['cce1af02-c5ff-4af0-b1f4-031433889f35', '5121def9-641e-4241-a6cf-4203f22169da', '8a2d49e2-2cc4-41eb-abb5-dda8649e9ac6', 'e96f4c52-1886-4722-8c6b-19e334f3f45c'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:36.128045 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:13:36.128773 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:13:36.132790 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a40163-3b51-481b-8bea-68066c540f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84f04a8-be34-4486-bdd8-9e937a491071', 'volume_size': 2}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:36.146513 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe6df01-21d3-4df1-be88-6d163066fb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:36.278348 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Volume volume-e84f04a8-be34-4486-bdd8-9e937a491071 (e84f04a8-be34-4486-bdd8-9e937a491071): created successfully Mar 05 21:13:36.292231 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe6df01-21d3-4df1-be88-6d163066fb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:36.301759 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Flow 'volume_create_manager' (a5b98f75-c6a6-4680-8ff9-f4d699577329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:13:36.322348 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] Created reservations ['77ba9bf8-04e0-4c7c-97f6-8d69230f170e', '2174c1ee-41af-4ef9-bde8-97fea8bc8a7f', '973a1125-279f-4823-a718-d305c7ec7d5f', '5a8c9aa2-bb7b-4a95-8b27-885dfb86533a'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:36.333344 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f8fc021e-3b13-4bb1-a049-749f921dcd9f tempest-VolumesCloneNegativeTest-1642718031 None] Created volume successfully. Mar 05 21:13:36.506444 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:36.564660 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:36.642554 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:13:36.647459 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-71321169-513e-4baf-8dee-988b597bd5f7 tempest-GroupSnapshotsTest-1430122540 None] Delete group completed successfully. Mar 05 21:13:37.065512 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ed36f626-ec94-45cb-b53e-7c7133743348 tempest-VolumesCloneNegativeTest-1642718031 None] Lock "b'cinder-e84f04a8-be34-4486-bdd8-9e937a491071-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:13:37.146661 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ed36f626-ec94-45cb-b53e-7c7133743348 tempest-VolumesCloneNegativeTest-1642718031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:37.236425 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ed36f626-ec94-45cb-b53e-7c7133743348 tempest-VolumesCloneNegativeTest-1642718031 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:13:37.237354 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ed36f626-ec94-45cb-b53e-7c7133743348 tempest-VolumesCloneNegativeTest-1642718031 None] Volume volume-e84f04a8-be34-4486-bdd8-9e937a491071 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:13:37.246439 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ed36f626-ec94-45cb-b53e-7c7133743348 tempest-VolumesCloneNegativeTest-1642718031 None] deleting rbd volume volume-e84f04a8-be34-4486-bdd8-9e937a491071 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:13:37.453196 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-796f7746-4748-4b56-b666-9e2b66c2b967 tempest-GroupSnapshotsTest-1430122540 None] Group tempest-GroupSnapshotsTest-Group-500240886: creating Mar 05 21:13:37.492533 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-796f7746-4748-4b56-b666-9e2b66c2b967 tempest-GroupSnapshotsTest-1430122540 None] Group tempest-GroupSnapshotsTest-Group-500240886: created successfully Mar 05 21:13:37.521396 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-796f7746-4748-4b56-b666-9e2b66c2b967 tempest-GroupSnapshotsTest-1430122540 None] Create group completed successfully. Mar 05 21:13:37.666046 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-ed36f626-ec94-45cb-b53e-7c7133743348 tempest-VolumesCloneNegativeTest-1642718031 None] Created reservations ['7ad28dd7-0e05-406a-b463-abc57b712b15', '701c25bd-7b00-4673-b5da-5bb6aee67879', '8c77f140-4313-4005-a294-9b244200cb1a', '7d6beb01-8b65-44ea-90b8-b2971043d951'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:37.768365 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ed36f626-ec94-45cb-b53e-7c7133743348 tempest-VolumesCloneNegativeTest-1642718031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:37.836996 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ed36f626-ec94-45cb-b53e-7c7133743348 tempest-VolumesCloneNegativeTest-1642718031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:37.897498 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-ed36f626-ec94-45cb-b53e-7c7133743348 tempest-VolumesCloneNegativeTest-1642718031 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:13:37.902443 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ed36f626-ec94-45cb-b53e-7c7133743348 tempest-VolumesCloneNegativeTest-1642718031 None] Deleted volume successfully. Mar 05 21:13:37.926344 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ed36f626-ec94-45cb-b53e-7c7133743348 tempest-VolumesCloneNegativeTest-1642718031 None] Lock "b'cinder-e84f04a8-be34-4486-bdd8-9e937a491071-delete_volume'" released by "delete_volume" :: held 0.861s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:13:39.651404 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:13:39.665816 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:13:39.666158 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:13:39.722011 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Flow 'volume_create_manager' (5c590c0b-31b8-4fca-b7bb-dca777cab23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:13:39.729680 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2ba76e-efc9-4c9e-91df-b4915d75db71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:39.757174 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:13:39.790643 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2ba76e-efc9-4c9e-91df-b4915d75db71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1991164708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da69075b-09ce-481d-bdc0-5e9a84a6cecd,host='ncdv-master-1@ceph#ceph',id=a2c00abe-17e2-45cb-b3ab-cfec4c1774c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e437b46d75485cb231d9a73fb90e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:13:40Z,use_quota=True,user_id='d14b9b77c3ed4b3b81671fe7f90f23d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86110c30-c87a-4cf4-979c-0059ae86e817),volume_type_id=86110c30-c87a-4cf4-979c-0059ae86e817)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:39.833639 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a5cc33-2d1d-4887-a8fe-c17c0e241895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:39.842007 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a5cc33-2d1d-4887-a8fe-c17c0e241895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:39.857630 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f836f32-48e6-439d-a739-c3b3d2c3a9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:39.863595 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f836f32-48e6-439d-a739-c3b3d2c3a9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c00abe-17e2-45cb-b3ab-cfec4c1774c0', 'volume_name': 'volume-a2c00abe-17e2-45cb-b3ab-cfec4c1774c0', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:39.877913 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513ac47d-2276-4746-bb6d-2dbb478e0695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:39.882146 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513ac47d-2276-4746-bb6d-2dbb478e0695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:39.911655 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f76bc8d-d3d5-49e5-89f7-8c61a0b6e79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:39.912903 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Volume a2c00abe-17e2-45cb-b3ab-cfec4c1774c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c00abe-17e2-45cb-b3ab-cfec4c1774c0', 'volume_size': 1} Mar 05 21:13:39.913307 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] creating volume 'volume-a2c00abe-17e2-45cb-b3ab-cfec4c1774c0' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:13:39.915196 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:40.068334 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] extra_specs: {} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:13:40.068714 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] extra_specs: {} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:13:40.072578 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f76bc8d-d3d5-49e5-89f7-8c61a0b6e79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c00abe-17e2-45cb-b3ab-cfec4c1774c0', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:40.088165 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4d72eb-978c-4d0a-b881-c8d12a5a488b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:13:40.104164 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Volume volume-a2c00abe-17e2-45cb-b3ab-cfec4c1774c0 (a2c00abe-17e2-45cb-b3ab-cfec4c1774c0): created successfully Mar 05 21:13:40.108744 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4d72eb-978c-4d0a-b881-c8d12a5a488b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:13:40.118030 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Flow 'volume_create_manager' (5c590c0b-31b8-4fca-b7bb-dca777cab23c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:13:40.140944 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-3039e2b9-ccea-4748-9e3c-59a53605b7be tempest-GroupSnapshotsTest-1430122540 None] Created volume successfully. Mar 05 21:13:41.150472 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-abaec933-8956-4229-90e4-0c63e039fae5 tempest-GroupSnapshotsTest-1430122540 None] GroupSnapshot 785ed816-2bf5-4b21-9ee1-a565e67c6442: creating. Mar 05 21:13:41.243128 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-abaec933-8956-4229-90e4-0c63e039fae5 tempest-GroupSnapshotsTest-1430122540 None] Group snapshot 785ed816-2bf5-4b21-9ee1-a565e67c6442: creating. {{(pid=134747) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Mar 05 21:13:41.280848 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-abaec933-8956-4229-90e4-0c63e039fae5 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:42.231392 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-abaec933-8956-4229-90e4-0c63e039fae5 tempest-GroupSnapshotsTest-1430122540 None] group_snapshot 785ed816-2bf5-4b21-9ee1-a565e67c6442: created successfully Mar 05 21:13:42.552138 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-3b61db34-c83b-4454-a051-35db15472e39 tempest-GroupSnapshotsTest-1430122540 None] group_snapshot 785ed816-2bf5-4b21-9ee1-a565e67c6442: deleting Mar 05 21:13:42.583046 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3b61db34-c83b-4454-a051-35db15472e39 tempest-GroupSnapshotsTest-1430122540 None] group_snapshot 785ed816-2bf5-4b21-9ee1-a565e67c6442: deleting {{(pid=134747) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Mar 05 21:13:42.636875 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3b61db34-c83b-4454-a051-35db15472e39 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:43.204441 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-3b61db34-c83b-4454-a051-35db15472e39 tempest-GroupSnapshotsTest-1430122540 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-156778527 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-156778527, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:13:43.205249 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-3b61db34-c83b-4454-a051-35db15472e39 tempest-GroupSnapshotsTest-1430122540 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-156778527 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-156778527, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:13:43.229658 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-3b61db34-c83b-4454-a051-35db15472e39 tempest-GroupSnapshotsTest-1430122540 None] Created reservations ['b9ef3e42-dbae-4f58-a482-523aef40e917', '52cd1285-a70f-4aa3-8fe1-02ddcb32014d', 'ed96be0e-a621-4ccf-b4fd-a17b7fd56765', '48aee018-aece-4401-9a8e-a9dbf0172b82'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:43.311758 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-3b61db34-c83b-4454-a051-35db15472e39 tempest-GroupSnapshotsTest-1430122540 None] group_snapshot 785ed816-2bf5-4b21-9ee1-a565e67c6442: deleted successfully Mar 05 21:13:44.232090 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b64efc47-e4e7-4b8f-8701-f20992dc5d21 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:44.353239 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b64efc47-e4e7-4b8f-8701-f20992dc5d21 tempest-GroupSnapshotsTest-1430122540 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:13:44.353874 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b64efc47-e4e7-4b8f-8701-f20992dc5d21 tempest-GroupSnapshotsTest-1430122540 None] Volume volume-a2c00abe-17e2-45cb-b3ab-cfec4c1774c0 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:13:44.366147 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b64efc47-e4e7-4b8f-8701-f20992dc5d21 tempest-GroupSnapshotsTest-1430122540 None] deleting rbd volume volume-a2c00abe-17e2-45cb-b3ab-cfec4c1774c0 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:13:44.869578 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-b64efc47-e4e7-4b8f-8701-f20992dc5d21 tempest-GroupSnapshotsTest-1430122540 None] Created reservations ['fcd60492-73d9-4d20-978c-0aacc5169a85'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:44.922152 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-b64efc47-e4e7-4b8f-8701-f20992dc5d21 tempest-GroupSnapshotsTest-1430122540 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-156778527 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-156778527, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:13:44.953491 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-b64efc47-e4e7-4b8f-8701-f20992dc5d21 tempest-GroupSnapshotsTest-1430122540 None] Created reservations ['10d4d5fd-d799-4b87-80d1-58daef70514f', 'cf9b1460-6177-4bcc-ac5f-da9e49185052', '7316de07-9513-499f-8c1f-d651bcc940a8', 'c51bdb64-b469-4d8a-8526-cba148769330'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:13:45.151132 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b64efc47-e4e7-4b8f-8701-f20992dc5d21 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:45.201918 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b64efc47-e4e7-4b8f-8701-f20992dc5d21 tempest-GroupSnapshotsTest-1430122540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:45.275003 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-b64efc47-e4e7-4b8f-8701-f20992dc5d21 tempest-GroupSnapshotsTest-1430122540 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:13:45.283513 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b64efc47-e4e7-4b8f-8701-f20992dc5d21 tempest-GroupSnapshotsTest-1430122540 None] Delete group completed successfully. Mar 05 21:13:45.613435 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:13:45.618715 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:45.691475 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:13:45.823234 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:13:52.228464 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-dea3d029-3632-49b5-95a6-c9b1e302c06e tempest-VolumesActionsTest-1075133775 None] Lock "b'cinder-c892a60c-7706-469a-ba8c-f52ad4e0338b'" acquired by "attach_volume" :: waited 0.019s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:13:52.323048 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-dea3d029-3632-49b5-95a6-c9b1e302c06e tempest-VolumesActionsTest-1075133775 None] Attaching volume c892a60c-7706-469a-ba8c-f52ad4e0338b to instance 6cd96e93-68e0-4a43-a639-f7687e332e17 at mountpoint /dev/sdb on host None. Mar 05 21:13:52.369660 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-dea3d029-3632-49b5-95a6-c9b1e302c06e tempest-VolumesActionsTest-1075133775 None] Attach volume completed successfully. Mar 05 21:13:52.378911 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-dea3d029-3632-49b5-95a6-c9b1e302c06e tempest-VolumesActionsTest-1075133775 None] Lock "b'cinder-c892a60c-7706-469a-ba8c-f52ad4e0338b'" released by "attach_volume" :: held 0.156s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:13:52.726932 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-847f5fad-357b-4863-b674-78be6a3c7379 tempest-VolumesActionsTest-1075133775 None] Lock "b'cinder-c892a60c-7706-469a-ba8c-f52ad4e0338b-detach_volume'" acquired by "detach_volume" :: waited 0.017s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:13:52.727414 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-847f5fad-357b-4863-b674-78be6a3c7379 tempest-VolumesActionsTest-1075133775 None] Detaching volume c892a60c-7706-469a-ba8c-f52ad4e0338b from instance 6cd96e93-68e0-4a43-a639-f7687e332e17. Mar 05 21:13:52.821296 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-847f5fad-357b-4863-b674-78be6a3c7379 tempest-VolumesActionsTest-1075133775 None] Detach volume completed successfully. Mar 05 21:13:52.827539 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-847f5fad-357b-4863-b674-78be6a3c7379 tempest-VolumesActionsTest-1075133775 None] Lock "b'cinder-c892a60c-7706-469a-ba8c-f52ad4e0338b-detach_volume'" released by "detach_volume" :: held 0.101s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:13:58.306372 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-b21228c3-0429-4b5f-af0e-3e2fc9f1f102 tempest-VolumesActionsTest-1075133775 None] Running cmd (subprocess): rbd export --pool volumes volume-c892a60c-7706-469a-ba8c-f52ad4e0338b /opt/stack/data/cinder/conversion/volume-c892a60c-7706-469a-ba8c-f52ad4e0338b-8584f74f-d105-41ff-8a86-e1ccb917c839 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:13:59.129792 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-b21228c3-0429-4b5f-af0e-3e2fc9f1f102 tempest-VolumesActionsTest-1075133775 None] CMD "rbd export --pool volumes volume-c892a60c-7706-469a-ba8c-f52ad4e0338b /opt/stack/data/cinder/conversion/volume-c892a60c-7706-469a-ba8c-f52ad4e0338b-8584f74f-d105-41ff-8a86-e1ccb917c839 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.823s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:13:59.141299 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.image_utils [None req-b21228c3-0429-4b5f-af0e-3e2fc9f1f102 tempest-VolumesActionsTest-1075133775 None] 8584f74f-d105-41ff-8a86-e1ccb917c839 was raw, no need to convert to raw {{(pid=134747) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Mar 05 21:14:07.171624 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:14:07.177009 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:14:07.177009 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:14:07.198172 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Flow 'volume_create_manager' (a230ffe7-f419-46db-b05b-dbc678c97330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:14:07.205947 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c03d95a-046f-490d-96cb-5c740832725a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:07.215855 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:14:07.232215 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c03d95a-046f-490d-96cb-5c740832725a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-55222817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8ec980b3-01f1-4ca0-9665-82cf4f202946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f5480304d149b68a03d13795a2926f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:14:07Z,use_quota=True,user_id='68f55e621c614ccea48808fb27a2d65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:07.237985 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3bdc611-a0ef-4e61-ba48-e3ddd4b03a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:07.242526 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3bdc611-a0ef-4e61-ba48-e3ddd4b03a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:07.247960 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7233c46-605e-4d13-8477-b51347697d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:07.253908 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7233c46-605e-4d13-8477-b51347697d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ec980b3-01f1-4ca0-9665-82cf4f202946', 'volume_name': 'volume-8ec980b3-01f1-4ca0-9665-82cf4f202946', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:07.262812 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7f43c5-2c1b-4ce8-91d0-671c14592291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:07.267631 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7f43c5-2c1b-4ce8-91d0-671c14592291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:07.273257 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91db084-a4ab-48c4-a60b-b29f51731958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:07.274784 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Volume 8ec980b3-01f1-4ca0-9665-82cf4f202946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ec980b3-01f1-4ca0-9665-82cf4f202946', 'volume_size': 1} Mar 05 21:14:07.275026 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] creating volume 'volume-8ec980b3-01f1-4ca0-9665-82cf4f202946' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:14:07.276552 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:14:07.402694 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:14:07.403096 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:14:07.408198 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91db084-a4ab-48c4-a60b-b29f51731958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec980b3-01f1-4ca0-9665-82cf4f202946', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:07.416343 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15899f13-e331-445e-95a0-5f314e0d3f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:07.434042 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Volume volume-8ec980b3-01f1-4ca0-9665-82cf4f202946 (8ec980b3-01f1-4ca0-9665-82cf4f202946): created successfully Mar 05 21:14:07.438873 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15899f13-e331-445e-95a0-5f314e0d3f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:07.446335 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Flow 'volume_create_manager' (a230ffe7-f419-46db-b05b-dbc678c97330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:14:07.464145 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-0bba978c-e007-44fa-8ad6-5bdff000d740 tempest-VolumesMetadataTest-513589692 None] Created volume successfully. Mar 05 21:14:09.260676 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-c3b04e89-ac07-4d04-b16d-934908719df7 tempest-VolumesMetadataTest-513589692 None] Lock "b'cinder-8ec980b3-01f1-4ca0-9665-82cf4f202946-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:14:09.353514 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c3b04e89-ac07-4d04-b16d-934908719df7 tempest-VolumesMetadataTest-513589692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:14:09.416948 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c3b04e89-ac07-4d04-b16d-934908719df7 tempest-VolumesMetadataTest-513589692 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:14:09.417552 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c3b04e89-ac07-4d04-b16d-934908719df7 tempest-VolumesMetadataTest-513589692 None] Volume volume-8ec980b3-01f1-4ca0-9665-82cf4f202946 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:14:09.424687 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c3b04e89-ac07-4d04-b16d-934908719df7 tempest-VolumesMetadataTest-513589692 None] deleting rbd volume volume-8ec980b3-01f1-4ca0-9665-82cf4f202946 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:14:09.895254 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-c3b04e89-ac07-4d04-b16d-934908719df7 tempest-VolumesMetadataTest-513589692 None] Created reservations ['423a2ad5-da06-4537-af89-125c50cc87e3', '03a0027f-c801-4928-9c00-4a7e7683b7a2', 'aa031242-ac0c-4b04-9669-6fc08af70c5e', '0b73d3f7-e30f-45a6-a1c8-1ec4910475c2'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:14:09.984840 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c3b04e89-ac07-4d04-b16d-934908719df7 tempest-VolumesMetadataTest-513589692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:14:10.061894 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c3b04e89-ac07-4d04-b16d-934908719df7 tempest-VolumesMetadataTest-513589692 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:14:10.142190 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-c3b04e89-ac07-4d04-b16d-934908719df7 tempest-VolumesMetadataTest-513589692 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:14:10.148483 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c3b04e89-ac07-4d04-b16d-934908719df7 tempest-VolumesMetadataTest-513589692 None] Deleted volume successfully. Mar 05 21:14:10.174311 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-c3b04e89-ac07-4d04-b16d-934908719df7 tempest-VolumesMetadataTest-513589692 None] Lock "b'cinder-8ec980b3-01f1-4ca0-9665-82cf4f202946-delete_volume'" released by "delete_volume" :: held 0.914s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:14:22.669106 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-c29dae9d-38ac-4176-b5b8-634ea6392047 req-1feedfd2-936e-4844-9e9f-13cb98bd23cb tempest-AttachVolumeShelveTestJSON-1318940295 None] Terminate volume connection completed successfully. Mar 05 21:14:22.669848 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-c29dae9d-38ac-4176-b5b8-634ea6392047 req-1feedfd2-936e-4844-9e9f-13cb98bd23cb tempest-AttachVolumeShelveTestJSON-1318940295 None] Deleting attachment 3b6ef4c4-7613-46a6-8821-7ce67f72b3af. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:14:34.938382 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b21228c3-0429-4b5f-af0e-3e2fc9f1f102 tempest-VolumesActionsTest-1075133775 None] Uploaded volume to glance image-id: 8584f74f-d105-41ff-8a86-e1ccb917c839. {{(pid=134747) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1745}} Mar 05 21:14:34.988924 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b21228c3-0429-4b5f-af0e-3e2fc9f1f102 tempest-VolumesActionsTest-1075133775 None] Copy volume to image completed successfully. Mar 05 21:14:35.022328 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:14:35.029559 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:14:35.033144 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:14:35.082565 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Flow 'volume_create_manager' (b111861e-09fb-4d58-bd7e-938019557516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:14:35.093328 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b256ad-4078-454b-8ff3-cea3afdf7925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:35.102114 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:14:35.135910 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b256ad-4078-454b-8ff3-cea3afdf7925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1736719379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=43dd405f-2b5a-46a2-a8e7-5b65271bc344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdcb29011e61419981c5bfc5f10677c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:14:35Z,use_quota=True,user_id='0c07bd2946594c3e8848bca133da0d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:35.147499 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f8cb3d-c17b-4b72-9a2d-923eb0ba7531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:35.159948 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f8cb3d-c17b-4b72-9a2d-923eb0ba7531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:35.175477 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c44e47-2a82-4e6d-b019-febe8c15b3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:35.308114 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c44e47-2a82-4e6d-b019-febe8c15b3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '43dd405f-2b5a-46a2-a8e7-5b65271bc344', 'volume_name': 'volume-43dd405f-2b5a-46a2-a8e7-5b65271bc344', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:35.322447 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67cdbb9-f12c-4c5f-9ec9-798088e2d8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:35.328569 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67cdbb9-f12c-4c5f-9ec9-798088e2d8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:35.344889 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21668cfb-bf7c-46ae-bfd2-d496f16dd280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:35.346177 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Volume 43dd405f-2b5a-46a2-a8e7-5b65271bc344: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-43dd405f-2b5a-46a2-a8e7-5b65271bc344', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 21:14:35.346802 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Cloning 43dd405f-2b5a-46a2-a8e7-5b65271bc344 from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 21:14:35.360727 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:14:35.392002 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 14, 35, 373926)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:14:35.392439 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:14:35.392842 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Found cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 05 21:14:35.399946 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 0.039s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:14:35.400825 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 21:14:35.408183 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 14, 35, 405259)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:14:35.409612 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:14:35.410230 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Creating from source image-volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7 {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 05 21:14:35.464611 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:14:35.637050 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] creating snapshot='volume-43dd405f-2b5a-46a2-a8e7-5b65271bc344.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 21:14:36.493945 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] cloning 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7@volume-43dd405f-2b5a-46a2-a8e7-5b65271bc344.clone_snap' to 'volume-43dd405f-2b5a-46a2-a8e7-5b65271bc344' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 21:14:36.789244 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a.deleted is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:14:36.790449 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:14:36.791474 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:14:36.825344 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 21:14:36.835619 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Marking volume 43dd405f-2b5a-46a2-a8e7-5b65271bc344 as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 21:14:36.840667 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to 43dd405f-2b5a-46a2-a8e7-5b65271bc344. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 21:14:36.841406 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Creating volume glance metadata for volume 43dd405f-2b5a-46a2-a8e7-5b65271bc344 backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 21:14:36.999410 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21668cfb-bf7c-46ae-bfd2-d496f16dd280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43dd405f-2b5a-46a2-a8e7-5b65271bc344', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:37.006860 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037dc48e-a130-40f4-94ef-023a60463fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:37.024821 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Volume volume-43dd405f-2b5a-46a2-a8e7-5b65271bc344 (43dd405f-2b5a-46a2-a8e7-5b65271bc344): created successfully Mar 05 21:14:37.029697 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037dc48e-a130-40f4-94ef-023a60463fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:37.040421 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Flow 'volume_create_manager' (b111861e-09fb-4d58-bd7e-938019557516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:14:37.061449 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-e5f80fd9-27d7-471f-a5ff-60299991f8dc tempest-TestVolumeBootPattern-160921740 None] Created volume successfully. Mar 05 21:14:37.200371 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:14:37.206207 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:14:37.207075 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:14:37.272005 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Flow 'volume_create_manager' (00b7551d-85f1-499d-8d71-56cde0fea69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:14:37.295686 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224eb675-1a6a-4cf0-86fa-e1afe3529f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:37.315784 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:14:37.327504 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-35cde8f9-2b11-4382-9bcb-778eadda0a9f tempest-VolumesActionsTest-1075133775 None] Lock "b'cinder-c892a60c-7706-469a-ba8c-f52ad4e0338b-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:14:37.348743 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224eb675-1a6a-4cf0-86fa-e1afe3529f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1772075629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73f6888043940b9b1344c6998b423da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:14:37Z,use_quota=True,user_id='8bee90d7a5af4246b85ff0cb89217700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:37.356250 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f18aa88-2c3c-4cf0-a2e7-fd30a8a74d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:37.360676 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f18aa88-2c3c-4cf0-a2e7-fd30a8a74d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:37.366751 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9509a37-96fa-4828-9969-b383fe7a296d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:37.371220 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9509a37-96fa-4828-9969-b383fe7a296d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f', 'volume_name': 'volume-1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:37.376879 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046baac9-2bc6-40a7-8ded-532d2595a658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:37.382113 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046baac9-2bc6-40a7-8ded-532d2595a658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:37.387756 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b22afb-845d-499a-ba30-618146eea2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:37.389433 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Volume 1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f', 'volume_size': 1} Mar 05 21:14:37.390065 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] creating volume 'volume-1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:14:37.391338 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:14:37.466079 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-35cde8f9-2b11-4382-9bcb-778eadda0a9f tempest-VolumesActionsTest-1075133775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:14:37.542614 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-35cde8f9-2b11-4382-9bcb-778eadda0a9f tempest-VolumesActionsTest-1075133775 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:14:37.543824 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-35cde8f9-2b11-4382-9bcb-778eadda0a9f tempest-VolumesActionsTest-1075133775 None] Volume volume-c892a60c-7706-469a-ba8c-f52ad4e0338b is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:14:37.558346 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-35cde8f9-2b11-4382-9bcb-778eadda0a9f tempest-VolumesActionsTest-1075133775 None] deleting rbd volume volume-c892a60c-7706-469a-ba8c-f52ad4e0338b {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:14:37.571582 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:14:37.573552 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:14:37.590196 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b22afb-845d-499a-ba30-618146eea2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:37.605655 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b14d323-b550-438e-b6e0-ed3eb9ce870c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:37.620143 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Volume volume-1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f (1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f): created successfully Mar 05 21:14:37.626475 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b14d323-b550-438e-b6e0-ed3eb9ce870c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:37.635986 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Flow 'volume_create_manager' (00b7551d-85f1-499d-8d71-56cde0fea69a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:14:37.653363 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-89ff8da0-b835-4918-9666-35518c39d23f tempest-AttachVolumeNegativeTest-1565771773 None] Created volume successfully. Mar 05 21:14:37.992851 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-35cde8f9-2b11-4382-9bcb-778eadda0a9f tempest-VolumesActionsTest-1075133775 None] Created reservations ['f3fae474-4489-4194-8961-501e78fa307a', '974cadcd-00b0-4ca7-a878-1658be90ae97', 'a7c143d7-3dc2-4e9a-8e6b-2ed71ca39e31', '82673a52-b659-4ca8-a581-6cd6df212e86'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:14:38.059815 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-35cde8f9-2b11-4382-9bcb-778eadda0a9f tempest-VolumesActionsTest-1075133775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:14:38.130297 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-35cde8f9-2b11-4382-9bcb-778eadda0a9f tempest-VolumesActionsTest-1075133775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:14:38.205420 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-35cde8f9-2b11-4382-9bcb-778eadda0a9f tempest-VolumesActionsTest-1075133775 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:14:38.209996 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-35cde8f9-2b11-4382-9bcb-778eadda0a9f tempest-VolumesActionsTest-1075133775 None] Deleted volume successfully. Mar 05 21:14:38.238729 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-35cde8f9-2b11-4382-9bcb-778eadda0a9f tempest-VolumesActionsTest-1075133775 None] Lock "b'cinder-c892a60c-7706-469a-ba8c-f52ad4e0338b-delete_volume'" released by "delete_volume" :: held 0.910s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:14:38.448516 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6cb74da0-5092-4934-a795-158860fdcb65 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:14:38.928680 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-6e719e22-5497-4301-bd5e-fea74fa52592 req-bf765793-2bf9-435e-9848-0d3b7068786e tempest-AttachVolumeNegativeTest-1565771773 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:14:38.964921 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6cb74da0-5092-4934-a795-158860fdcb65 tempest-TestVolumeBootPattern-160921740 None] Create snapshot completed successfully Mar 05 21:14:40.191300 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-6e719e22-5497-4301-bd5e-fea74fa52592 req-bf765793-2bf9-435e-9848-0d3b7068786e tempest-AttachVolumeNegativeTest-1565771773 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.263s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:14:40.192291 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-6e719e22-5497-4301-bd5e-fea74fa52592 req-bf765793-2bf9-435e-9848-0d3b7068786e tempest-AttachVolumeNegativeTest-1565771773 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:14:40.239212 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-6e719e22-5497-4301-bd5e-fea74fa52592 req-bf765793-2bf9-435e-9848-0d3b7068786e tempest-AttachVolumeNegativeTest-1565771773 None] Connection info returned from driver {'name': 'volumes/volume-1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8be3fd3b-4f76-4248-86d4-4f0b8e68458e'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:14:40.339440 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-6e719e22-5497-4301-bd5e-fea74fa52592 req-bf765793-2bf9-435e-9848-0d3b7068786e tempest-AttachVolumeNegativeTest-1565771773 None] attachment_update completed successfully. Mar 05 21:14:41.994800 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:14:42.000434 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:14:42.000927 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:14:42.024245 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Flow 'volume_create_manager' (fd354422-d26e-40a0-ba2d-b5da9b7531c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:14:42.032580 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5847197-4d2b-4dae-8b69-b580083c09ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:42.044552 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:14:42.073823 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5847197-4d2b-4dae-8b69-b580083c09ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1909368870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2de60bd3-fd9c-4cf2-a463-7d2086df54a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc2945ca7204c80907515ca0c271337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:14:42Z,use_quota=True,user_id='f82efe872057495292d8e41f987c48a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:42.080085 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41971c01-22f7-42b1-9d04-96b3a0c984b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:42.084854 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41971c01-22f7-42b1-9d04-96b3a0c984b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:42.090829 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb9dd97-f06b-42a4-96ea-08067f604031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:42.096099 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb9dd97-f06b-42a4-96ea-08067f604031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2de60bd3-fd9c-4cf2-a463-7d2086df54a0', 'volume_name': 'volume-2de60bd3-fd9c-4cf2-a463-7d2086df54a0', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:42.101762 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d290c9-fe59-440d-aeae-1bcf81ff098a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:42.106581 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d290c9-fe59-440d-aeae-1bcf81ff098a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:42.111812 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f20131c-7e1e-4f4b-9408-8f95cdcb98ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:42.113140 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Volume 2de60bd3-fd9c-4cf2-a463-7d2086df54a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2de60bd3-fd9c-4cf2-a463-7d2086df54a0', 'volume_size': 1} Mar 05 21:14:42.113865 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] creating volume 'volume-2de60bd3-fd9c-4cf2-a463-7d2086df54a0' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:14:42.115880 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:14:42.215485 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:14:42.216058 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:14:42.221798 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f20131c-7e1e-4f4b-9408-8f95cdcb98ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2de60bd3-fd9c-4cf2-a463-7d2086df54a0', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:42.227799 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cc828c-bf74-41c3-8e26-f3559a0ec480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:42.240764 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Volume volume-2de60bd3-fd9c-4cf2-a463-7d2086df54a0 (2de60bd3-fd9c-4cf2-a463-7d2086df54a0): created successfully Mar 05 21:14:42.266503 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cc828c-bf74-41c3-8e26-f3559a0ec480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:42.281970 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Flow 'volume_create_manager' (fd354422-d26e-40a0-ba2d-b5da9b7531c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:14:42.316315 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b6044310-b2d6-4cef-8556-b9a6d08fe31d tempest-VolumesBackupsTest-1617152067 None] Created volume successfully. Mar 05 21:14:43.771395 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-f6b531d0-f007-4560-9001-ba385732bc53 req-1c758ad6-8ef4-40ce-9ed5-1bc35d07e4fb tempest-AttachVolumeNegativeTest-1565771773 None] Terminate volume connection completed successfully. Mar 05 21:14:43.772202 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-f6b531d0-f007-4560-9001-ba385732bc53 req-1c758ad6-8ef4-40ce-9ed5-1bc35d07e4fb tempest-AttachVolumeNegativeTest-1565771773 None] Deleting attachment 8be3fd3b-4f76-4248-86d4-4f0b8e68458e. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:14:44.042239 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:14:44.057118 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:14:44.057657 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:14:44.116300 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Flow 'volume_create_manager' (4663f534-9a8d-4b9b-852f-40244851f73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:14:44.127506 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6c7613-a9b0-4ba9-b562-0d6c99b0ec6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:44.140739 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:14:44.164063 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6c7613-a9b0-4ba9-b562-0d6c99b0ec6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:14:44Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=64d9dc7b-f9a4-4c94-92c5-2cd203b837a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdcb29011e61419981c5bfc5f10677c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2ca037da-0a96-4563-a9e2-280545ea1442,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:14:44Z,use_quota=True,user_id='0c07bd2946594c3e8848bca133da0d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:44.171174 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (440b6940-cf0b-4cad-b03e-5cfef59d523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:44.176502 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (440b6940-cf0b-4cad-b03e-5cfef59d523f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:44.182217 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0610628a-38e0-4052-82b8-67e4e459fb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:44.192493 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0610628a-38e0-4052-82b8-67e4e459fb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '64d9dc7b-f9a4-4c94-92c5-2cd203b837a3', 'volume_name': 'volume-64d9dc7b-f9a4-4c94-92c5-2cd203b837a3', 'volume_size': 1, 'snapshot_id': '2ca037da-0a96-4563-a9e2-280545ea1442'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:44.201367 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d52147c-b614-4d8c-af76-67b8ded0e1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:44.206105 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d52147c-b614-4d8c-af76-67b8ded0e1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:44.214955 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c24ab01-8895-4f77-80b3-932cebd799a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:44.221462 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Volume 64d9dc7b-f9a4-4c94-92c5-2cd203b837a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-64d9dc7b-f9a4-4c94-92c5-2cd203b837a3', 'volume_size': 1, 'snapshot_id': '2ca037da-0a96-4563-a9e2-280545ea1442'} Mar 05 21:14:44.253282 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] cloning volumes/volume-43dd405f-2b5a-46a2-a8e7-5b65271bc344@snapshot-2ca037da-0a96-4563-a9e2-280545ea1442 to volume-64d9dc7b-f9a4-4c94-92c5-2cd203b837a3 {{(pid=134747) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Mar 05 21:14:44.254462 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:14:44.414428 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:14:44.659183 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:14:44.660183 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:14:44.680234 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Marking volume 64d9dc7b-f9a4-4c94-92c5-2cd203b837a3 as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 21:14:44.692617 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Copying metadata from snapshot 2ca037da-0a96-4563-a9e2-280545ea1442 to 64d9dc7b-f9a4-4c94-92c5-2cd203b837a3. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Mar 05 21:14:44.746548 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c24ab01-8895-4f77-80b3-932cebd799a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d9dc7b-f9a4-4c94-92c5-2cd203b837a3', 'volume_size': 1, 'snapshot_id': '2ca037da-0a96-4563-a9e2-280545ea1442'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:44.751761 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdba75bd-4fac-4bde-befa-16f28a070867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:14:44.766987 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Volume volume-64d9dc7b-f9a4-4c94-92c5-2cd203b837a3 (64d9dc7b-f9a4-4c94-92c5-2cd203b837a3): created successfully Mar 05 21:14:44.773109 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdba75bd-4fac-4bde-befa-16f28a070867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:14:44.779477 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Flow 'volume_create_manager' (4663f534-9a8d-4b9b-852f-40244851f73c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:14:44.799708 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-65af1f31-ce0f-42cf-9e58-92cd21fcf1cb tempest-TestVolumeBootPattern-160921740 None] Created volume successfully. Mar 05 21:14:45.610087 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:14:45.610877 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:14:45.685959 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:14:45.740680 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:14:47.460825 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-48d48f67-5956-403a-943e-b2e233581b6e tempest-TestVolumeBootPattern-160921740 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:14:48.472141 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-48d48f67-5956-403a-943e-b2e233581b6e tempest-TestVolumeBootPattern-160921740 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.011s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:14:48.472976 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-48d48f67-5956-403a-943e-b2e233581b6e tempest-TestVolumeBootPattern-160921740 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-64d9dc7b-f9a4-4c94-92c5-2cd203b837a3', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '64d9dc7b-f9a4-4c94-92c5-2cd203b837a3', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:14:48.522868 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-48d48f67-5956-403a-943e-b2e233581b6e tempest-TestVolumeBootPattern-160921740 None] Connection info returned from driver {'name': 'volumes/volume-64d9dc7b-f9a4-4c94-92c5-2cd203b837a3', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '64d9dc7b-f9a4-4c94-92c5-2cd203b837a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c79cf27d-834e-4d44-9baa-9e72fd7f7d5e'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:14:48.632677 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-157c2f72-096d-4f9b-8003-afd775fcfdde req-48d48f67-5956-403a-943e-b2e233581b6e tempest-TestVolumeBootPattern-160921740 None] attachment_update completed successfully. Mar 05 21:15:00.508750 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-d44eae7e-0560-40a1-a256-dbde3d36bdab req-7352bfe2-5a90-4b0f-81cb-e42fa1025c60 tempest-VolumesBackupsTest-1617152067 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:15:01.442887 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-d44eae7e-0560-40a1-a256-dbde3d36bdab req-7352bfe2-5a90-4b0f-81cb-e42fa1025c60 tempest-VolumesBackupsTest-1617152067 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.933s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:15:01.457103 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-d44eae7e-0560-40a1-a256-dbde3d36bdab req-7352bfe2-5a90-4b0f-81cb-e42fa1025c60 tempest-VolumesBackupsTest-1617152067 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2de60bd3-fd9c-4cf2-a463-7d2086df54a0', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '2de60bd3-fd9c-4cf2-a463-7d2086df54a0', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:15:01.523494 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-d44eae7e-0560-40a1-a256-dbde3d36bdab req-7352bfe2-5a90-4b0f-81cb-e42fa1025c60 tempest-VolumesBackupsTest-1617152067 None] Connection info returned from driver {'name': 'volumes/volume-2de60bd3-fd9c-4cf2-a463-7d2086df54a0', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2de60bd3-fd9c-4cf2-a463-7d2086df54a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'baac0999-edd8-408d-b850-75d81a2a0ba7'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:15:01.621850 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-d44eae7e-0560-40a1-a256-dbde3d36bdab req-7352bfe2-5a90-4b0f-81cb-e42fa1025c60 tempest-VolumesBackupsTest-1617152067 None] attachment_update completed successfully. Mar 05 21:15:04.050053 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8288ddf2-c579-4db3-be85-5c9798d066e5 tempest-VolumesBackupsTest-1617152067 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-05T21:15:03Z,data_timestamp=2022-03-05T21:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1452719834',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=a273ab6d-b020-47de-876e-e182bf0c50d3,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='0bc2945ca7204c80907515ca0c271337',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f82efe872057495292d8e41f987c48a4',volume_id=2de60bd3-fd9c-4cf2-a463-7d2086df54a0) Mar 05 21:15:04.050596 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.backup.rpcapi [None req-8288ddf2-c579-4db3-be85-5c9798d066e5 tempest-VolumesBackupsTest-1617152067 None] continue_backup in rpcapi backup_id a273ab6d-b020-47de-876e-e182bf0c50d3 {{(pid=134747) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 05 21:15:04.315563 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-8288ddf2-c579-4db3-be85-5c9798d066e5 tempest-VolumesBackupsTest-1617152067 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:15:05.283892 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-8288ddf2-c579-4db3-be85-5c9798d066e5 tempest-VolumesBackupsTest-1617152067 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.968s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:15:05.286129 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8288ddf2-c579-4db3-be85-5c9798d066e5 tempest-VolumesBackupsTest-1617152067 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2de60bd3-fd9c-4cf2-a463-7d2086df54a0', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '2de60bd3-fd9c-4cf2-a463-7d2086df54a0', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:15:05.332692 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8288ddf2-c579-4db3-be85-5c9798d066e5 tempest-VolumesBackupsTest-1617152067 None] Initialize volume connection completed successfully. Mar 05 21:15:05.756314 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-22679092-2ae4-48f6-926c-8d646f2fb8f3 req-b1a80e3c-e5cf-4fcb-92cf-002c98402db3 tempest-TestVolumeBootPattern-160921740 None] Terminate volume connection completed successfully. Mar 05 21:15:05.756856 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-22679092-2ae4-48f6-926c-8d646f2fb8f3 req-b1a80e3c-e5cf-4fcb-92cf-002c98402db3 tempest-TestVolumeBootPattern-160921740 None] Deleting attachment c79cf27d-834e-4d44-9baa-9e72fd7f7d5e. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:15:06.001839 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-22679092-2ae4-48f6-926c-8d646f2fb8f3 req-2243bb2f-1de9-4a74-8744-9254c439c9f2 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-64d9dc7b-f9a4-4c94-92c5-2cd203b837a3-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:15:06.095452 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-22679092-2ae4-48f6-926c-8d646f2fb8f3 req-2243bb2f-1de9-4a74-8744-9254c439c9f2 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:06.228951 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-22679092-2ae4-48f6-926c-8d646f2fb8f3 req-2243bb2f-1de9-4a74-8744-9254c439c9f2 tempest-TestVolumeBootPattern-160921740 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:15:06.240268 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-22679092-2ae4-48f6-926c-8d646f2fb8f3 req-2243bb2f-1de9-4a74-8744-9254c439c9f2 tempest-TestVolumeBootPattern-160921740 None] deleting rbd volume volume-64d9dc7b-f9a4-4c94-92c5-2cd203b837a3 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:15:06.643135 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [req-22679092-2ae4-48f6-926c-8d646f2fb8f3 req-2243bb2f-1de9-4a74-8744-9254c439c9f2 tempest-TestVolumeBootPattern-160921740 None] Created reservations ['b9f471d6-eec5-4e2a-8b66-a869df9b8984', 'f0d9b8e2-a8bc-4a13-b025-025a734884d2', 'bcca1e76-79d9-4105-820d-2335a1020010', 'ba9bd1da-c67f-4fd4-a28e-41fd5b6476fc'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:15:06.709709 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-22679092-2ae4-48f6-926c-8d646f2fb8f3 req-2243bb2f-1de9-4a74-8744-9254c439c9f2 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:06.766980 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-22679092-2ae4-48f6-926c-8d646f2fb8f3 req-2243bb2f-1de9-4a74-8744-9254c439c9f2 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:06.816502 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [req-22679092-2ae4-48f6-926c-8d646f2fb8f3 req-2243bb2f-1de9-4a74-8744-9254c439c9f2 tempest-TestVolumeBootPattern-160921740 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:15:06.822080 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-22679092-2ae4-48f6-926c-8d646f2fb8f3 req-2243bb2f-1de9-4a74-8744-9254c439c9f2 tempest-TestVolumeBootPattern-160921740 None] Deleted volume successfully. Mar 05 21:15:06.840813 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-22679092-2ae4-48f6-926c-8d646f2fb8f3 req-2243bb2f-1de9-4a74-8744-9254c439c9f2 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-64d9dc7b-f9a4-4c94-92c5-2cd203b837a3-delete_volume'" released by "delete_volume" :: held 0.839s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:15:06.925140 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b654c207-5d7b-41ef-adae-43893c47dd6f tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-2ca037da-0a96-4563-a9e2-280545ea1442-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:15:06.930645 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b654c207-5d7b-41ef-adae-43893c47dd6f tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:07.470371 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-b654c207-5d7b-41ef-adae-43893c47dd6f tempest-TestVolumeBootPattern-160921740 None] Created reservations ['f81e0cc2-41f5-4584-9ba4-5d81e6a7f319', 'e2de395f-b418-4fde-ace8-e2ac94069b94', '4f40d074-0323-4f22-a192-2b356090f6a7', '53abbaca-0d6f-49ca-a95a-916b7d1dc758'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:15:07.561900 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b654c207-5d7b-41ef-adae-43893c47dd6f tempest-TestVolumeBootPattern-160921740 None] Delete snapshot completed successfully. Mar 05 21:15:07.576159 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b654c207-5d7b-41ef-adae-43893c47dd6f tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-2ca037da-0a96-4563-a9e2-280545ea1442-delete_snapshot'" released by "delete_snapshot" :: held 0.651s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:15:07.578501 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8288ddf2-c579-4db3-be85-5c9798d066e5 tempest-VolumesBackupsTest-1617152067 None] Terminate volume connection completed successfully. Mar 05 21:15:07.597359 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8288ddf2-c579-4db3-be85-5c9798d066e5 tempest-VolumesBackupsTest-1617152067 None] Remove volume export completed successfully. Mar 05 21:15:08.064931 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-61689238-8e85-4e7b-9d3a-d1e8f5d14977 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-43dd405f-2b5a-46a2-a8e7-5b65271bc344-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:15:08.124749 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-61689238-8e85-4e7b-9d3a-d1e8f5d14977 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:08.222011 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-61689238-8e85-4e7b-9d3a-d1e8f5d14977 tempest-TestVolumeBootPattern-160921740 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:15:08.231256 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-61689238-8e85-4e7b-9d3a-d1e8f5d14977 tempest-TestVolumeBootPattern-160921740 None] deleting rbd volume volume-43dd405f-2b5a-46a2-a8e7-5b65271bc344 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:15:08.433374 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-61689238-8e85-4e7b-9d3a-d1e8f5d14977 tempest-TestVolumeBootPattern-160921740 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 21:15:08.464501 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-61689238-8e85-4e7b-9d3a-d1e8f5d14977 tempest-TestVolumeBootPattern-160921740 None] deleting parent snapshot volume-43dd405f-2b5a-46a2-a8e7-5b65271bc344.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 21:15:08.912890 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-61689238-8e85-4e7b-9d3a-d1e8f5d14977 tempest-TestVolumeBootPattern-160921740 None] Created reservations ['e5052d19-9158-4d2e-ab7e-1c464648e7c2', '7868de25-c3c2-49c1-b07a-e84bb23be3e3', '9059aaf2-6527-429e-89ee-406af9f09d99', '1bfcb7da-3c8c-48c0-a32a-b29ff2f3f8ee'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:15:08.975748 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-61689238-8e85-4e7b-9d3a-d1e8f5d14977 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:09.064477 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-61689238-8e85-4e7b-9d3a-d1e8f5d14977 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:09.131546 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-61689238-8e85-4e7b-9d3a-d1e8f5d14977 tempest-TestVolumeBootPattern-160921740 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:15:09.136151 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-61689238-8e85-4e7b-9d3a-d1e8f5d14977 tempest-TestVolumeBootPattern-160921740 None] Deleted volume successfully. Mar 05 21:15:09.154681 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-61689238-8e85-4e7b-9d3a-d1e8f5d14977 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-43dd405f-2b5a-46a2-a8e7-5b65271bc344-delete_volume'" released by "delete_volume" :: held 1.090s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:15:09.924548 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:15:09.931650 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:15:09.932767 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:15:09.958288 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Flow 'volume_create_manager' (cbe2f428-8e55-463b-bf72-0408745e5035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:09.966069 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47cf024-5601-4ea3-8a45-af7493cf3c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:09.974086 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:15:09.989370 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47cf024-5601-4ea3-8a45-af7493cf3c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1348150617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bfb78306-e19f-4d73-9333-7d277b32418e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdcb29011e61419981c5bfc5f10677c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:15:10Z,use_quota=True,user_id='0c07bd2946594c3e8848bca133da0d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:09.995220 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b126d6-6530-4fb5-995a-c043102affe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:10.000289 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b126d6-6530-4fb5-995a-c043102affe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:10.006217 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41bb344-3790-4600-84a6-7d577fee411b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:10.093735 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41bb344-3790-4600-84a6-7d577fee411b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bfb78306-e19f-4d73-9333-7d277b32418e', 'volume_name': 'volume-bfb78306-e19f-4d73-9333-7d277b32418e', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:10.099866 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f1dce8-fb12-4061-8085-68203b3bc197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:10.104300 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f1dce8-fb12-4061-8085-68203b3bc197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:10.109082 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6c1410-84c1-4b8a-9697-559b175c6561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:10.110221 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Volume bfb78306-e19f-4d73-9333-7d277b32418e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bfb78306-e19f-4d73-9333-7d277b32418e', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 21:15:10.110791 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Cloning bfb78306-e19f-4d73-9333-7d277b32418e from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 21:15:10.119595 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:15:10.128876 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 15, 10, 123905)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:15:10.129595 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:15:10.130176 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Found cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 05 21:15:10.134443 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:15:10.135402 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 21:15:10.141035 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 15, 10, 138803)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:15:10.141464 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:15:10.141859 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Creating from source image-volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7 {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 05 21:15:10.153853 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:10.213845 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] creating snapshot='volume-bfb78306-e19f-4d73-9333-7d277b32418e.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 21:15:10.860574 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] cloning 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7@volume-bfb78306-e19f-4d73-9333-7d277b32418e.clone_snap' to 'volume-bfb78306-e19f-4d73-9333-7d277b32418e' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 21:15:11.065175 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a.deleted is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:15:11.066775 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:15:11.067892 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:15:11.101555 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 21:15:11.102352 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Marking volume bfb78306-e19f-4d73-9333-7d277b32418e as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 21:15:11.113082 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to bfb78306-e19f-4d73-9333-7d277b32418e. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 21:15:11.114058 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Creating volume glance metadata for volume bfb78306-e19f-4d73-9333-7d277b32418e backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 21:15:11.183800 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6c1410-84c1-4b8a-9697-559b175c6561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfb78306-e19f-4d73-9333-7d277b32418e', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:11.190134 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4cad52-417e-4cf9-a68d-0b92f48938d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:11.206416 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Volume volume-bfb78306-e19f-4d73-9333-7d277b32418e (bfb78306-e19f-4d73-9333-7d277b32418e): created successfully Mar 05 21:15:11.213342 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4cad52-417e-4cf9-a68d-0b92f48938d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:11.221598 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Flow 'volume_create_manager' (cbe2f428-8e55-463b-bf72-0408745e5035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:11.237216 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ad02eec5-60aa-44cb-b15d-35303ccef2f1 tempest-TestVolumeBootPattern-160921740 None] Created volume successfully. Mar 05 21:15:11.264530 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-6f9db4a7-6d14-4416-80b9-3b350fe01f3e req-d680dbc0-7fba-4d42-bc39-3b27364a6ef8 tempest-VolumesBackupsTest-1617152067 None] Terminate volume connection completed successfully. Mar 05 21:15:11.265329 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-6f9db4a7-6d14-4416-80b9-3b350fe01f3e req-d680dbc0-7fba-4d42-bc39-3b27364a6ef8 tempest-VolumesBackupsTest-1617152067 None] Deleting attachment baac0999-edd8-408d-b850-75d81a2a0ba7. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:15:15.089185 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 req-5b7e866a-63ee-4ac8-9dbc-4c7eda1d903e tempest-TestVolumeBootPattern-160921740 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:15:15.950565 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-9aab464d-d09d-46ed-9ae7-6dfc88edd507 tempest-VolumesBackupsTest-1617152067 None] Lock "b'cinder-2de60bd3-fd9c-4cf2-a463-7d2086df54a0-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:15:16.032821 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9aab464d-d09d-46ed-9ae7-6dfc88edd507 tempest-VolumesBackupsTest-1617152067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:17.140135 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9aab464d-d09d-46ed-9ae7-6dfc88edd507 tempest-VolumesBackupsTest-1617152067 None] Volume volume-2de60bd3-fd9c-4cf2-a463-7d2086df54a0 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:15:17.165932 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9aab464d-d09d-46ed-9ae7-6dfc88edd507 tempest-VolumesBackupsTest-1617152067 None] deleting rbd volume volume-2de60bd3-fd9c-4cf2-a463-7d2086df54a0 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:15:17.171122 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 req-5b7e866a-63ee-4ac8-9dbc-4c7eda1d903e tempest-TestVolumeBootPattern-160921740 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.082s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:15:17.172179 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 req-5b7e866a-63ee-4ac8-9dbc-4c7eda1d903e tempest-TestVolumeBootPattern-160921740 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bfb78306-e19f-4d73-9333-7d277b32418e', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'bfb78306-e19f-4d73-9333-7d277b32418e', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:15:17.220848 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 req-5b7e866a-63ee-4ac8-9dbc-4c7eda1d903e tempest-TestVolumeBootPattern-160921740 None] Connection info returned from driver {'name': 'volumes/volume-bfb78306-e19f-4d73-9333-7d277b32418e', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bfb78306-e19f-4d73-9333-7d277b32418e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '90506c1b-f3f5-4e4d-9bda-35107c9fb4ae'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:15:17.293746 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 req-5b7e866a-63ee-4ac8-9dbc-4c7eda1d903e tempest-TestVolumeBootPattern-160921740 None] attachment_update completed successfully. Mar 05 21:15:17.511882 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-9aab464d-d09d-46ed-9ae7-6dfc88edd507 tempest-VolumesBackupsTest-1617152067 None] Created reservations ['01ef9046-3d13-4f22-aa35-a79e4d26308e', 'db2e883b-3b82-4e82-a943-55b3b264864f', '9cead4c2-19da-4300-8dbc-72c2c74b3e2a', '00fae90c-17a5-454d-9ff7-6a2aaed27499'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:15:17.587108 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9aab464d-d09d-46ed-9ae7-6dfc88edd507 tempest-VolumesBackupsTest-1617152067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:17.630477 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9aab464d-d09d-46ed-9ae7-6dfc88edd507 tempest-VolumesBackupsTest-1617152067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:17.700117 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-9aab464d-d09d-46ed-9ae7-6dfc88edd507 tempest-VolumesBackupsTest-1617152067 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:15:17.704742 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-9aab464d-d09d-46ed-9ae7-6dfc88edd507 tempest-VolumesBackupsTest-1617152067 None] Deleted volume successfully. Mar 05 21:15:17.736244 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-9aab464d-d09d-46ed-9ae7-6dfc88edd507 tempest-VolumesBackupsTest-1617152067 None] Lock "b'cinder-2de60bd3-fd9c-4cf2-a463-7d2086df54a0-delete_volume'" released by "delete_volume" :: held 1.790s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:15:18.662147 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:15:18.666723 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:15:18.667333 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:15:18.687609 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Flow 'volume_create_manager' (d5a77c78-a0ac-481a-8f5b-2cf3e8cb2913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:18.695131 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8305aa0e-70f0-40fc-9499-cb4a5b0fea4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:18.702010 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:15:18.717628 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8305aa0e-70f0-40fc-9499-cb4a5b0fea4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1119826496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=47b94a70-47d6-4b47-9cf2-6c025f612fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc2945ca7204c80907515ca0c271337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:15:19Z,use_quota=True,user_id='f82efe872057495292d8e41f987c48a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:18.724096 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9d2e3d-c317-4347-9267-d681280e35ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:18.728578 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9d2e3d-c317-4347-9267-d681280e35ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:18.734714 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8ed227-23e3-45c5-8d7f-8c853ffc606c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:18.841873 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8ed227-23e3-45c5-8d7f-8c853ffc606c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '47b94a70-47d6-4b47-9cf2-6c025f612fb4', 'volume_name': 'volume-47b94a70-47d6-4b47-9cf2-6c025f612fb4', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:18.847591 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee0dd58-27e0-4ba0-9db9-40da67132782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:18.852268 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee0dd58-27e0-4ba0-9db9-40da67132782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:18.857461 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c227e1-db57-4fa9-960a-95ee76d7cec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:18.858862 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Volume 47b94a70-47d6-4b47-9cf2-6c025f612fb4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-47b94a70-47d6-4b47-9cf2-6c025f612fb4', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 21:15:18.859689 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Cloning 47b94a70-47d6-4b47-9cf2-6c025f612fb4 from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 21:15:18.870646 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:15:18.885064 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 15, 18, 875900)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:15:18.885854 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:15:18.886479 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Found cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 05 21:15:18.893494 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 0.023s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:15:18.895778 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 21:15:18.903874 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 15, 18, 899916)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:15:18.904291 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:15:18.904681 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Creating from source image-volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7 {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 05 21:15:18.921359 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:19.003846 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] creating snapshot='volume-47b94a70-47d6-4b47-9cf2-6c025f612fb4.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 21:15:19.140654 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] cloning 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7@volume-47b94a70-47d6-4b47-9cf2-6c025f612fb4.clone_snap' to 'volume-47b94a70-47d6-4b47-9cf2-6c025f612fb4' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 21:15:19.268604 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a.deleted is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:15:19.269792 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:15:19.270353 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:15:19.286947 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 21:15:19.287574 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Marking volume 47b94a70-47d6-4b47-9cf2-6c025f612fb4 as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 21:15:19.295583 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to 47b94a70-47d6-4b47-9cf2-6c025f612fb4. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 21:15:19.296060 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Creating volume glance metadata for volume 47b94a70-47d6-4b47-9cf2-6c025f612fb4 backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 21:15:19.347541 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c227e1-db57-4fa9-960a-95ee76d7cec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b94a70-47d6-4b47-9cf2-6c025f612fb4', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:19.352856 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9bd40d5-6495-408e-9c8b-264d4addbdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:19.361494 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Volume volume-47b94a70-47d6-4b47-9cf2-6c025f612fb4 (47b94a70-47d6-4b47-9cf2-6c025f612fb4): created successfully Mar 05 21:15:19.366446 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9bd40d5-6495-408e-9c8b-264d4addbdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:19.372120 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Flow 'volume_create_manager' (d5a77c78-a0ac-481a-8f5b-2cf3e8cb2913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:19.380475 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-5edbab64-4066-4fdf-9eb7-0b31b5a2e33c tempest-VolumesBackupsTest-1617152067 None] Created volume successfully. Mar 05 21:15:19.863706 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-fa18d988-6da9-4493-9143-1cb8e811efa9 tempest-VolumesBackupsTest-1617152067 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-05T21:15:19Z,data_timestamp=2022-03-05T21:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1981703880',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=b48ce6f8-b6c1-47fa-8378-5b7bd8130650,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='0bc2945ca7204c80907515ca0c271337',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f82efe872057495292d8e41f987c48a4',volume_id=47b94a70-47d6-4b47-9cf2-6c025f612fb4) Mar 05 21:15:19.865687 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.backup.rpcapi [None req-fa18d988-6da9-4493-9143-1cb8e811efa9 tempest-VolumesBackupsTest-1617152067 None] continue_backup in rpcapi backup_id b48ce6f8-b6c1-47fa-8378-5b7bd8130650 {{(pid=134747) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 05 21:15:19.993294 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-fa18d988-6da9-4493-9143-1cb8e811efa9 tempest-VolumesBackupsTest-1617152067 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:15:20.671867 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-fa18d988-6da9-4493-9143-1cb8e811efa9 tempest-VolumesBackupsTest-1617152067 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.678s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:15:20.672928 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fa18d988-6da9-4493-9143-1cb8e811efa9 tempest-VolumesBackupsTest-1617152067 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-47b94a70-47d6-4b47-9cf2-6c025f612fb4', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '47b94a70-47d6-4b47-9cf2-6c025f612fb4', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:15:20.687521 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-fa18d988-6da9-4493-9143-1cb8e811efa9 tempest-VolumesBackupsTest-1617152067 None] Initialize volume connection completed successfully. Mar 05 21:15:27.076714 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-fa18d988-6da9-4493-9143-1cb8e811efa9 tempest-VolumesBackupsTest-1617152067 None] Terminate volume connection completed successfully. Mar 05 21:15:27.094032 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-fa18d988-6da9-4493-9143-1cb8e811efa9 tempest-VolumesBackupsTest-1617152067 None] Remove volume export completed successfully. Mar 05 21:15:28.155262 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:15:28.158959 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:15:28.159454 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:15:28.181772 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Flow 'volume_create_manager' (cb63f1a1-b86f-4f45-bac6-bb2f0a4f8d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:28.188418 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83306c83-1dbd-44d7-918c-4ff01d5e1991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:28.196630 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:15:28.212989 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83306c83-1dbd-44d7-918c-4ff01d5e1991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1409827923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2c43501d-253b-49b5-9c77-8a8e525b5831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1b37634bef4eefa974dfc8912e8556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:15:28Z,use_quota=True,user_id='469bc2b7ea9e4727a0f0356e9a08dcb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:28.218857 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38978d8-7ead-4d60-ade0-36178985bddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:28.224365 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38978d8-7ead-4d60-ade0-36178985bddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:28.230286 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff9fa07-983d-4d8c-a143-9207189e3f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:28.239224 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff9fa07-983d-4d8c-a143-9207189e3f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c43501d-253b-49b5-9c77-8a8e525b5831', 'volume_name': 'volume-2c43501d-253b-49b5-9c77-8a8e525b5831', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:28.249666 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9ca407-08f6-4d20-9d91-8c51348c07f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:28.254151 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9ca407-08f6-4d20-9d91-8c51348c07f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:28.259900 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc74fd1-82bb-4c16-a78e-a4145919faff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:28.261045 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Volume 2c43501d-253b-49b5-9c77-8a8e525b5831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c43501d-253b-49b5-9c77-8a8e525b5831', 'volume_size': 1} Mar 05 21:15:28.261459 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] creating volume 'volume-2c43501d-253b-49b5-9c77-8a8e525b5831' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:15:28.262886 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:28.372751 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:15:28.373358 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:15:28.379226 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc74fd1-82bb-4c16-a78e-a4145919faff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c43501d-253b-49b5-9c77-8a8e525b5831', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:28.385253 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a7a85f-b3e7-447a-a1fe-0576a9d9e862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:28.398487 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-3e48dc46-2b1c-40e9-b975-be0adf56f360 req-48637546-3a1f-47a6-8cc0-3cc2769b9d25 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:28.515956 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Volume volume-2c43501d-253b-49b5-9c77-8a8e525b5831 (2c43501d-253b-49b5-9c77-8a8e525b5831): created successfully Mar 05 21:15:28.521681 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a7a85f-b3e7-447a-a1fe-0576a9d9e862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:28.534008 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Flow 'volume_create_manager' (cb63f1a1-b86f-4f45-bac6-bb2f0a4f8d17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:28.544872 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f05b3ebd-31c4-4680-a09d-02264277f7e8 tempest-AttachVolumeShelveTestJSON-1318940295 None] Created volume successfully. Mar 05 21:15:28.728250 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:15:28.732978 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:15:28.733757 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:15:28.763557 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Flow 'volume_create_manager' (071d6703-2634-41dc-b8dd-32ec10406bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:28.773115 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728737b3-774a-468a-b36f-52da5e626f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:28.781512 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:15:28.797526 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728737b3-774a-468a-b36f-52da5e626f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:15:28Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_b48ce6f8-b6c1-47fa-8378-5b7bd8130650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=64e64fb0-06b0-49f8-a57b-8d1b70369c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc2945ca7204c80907515ca0c271337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:15:29Z,use_quota=True,user_id='f82efe872057495292d8e41f987c48a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:28.804058 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4daf462-2a6f-4baf-ab08-1daf1cab9ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:28.808342 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4daf462-2a6f-4baf-ab08-1daf1cab9ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:28.813740 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8fbab0-fa67-46d9-a95a-f6c00055834c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:28.819362 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8fbab0-fa67-46d9-a95a-f6c00055834c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e64fb0-06b0-49f8-a57b-8d1b70369c59', 'volume_name': 'volume-64e64fb0-06b0-49f8-a57b-8d1b70369c59', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:28.824620 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9764ba71-fcfa-479d-b3e6-c93039383dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:28.828942 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9764ba71-fcfa-479d-b3e6-c93039383dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:28.834373 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec557dc9-e517-4028-865f-a0402d411e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:28.835466 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Volume 64e64fb0-06b0-49f8-a57b-8d1b70369c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e64fb0-06b0-49f8-a57b-8d1b70369c59', 'volume_size': 1} Mar 05 21:15:28.835889 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] creating volume 'volume-64e64fb0-06b0-49f8-a57b-8d1b70369c59' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:15:28.836896 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:28.916386 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:15:28.916768 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:15:28.920644 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec557dc9-e517-4028-865f-a0402d411e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e64fb0-06b0-49f8-a57b-8d1b70369c59', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:28.925511 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff5e7f8-badc-4beb-b54e-5a8b7f2592c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:28.937347 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Volume volume-64e64fb0-06b0-49f8-a57b-8d1b70369c59 (64e64fb0-06b0-49f8-a57b-8d1b70369c59): created successfully Mar 05 21:15:28.941116 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff5e7f8-badc-4beb-b54e-5a8b7f2592c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:28.949201 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Flow 'volume_create_manager' (071d6703-2634-41dc-b8dd-32ec10406bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:28.960742 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Created volume successfully. Mar 05 21:15:29.076823 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-3e48dc46-2b1c-40e9-b975-be0adf56f360 req-48637546-3a1f-47a6-8cc0-3cc2769b9d25 tempest-TestVolumeBootPattern-160921740 None] Create snapshot completed successfully Mar 05 21:15:29.826544 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:15:30.591865 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.765s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:15:30.592724 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-64e64fb0-06b0-49f8-a57b-8d1b70369c59', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '64e64fb0-06b0-49f8-a57b-8d1b70369c59', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:15:30.616664 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Initialize volume connection completed successfully. Mar 05 21:15:32.156573 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:15:32.161387 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:15:32.162156 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:15:32.216505 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Flow 'volume_create_manager' (ea29a6d0-499d-4872-b208-cea7a5ea0bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:32.225282 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98f7541-5674-4640-b917-2e764a6990d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:32.234296 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:15:32.255409 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98f7541-5674-4640-b917-2e764a6990d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:15:32Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=163f1fe5-b8e6-4ca7-abae-0c48827fcb75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdcb29011e61419981c5bfc5f10677c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aa3b08df-4433-4b4f-ad93-0796031774bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:15:32Z,use_quota=True,user_id='0c07bd2946594c3e8848bca133da0d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:32.264403 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6147d316-e790-46a5-a2d1-1939b4de7a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:32.269867 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6147d316-e790-46a5-a2d1-1939b4de7a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:32.276506 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08269646-6e6a-4600-802c-ab9b843cec0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:32.281561 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08269646-6e6a-4600-802c-ab9b843cec0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '163f1fe5-b8e6-4ca7-abae-0c48827fcb75', 'volume_name': 'volume-163f1fe5-b8e6-4ca7-abae-0c48827fcb75', 'volume_size': 1, 'snapshot_id': 'aa3b08df-4433-4b4f-ad93-0796031774bf'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:32.294493 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8c8414-6788-4625-aa00-8bc6777c2ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:32.299121 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8c8414-6788-4625-aa00-8bc6777c2ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:32.308662 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae26207-06c6-4345-a62b-dbf37839da84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:32.310150 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Volume 163f1fe5-b8e6-4ca7-abae-0c48827fcb75: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-163f1fe5-b8e6-4ca7-abae-0c48827fcb75', 'volume_size': 1, 'snapshot_id': 'aa3b08df-4433-4b4f-ad93-0796031774bf'} Mar 05 21:15:32.344447 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] cloning volumes/volume-bfb78306-e19f-4d73-9333-7d277b32418e@snapshot-aa3b08df-4433-4b4f-ad93-0796031774bf to volume-163f1fe5-b8e6-4ca7-abae-0c48827fcb75 {{(pid=134747) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Mar 05 21:15:32.345925 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:32.547620 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:33.216469 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:15:33.218361 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:15:33.248530 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Marking volume 163f1fe5-b8e6-4ca7-abae-0c48827fcb75 as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 21:15:33.261576 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Copying metadata from snapshot aa3b08df-4433-4b4f-ad93-0796031774bf to 163f1fe5-b8e6-4ca7-abae-0c48827fcb75. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Mar 05 21:15:33.310063 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae26207-06c6-4345-a62b-dbf37839da84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-163f1fe5-b8e6-4ca7-abae-0c48827fcb75', 'volume_size': 1, 'snapshot_id': 'aa3b08df-4433-4b4f-ad93-0796031774bf'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:33.319213 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab1dcf9-873f-4b85-ba17-769021218ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:33.334343 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Volume volume-163f1fe5-b8e6-4ca7-abae-0c48827fcb75 (163f1fe5-b8e6-4ca7-abae-0c48827fcb75): created successfully Mar 05 21:15:33.346338 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab1dcf9-873f-4b85-ba17-769021218ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:33.360503 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Flow 'volume_create_manager' (ea29a6d0-499d-4872-b208-cea7a5ea0bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:33.410340 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-e0817883-7279-4262-9461-bcacdcef874a tempest-TestVolumeBootPattern-160921740 None] Created volume successfully. Mar 05 21:15:33.440256 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:15:33.449204 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:15:33.450204 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:15:33.478371 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Flow 'volume_create_manager' (baf637c1-99fe-4f7e-83ef-8346a374f317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:33.493535 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d9e190-1b7e-4b27-ad63-36cd64094b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:33.503010 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:15:33.531618 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d9e190-1b7e-4b27-ad63-36cd64094b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-397909730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4c74ca3c-f5f2-4328-9573-41feea9d8616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df320c2ff22143c6aff862211cdcf12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:15:33Z,use_quota=True,user_id='7e6d7eed4dde4319ac67ce89afb6a55a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:33.539771 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a653f720-6751-49c1-ae43-1042e7f3b1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:33.545074 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a653f720-6751-49c1-ae43-1042e7f3b1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:33.551404 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23989d36-0a58-4e20-b6d2-978231b16aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:33.557392 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23989d36-0a58-4e20-b6d2-978231b16aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c74ca3c-f5f2-4328-9573-41feea9d8616', 'volume_name': 'volume-4c74ca3c-f5f2-4328-9573-41feea9d8616', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:33.564388 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46207e4-8968-4aaf-a6e7-aeefd790358e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:33.569857 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46207e4-8968-4aaf-a6e7-aeefd790358e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:33.575512 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77ce6ee-f647-48b0-8e67-50b6d8a676cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:33.577119 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Volume 4c74ca3c-f5f2-4328-9573-41feea9d8616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c74ca3c-f5f2-4328-9573-41feea9d8616', 'volume_size': 1} Mar 05 21:15:33.577725 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] creating volume 'volume-4c74ca3c-f5f2-4328-9573-41feea9d8616' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:15:33.579068 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:33.889587 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:15:33.889977 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:15:33.900963 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77ce6ee-f647-48b0-8e67-50b6d8a676cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c74ca3c-f5f2-4328-9573-41feea9d8616', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:33.908270 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f0b642-743e-4eb9-89b6-0de407fea633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:33.921350 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Volume volume-4c74ca3c-f5f2-4328-9573-41feea9d8616 (4c74ca3c-f5f2-4328-9573-41feea9d8616): created successfully Mar 05 21:15:33.929738 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f0b642-743e-4eb9-89b6-0de407fea633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:33.939818 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Flow 'volume_create_manager' (baf637c1-99fe-4f7e-83ef-8346a374f317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:33.962928 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-9e53ab2e-a8e6-426f-9d81-07cb5509a12a tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Created volume successfully. Mar 05 21:15:35.648706 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-872e01ff-ba10-4df1-b114-2639ae72af8e tempest-TestVolumeBootPattern-160921740 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:15:35.722539 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-cfa3d192-0ac5-452f-950b-2d054c3b4915 tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Lock "b'cinder-4c74ca3c-f5f2-4328-9573-41feea9d8616-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:15:35.810305 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-cfa3d192-0ac5-452f-950b-2d054c3b4915 tempest-VolumeQuotasNegativeTestJSON-1869839011 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:35.920329 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-cfa3d192-0ac5-452f-950b-2d054c3b4915 tempest-VolumeQuotasNegativeTestJSON-1869839011 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:15:35.920889 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-cfa3d192-0ac5-452f-950b-2d054c3b4915 tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Volume volume-4c74ca3c-f5f2-4328-9573-41feea9d8616 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:15:35.927422 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-cfa3d192-0ac5-452f-950b-2d054c3b4915 tempest-VolumeQuotasNegativeTestJSON-1869839011 None] deleting rbd volume volume-4c74ca3c-f5f2-4328-9573-41feea9d8616 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:15:36.320158 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-cfa3d192-0ac5-452f-950b-2d054c3b4915 tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Created reservations ['54d01ebd-9437-4744-a45a-63f342ae8ac9', 'c3df14c2-86ef-4a02-bd00-a2fe1a86abbc', 'd0df8b1b-df13-4abc-a6f9-c9efd93f58ee', 'dcb82831-3410-4b7a-9fc0-cc07f99a909b'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:15:36.411632 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-cfa3d192-0ac5-452f-950b-2d054c3b4915 tempest-VolumeQuotasNegativeTestJSON-1869839011 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:36.449304 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-cfa3d192-0ac5-452f-950b-2d054c3b4915 tempest-VolumeQuotasNegativeTestJSON-1869839011 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:36.486196 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-cfa3d192-0ac5-452f-950b-2d054c3b4915 tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:15:36.489529 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-872e01ff-ba10-4df1-b114-2639ae72af8e tempest-TestVolumeBootPattern-160921740 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.841s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:15:36.490017 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-872e01ff-ba10-4df1-b114-2639ae72af8e tempest-TestVolumeBootPattern-160921740 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-163f1fe5-b8e6-4ca7-abae-0c48827fcb75', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '163f1fe5-b8e6-4ca7-abae-0c48827fcb75', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:15:36.495006 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-cfa3d192-0ac5-452f-950b-2d054c3b4915 tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Deleted volume successfully. Mar 05 21:15:36.516400 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-cfa3d192-0ac5-452f-950b-2d054c3b4915 tempest-VolumeQuotasNegativeTestJSON-1869839011 None] Lock "b'cinder-4c74ca3c-f5f2-4328-9573-41feea9d8616-delete_volume'" released by "delete_volume" :: held 0.794s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:15:36.518319 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-872e01ff-ba10-4df1-b114-2639ae72af8e tempest-TestVolumeBootPattern-160921740 None] Connection info returned from driver {'name': 'volumes/volume-163f1fe5-b8e6-4ca7-abae-0c48827fcb75', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '163f1fe5-b8e6-4ca7-abae-0c48827fcb75', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd90aad2d-42de-4e63-9443-0b74b1b10b7d'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:15:36.568527 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd req-872e01ff-ba10-4df1-b114-2639ae72af8e tempest-TestVolumeBootPattern-160921740 None] attachment_update completed successfully. Mar 05 21:15:36.621584 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Terminate volume connection completed successfully. Mar 05 21:15:36.637523 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8bc7f593-575b-41a9-b496-25b2aa3666ad tempest-VolumesBackupsTest-1617152067 None] Remove volume export completed successfully. Mar 05 21:15:37.170118 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-6070d335-f8e9-499b-a43b-718e028716f1 tempest-VolumesBackupsTest-1617152067 None] Lock "b'cinder-64e64fb0-06b0-49f8-a57b-8d1b70369c59-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:15:37.211085 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6070d335-f8e9-499b-a43b-718e028716f1 tempest-VolumesBackupsTest-1617152067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:38.210961 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6070d335-f8e9-499b-a43b-718e028716f1 tempest-VolumesBackupsTest-1617152067 None] Volume volume-64e64fb0-06b0-49f8-a57b-8d1b70369c59 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:15:38.236769 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6070d335-f8e9-499b-a43b-718e028716f1 tempest-VolumesBackupsTest-1617152067 None] deleting rbd volume volume-64e64fb0-06b0-49f8-a57b-8d1b70369c59 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:15:38.688754 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-6070d335-f8e9-499b-a43b-718e028716f1 tempest-VolumesBackupsTest-1617152067 None] Created reservations ['1217e96a-645c-4d15-9ab9-935322df4830', '089dd239-7a8c-45f6-b23d-bc6838187b0a', '7d6623c4-0976-408e-bde3-2f9e3f9f072d', '7f5b040f-24f5-43d5-879e-707ab08a24cd'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:15:38.747465 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6070d335-f8e9-499b-a43b-718e028716f1 tempest-VolumesBackupsTest-1617152067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:38.796467 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6070d335-f8e9-499b-a43b-718e028716f1 tempest-VolumesBackupsTest-1617152067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:38.831004 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-6070d335-f8e9-499b-a43b-718e028716f1 tempest-VolumesBackupsTest-1617152067 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:15:38.836835 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6070d335-f8e9-499b-a43b-718e028716f1 tempest-VolumesBackupsTest-1617152067 None] Deleted volume successfully. Mar 05 21:15:38.849532 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-6070d335-f8e9-499b-a43b-718e028716f1 tempest-VolumesBackupsTest-1617152067 None] Lock "b'cinder-64e64fb0-06b0-49f8-a57b-8d1b70369c59-delete_volume'" released by "delete_volume" :: held 1.680s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:15:40.144510 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:15:40.148415 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:15:40.148936 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:15:40.168281 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Flow 'volume_create_manager' (982c1581-252b-436e-8abf-9fedf5699f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:40.174797 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f44025-3f9a-4e92-a28e-c4b2ac26ae89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:40.181993 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:15:40.195813 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f44025-3f9a-4e92-a28e-c4b2ac26ae89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1672399807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fd53a6b7-93ee-4a7c-b003-cf6be432dca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa62d3994074b5d8c45eba5b7dfd82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:15:40Z,use_quota=True,user_id='acf061ff833645a5b6646ebe2a639a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:40.201243 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8e69c2-1032-4720-827d-8ec01c2cbe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:40.205377 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8e69c2-1032-4720-827d-8ec01c2cbe36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:40.210671 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de000a8-326e-47d7-aa65-697c6176544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:40.214987 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de000a8-326e-47d7-aa65-697c6176544a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd53a6b7-93ee-4a7c-b003-cf6be432dca3', 'volume_name': 'volume-fd53a6b7-93ee-4a7c-b003-cf6be432dca3', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:40.220024 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb42dfb-9597-4df0-b0ea-42a18dfa2486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:40.224929 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb42dfb-9597-4df0-b0ea-42a18dfa2486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:40.229811 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b182e13-5262-4469-a487-8df19f94af17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:40.230921 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Volume fd53a6b7-93ee-4a7c-b003-cf6be432dca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd53a6b7-93ee-4a7c-b003-cf6be432dca3', 'volume_size': 1} Mar 05 21:15:40.231320 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] creating volume 'volume-fd53a6b7-93ee-4a7c-b003-cf6be432dca3' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:15:40.232353 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:40.290677 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:15:40.291114 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:15:40.295285 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b182e13-5262-4469-a487-8df19f94af17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd53a6b7-93ee-4a7c-b003-cf6be432dca3', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:40.300121 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5dbac0-26bd-4985-a1c1-e49691a807f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:40.309484 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Volume volume-fd53a6b7-93ee-4a7c-b003-cf6be432dca3 (fd53a6b7-93ee-4a7c-b003-cf6be432dca3): created successfully Mar 05 21:15:40.313982 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5dbac0-26bd-4985-a1c1-e49691a807f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:40.320496 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Flow 'volume_create_manager' (982c1581-252b-436e-8abf-9fedf5699f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:40.328962 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d2076560-4f1f-40b3-9f42-15a031747ee7 tempest-VolumesListAdminTestJSON-1996774731 None] Created volume successfully. Mar 05 21:15:41.522143 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-4f98f41e-70d8-4574-ae97-0d5d64613522 tempest-VolumesBackupsTest-1617152067 None] Lock "b'cinder-47b94a70-47d6-4b47-9cf2-6c025f612fb4-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:15:41.553967 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:15:41.555525 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:15:41.556116 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:15:41.576533 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Flow 'volume_create_manager' (e95fa4b8-9d41-46e5-bbcd-c8b0b657041b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:41.583180 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbefd89-12df-4f37-b5c8-9b74ba992e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:41.597432 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:15:41.615485 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbefd89-12df-4f37-b5c8-9b74ba992e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-878907718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=da49635d-6ced-4b3a-ad4e-a22eec5e1837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa62d3994074b5d8c45eba5b7dfd82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:15:42Z,use_quota=True,user_id='acf061ff833645a5b6646ebe2a639a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:41.620999 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ac5dcf-396c-48b4-8bc0-85588e05690f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:41.625213 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ac5dcf-396c-48b4-8bc0-85588e05690f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:41.631065 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa4f62f-6d8b-4f38-866d-2013ff9abb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:41.635310 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa4f62f-6d8b-4f38-866d-2013ff9abb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da49635d-6ced-4b3a-ad4e-a22eec5e1837', 'volume_name': 'volume-da49635d-6ced-4b3a-ad4e-a22eec5e1837', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:41.640615 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3982b49e-a5d7-46c3-88e3-c0eb69112f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:41.644782 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3982b49e-a5d7-46c3-88e3-c0eb69112f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:41.649568 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5890f76d-cde6-4bca-ade0-bb3bcdf0a32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:41.650682 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Volume da49635d-6ced-4b3a-ad4e-a22eec5e1837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da49635d-6ced-4b3a-ad4e-a22eec5e1837', 'volume_size': 1} Mar 05 21:15:41.651079 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] creating volume 'volume-da49635d-6ced-4b3a-ad4e-a22eec5e1837' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:15:41.652093 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:41.678622 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4f98f41e-70d8-4574-ae97-0d5d64613522 tempest-VolumesBackupsTest-1617152067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:42.100513 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4f98f41e-70d8-4574-ae97-0d5d64613522 tempest-VolumesBackupsTest-1617152067 None] deleting rbd volume volume-47b94a70-47d6-4b47-9cf2-6c025f612fb4 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:15:42.107255 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:15:42.107646 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:15:42.111460 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5890f76d-cde6-4bca-ade0-bb3bcdf0a32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da49635d-6ced-4b3a-ad4e-a22eec5e1837', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:42.117159 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f578e077-6bb1-4268-aca8-938833e8beb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:42.125965 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Volume volume-da49635d-6ced-4b3a-ad4e-a22eec5e1837 (da49635d-6ced-4b3a-ad4e-a22eec5e1837): created successfully Mar 05 21:15:42.130857 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f578e077-6bb1-4268-aca8-938833e8beb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:42.136488 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Flow 'volume_create_manager' (e95fa4b8-9d41-46e5-bbcd-c8b0b657041b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:42.144941 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f3eedb04-6773-4527-a72d-5daa94700102 tempest-VolumesListAdminTestJSON-1996774731 None] Created volume successfully. Mar 05 21:15:42.292475 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4f98f41e-70d8-4574-ae97-0d5d64613522 tempest-VolumesBackupsTest-1617152067 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 21:15:42.323880 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4f98f41e-70d8-4574-ae97-0d5d64613522 tempest-VolumesBackupsTest-1617152067 None] deleting parent snapshot volume-47b94a70-47d6-4b47-9cf2-6c025f612fb4.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 21:15:43.346585 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:15:43.349749 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:15:43.350187 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:15:43.371477 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Flow 'volume_create_manager' (9dfa4df7-e791-4ec5-a7cf-886fc4bcfcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:43.380427 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ee0b7d-3cb1-40af-a6dd-544ee54ae449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:43.395457 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-4f98f41e-70d8-4574-ae97-0d5d64613522 tempest-VolumesBackupsTest-1617152067 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:15:43.414394 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ee0b7d-3cb1-40af-a6dd-544ee54ae449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-814167652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ab462ee0-aaae-4c4b-8c13-dfc86708827a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa62d3994074b5d8c45eba5b7dfd82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:15:43Z,use_quota=True,user_id='acf061ff833645a5b6646ebe2a639a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:43.419887 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfca2b2b-da82-4ae7-b8c8-3569867c1989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:43.426064 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfca2b2b-da82-4ae7-b8c8-3569867c1989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:43.432464 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf5bf30-7e67-463d-9cfa-24ee6a9ddedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:43.436871 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf5bf30-7e67-463d-9cfa-24ee6a9ddedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab462ee0-aaae-4c4b-8c13-dfc86708827a', 'volume_name': 'volume-ab462ee0-aaae-4c4b-8c13-dfc86708827a', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:43.443397 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982045e0-ab73-4c0f-9d20-4c56e7d08811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:43.448283 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982045e0-ab73-4c0f-9d20-4c56e7d08811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:43.453418 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65f7472-899a-483f-b510-526b82d36c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:43.454670 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Volume ab462ee0-aaae-4c4b-8c13-dfc86708827a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab462ee0-aaae-4c4b-8c13-dfc86708827a', 'volume_size': 1} Mar 05 21:15:43.455083 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] creating volume 'volume-ab462ee0-aaae-4c4b-8c13-dfc86708827a' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:15:43.456133 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:43.516614 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-4f98f41e-70d8-4574-ae97-0d5d64613522 tempest-VolumesBackupsTest-1617152067 None] Created reservations ['49c3c993-8bfd-40c6-99a2-a2708fcff222', 'e66462c0-d134-42b5-a641-727485cabc3d', 'dc89b2fb-42a7-4a55-8840-988bf68da3fe', '241e9d2d-3c93-473e-aaf7-608fad8e44f4'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:15:43.561815 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:15:43.562485 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:15:43.567127 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65f7472-899a-483f-b510-526b82d36c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab462ee0-aaae-4c4b-8c13-dfc86708827a', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:43.576235 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74ec823-8ef3-4ce5-883f-ad00ade721aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:43.600668 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Volume volume-ab462ee0-aaae-4c4b-8c13-dfc86708827a (ab462ee0-aaae-4c4b-8c13-dfc86708827a): created successfully Mar 05 21:15:43.608224 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74ec823-8ef3-4ce5-883f-ad00ade721aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:43.615172 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Flow 'volume_create_manager' (9dfa4df7-e791-4ec5-a7cf-886fc4bcfcf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:43.642793 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-340106f0-13c6-4a64-9e46-1e8270b86d79 tempest-VolumesListAdminTestJSON-1996774731 None] Created volume successfully. Mar 05 21:15:43.665139 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4f98f41e-70d8-4574-ae97-0d5d64613522 tempest-VolumesBackupsTest-1617152067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:43.738094 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4f98f41e-70d8-4574-ae97-0d5d64613522 tempest-VolumesBackupsTest-1617152067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:43.786355 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-4f98f41e-70d8-4574-ae97-0d5d64613522 tempest-VolumesBackupsTest-1617152067 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:15:43.792223 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-4f98f41e-70d8-4574-ae97-0d5d64613522 tempest-VolumesBackupsTest-1617152067 None] Deleted volume successfully. Mar 05 21:15:43.813031 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-4f98f41e-70d8-4574-ae97-0d5d64613522 tempest-VolumesBackupsTest-1617152067 None] Lock "b'cinder-47b94a70-47d6-4b47-9cf2-6c025f612fb4-delete_volume'" released by "delete_volume" :: held 2.291s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:15:44.980652 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:15:44.988119 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:15:44.989288 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:15:45.015480 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Flow 'volume_create_manager' (bab6bd4b-92b1-473b-9a9c-abbde294a142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:45.028441 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ddde5f-ee15-464e-8a0e-2b64523c0b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:45.035765 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:15:45.057805 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ddde5f-ee15-464e-8a0e-2b64523c0b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9c050d90-1d29-452f-ac03-dcc00b4a2474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7096bdfe71b44fb98fd2da6f63ab70f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:15:45Z,use_quota=True,user_id='af59b240ee6d41038c66bc9fb835162f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:45.070892 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4208a088-76b3-4b60-8cd6-e78eeb43331c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:45.075497 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4208a088-76b3-4b60-8cd6-e78eeb43331c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:45.081531 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875d2cee-b1f2-4a34-ab32-80c2d9bbe42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:45.104859 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875d2cee-b1f2-4a34-ab32-80c2d9bbe42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c050d90-1d29-452f-ac03-dcc00b4a2474', 'volume_name': 'volume-9c050d90-1d29-452f-ac03-dcc00b4a2474', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:45.122477 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c830f84a-f5c6-4fab-8908-afc08998f1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:45.126841 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c830f84a-f5c6-4fab-8908-afc08998f1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:45.132380 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fcd94bd-38ec-480e-8e1d-b75399aaa7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:45.133573 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Volume 9c050d90-1d29-452f-ac03-dcc00b4a2474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c050d90-1d29-452f-ac03-dcc00b4a2474', 'volume_size': 1} Mar 05 21:15:45.133981 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] creating volume 'volume-9c050d90-1d29-452f-ac03-dcc00b4a2474' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:15:45.135558 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:45.246998 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:15:45.247298 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:15:45.251381 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fcd94bd-38ec-480e-8e1d-b75399aaa7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c050d90-1d29-452f-ac03-dcc00b4a2474', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:45.260865 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789c8293-eb67-4582-9b28-e637be6b18f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:45.286088 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Volume volume-9c050d90-1d29-452f-ac03-dcc00b4a2474 (9c050d90-1d29-452f-ac03-dcc00b4a2474): created successfully Mar 05 21:15:45.294207 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789c8293-eb67-4582-9b28-e637be6b18f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:45.302611 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Flow 'volume_create_manager' (bab6bd4b-92b1-473b-9a9c-abbde294a142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:45.314729 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-edc9d431-fdc5-4655-b572-943bf0e4da71 tempest-VolumesListAdminTestJSON-571940724 None] Created volume successfully. Mar 05 21:15:45.614708 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:15:45.615726 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:45.694985 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:45.794994 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:15:46.113489 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-c10b46ef-c568-44a4-8115-8b8732dec398 req-0daa623b-5e8c-4fd7-b6a6-1f3d25cf127a tempest-TestVolumeBootPattern-160921740 None] Terminate volume connection completed successfully. Mar 05 21:15:46.114232 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-c10b46ef-c568-44a4-8115-8b8732dec398 req-0daa623b-5e8c-4fd7-b6a6-1f3d25cf127a tempest-TestVolumeBootPattern-160921740 None] Deleting attachment d90aad2d-42de-4e63-9443-0b74b1b10b7d. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:15:46.350933 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-687340f9-4465-4b90-b2e0-26f7c1be7d36 tempest-VolumesListAdminTestJSON-571940724 None] Lock "b'cinder-9c050d90-1d29-452f-ac03-dcc00b4a2474-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:15:46.495961 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-687340f9-4465-4b90-b2e0-26f7c1be7d36 tempest-VolumesListAdminTestJSON-571940724 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:46.668394 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-687340f9-4465-4b90-b2e0-26f7c1be7d36 tempest-VolumesListAdminTestJSON-571940724 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:15:46.668830 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-687340f9-4465-4b90-b2e0-26f7c1be7d36 tempest-VolumesListAdminTestJSON-571940724 None] Volume volume-9c050d90-1d29-452f-ac03-dcc00b4a2474 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:15:46.678381 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-687340f9-4465-4b90-b2e0-26f7c1be7d36 tempest-VolumesListAdminTestJSON-571940724 None] deleting rbd volume volume-9c050d90-1d29-452f-ac03-dcc00b4a2474 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:15:46.733619 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:15:46.741243 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:15:46.742037 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:15:46.771987 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Flow 'volume_create_manager' (5f2262f3-f67a-4086-a234-91ee4c98ec81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:46.780004 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ed02e7-f2cf-4277-90b2-6091af244af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:46.785146 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-c10b46ef-c568-44a4-8115-8b8732dec398 req-678e23a7-a972-4fdf-8a05-ca98f4d09ca7 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-163f1fe5-b8e6-4ca7-abae-0c48827fcb75-delete_volume'" acquired by "delete_volume" :: waited 0.099s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:15:46.788411 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-303246c6-bfee-4a06-8bc5-5ad868b47fd0 tempest-VolumesListAdminTestJSON-1996774731 None] Lock "b'cinder-ab462ee0-aaae-4c4b-8c13-dfc86708827a-delete_volume'" acquired by "delete_volume" :: waited 0.089s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:15:46.796696 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [req-c10b46ef-c568-44a4-8115-8b8732dec398 req-678e23a7-a972-4fdf-8a05-ca98f4d09ca7 tempest-TestVolumeBootPattern-160921740 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:15:46.835775 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ed02e7-f2cf-4277-90b2-6091af244af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-581054859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9e1d6099-db5b-4200-bae1-af2e6f129ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b535d20f00c4006a3dab8344bf4b2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:15:47Z,use_quota=True,user_id='c38e82a671f243b39615cd0cc9828531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:46.842424 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fd9c18-15b9-45a5-9bc8-e18cfd96a586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:46.847703 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fd9c18-15b9-45a5-9bc8-e18cfd96a586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:46.853924 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b21304-53c4-4370-b6c8-a50745f52c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:46.858764 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b21304-53c4-4370-b6c8-a50745f52c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e1d6099-db5b-4200-bae1-af2e6f129ed8', 'volume_name': 'volume-9e1d6099-db5b-4200-bae1-af2e6f129ed8', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:46.865137 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a58fdd-5bae-4724-8745-25d311f3a756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:46.870074 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a58fdd-5bae-4724-8745-25d311f3a756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:46.881657 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27249fb7-e6eb-48c6-a3bd-c4143ce89f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:46.883579 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Volume 9e1d6099-db5b-4200-bae1-af2e6f129ed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e1d6099-db5b-4200-bae1-af2e6f129ed8', 'volume_size': 1} Mar 05 21:15:46.884394 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] creating volume 'volume-9e1d6099-db5b-4200-bae1-af2e6f129ed8' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:15:46.886048 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:47.038880 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-c10b46ef-c568-44a4-8115-8b8732dec398 req-678e23a7-a972-4fdf-8a05-ca98f4d09ca7 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:47.192953 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-c10b46ef-c568-44a4-8115-8b8732dec398 req-678e23a7-a972-4fdf-8a05-ca98f4d09ca7 tempest-TestVolumeBootPattern-160921740 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:15:47.203287 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-c10b46ef-c568-44a4-8115-8b8732dec398 req-678e23a7-a972-4fdf-8a05-ca98f4d09ca7 tempest-TestVolumeBootPattern-160921740 None] deleting rbd volume volume-163f1fe5-b8e6-4ca7-abae-0c48827fcb75 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:15:47.214315 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:15:47.214823 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:15:47.242938 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27249fb7-e6eb-48c6-a3bd-c4143ce89f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1d6099-db5b-4200-bae1-af2e6f129ed8', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:47.256964 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ff3e05-5cfc-49c4-87f6-2d0c7dac6725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:47.279342 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-303246c6-bfee-4a06-8bc5-5ad868b47fd0 tempest-VolumesListAdminTestJSON-1996774731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:47.383583 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-303246c6-bfee-4a06-8bc5-5ad868b47fd0 tempest-VolumesListAdminTestJSON-1996774731 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:15:47.384072 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-303246c6-bfee-4a06-8bc5-5ad868b47fd0 tempest-VolumesListAdminTestJSON-1996774731 None] Volume volume-ab462ee0-aaae-4c4b-8c13-dfc86708827a is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:15:47.392002 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-303246c6-bfee-4a06-8bc5-5ad868b47fd0 tempest-VolumesListAdminTestJSON-1996774731 None] deleting rbd volume volume-ab462ee0-aaae-4c4b-8c13-dfc86708827a {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:15:47.403141 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Volume volume-9e1d6099-db5b-4200-bae1-af2e6f129ed8 (9e1d6099-db5b-4200-bae1-af2e6f129ed8): created successfully Mar 05 21:15:47.407781 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ff3e05-5cfc-49c4-87f6-2d0c7dac6725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:47.417440 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Flow 'volume_create_manager' (5f2262f3-f67a-4086-a234-91ee4c98ec81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:47.449223 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-aacaf22a-f111-4765-a75a-fe736e26d457 tempest-VolumesNegativeTest-1852983499 None] Created volume successfully. Mar 05 21:15:47.471922 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-687340f9-4465-4b90-b2e0-26f7c1be7d36 tempest-VolumesListAdminTestJSON-571940724 None] Created reservations ['3bf7de35-95e1-49c8-9b7b-200cfb85a6ed', 'ae453dec-f923-4a12-a636-5cba41590545', 'd2b050d8-664f-4593-84e2-1312bdbd30c4', '5df3f6fb-7193-42a8-9094-27d472549447'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:15:47.539586 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-687340f9-4465-4b90-b2e0-26f7c1be7d36 tempest-VolumesListAdminTestJSON-571940724 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:47.591855 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-687340f9-4465-4b90-b2e0-26f7c1be7d36 tempest-VolumesListAdminTestJSON-571940724 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:47.664679 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-687340f9-4465-4b90-b2e0-26f7c1be7d36 tempest-VolumesListAdminTestJSON-571940724 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:15:47.687614 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-687340f9-4465-4b90-b2e0-26f7c1be7d36 tempest-VolumesListAdminTestJSON-571940724 None] Deleted volume successfully. Mar 05 21:15:47.714455 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-687340f9-4465-4b90-b2e0-26f7c1be7d36 tempest-VolumesListAdminTestJSON-571940724 None] Lock "b'cinder-9c050d90-1d29-452f-ac03-dcc00b4a2474-delete_volume'" released by "delete_volume" :: held 1.364s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:15:47.741984 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [req-c10b46ef-c568-44a4-8115-8b8732dec398 req-678e23a7-a972-4fdf-8a05-ca98f4d09ca7 tempest-TestVolumeBootPattern-160921740 None] Created reservations ['d9d9d91a-204a-4b22-b0d4-8ed3e1b03a1d', '781d61ab-b3ff-43f3-86e5-4cbe5523c841', '844241ff-c30e-4a4d-a334-d26846d7d4c6', '0a863577-e77c-40d3-8e02-a507ce2279c5'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:15:47.848047 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-c10b46ef-c568-44a4-8115-8b8732dec398 req-678e23a7-a972-4fdf-8a05-ca98f4d09ca7 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:47.939558 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-c10b46ef-c568-44a4-8115-8b8732dec398 req-678e23a7-a972-4fdf-8a05-ca98f4d09ca7 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:47.989216 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [req-c10b46ef-c568-44a4-8115-8b8732dec398 req-678e23a7-a972-4fdf-8a05-ca98f4d09ca7 tempest-TestVolumeBootPattern-160921740 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:15:48.001754 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-c10b46ef-c568-44a4-8115-8b8732dec398 req-678e23a7-a972-4fdf-8a05-ca98f4d09ca7 tempest-TestVolumeBootPattern-160921740 None] Deleted volume successfully. Mar 05 21:15:48.030674 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-c10b46ef-c568-44a4-8115-8b8732dec398 req-678e23a7-a972-4fdf-8a05-ca98f4d09ca7 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-163f1fe5-b8e6-4ca7-abae-0c48827fcb75-delete_volume'" released by "delete_volume" :: held 1.245s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:15:48.048280 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-303246c6-bfee-4a06-8bc5-5ad868b47fd0 tempest-VolumesListAdminTestJSON-1996774731 None] Created reservations ['060ba563-ee5b-4fe2-9d2a-ba6a2cf20675', '4d5c867e-299e-4afe-b196-431d1bf3549b', 'dc17c371-d542-4aab-8048-686394137cfd', '5a5b336b-5fba-4949-bc19-9af90c46e74c'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:15:48.128815 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-303246c6-bfee-4a06-8bc5-5ad868b47fd0 tempest-VolumesListAdminTestJSON-1996774731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:48.190139 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-303246c6-bfee-4a06-8bc5-5ad868b47fd0 tempest-VolumesListAdminTestJSON-1996774731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:48.227799 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-303246c6-bfee-4a06-8bc5-5ad868b47fd0 tempest-VolumesListAdminTestJSON-1996774731 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:15:48.231983 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-303246c6-bfee-4a06-8bc5-5ad868b47fd0 tempest-VolumesListAdminTestJSON-1996774731 None] Deleted volume successfully. Mar 05 21:15:48.267030 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-303246c6-bfee-4a06-8bc5-5ad868b47fd0 tempest-VolumesListAdminTestJSON-1996774731 None] Lock "b'cinder-ab462ee0-aaae-4c4b-8c13-dfc86708827a-delete_volume'" released by "delete_volume" :: held 1.478s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:15:48.464483 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-22c6e0e0-ac17-48a3-a750-9aec6f0c37b3 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-aa3b08df-4433-4b4f-ad93-0796031774bf-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:15:48.464483 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-22c6e0e0-ac17-48a3-a750-9aec6f0c37b3 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:49.125505 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-78060077-c17a-4302-900b-ed777119a05a tempest-VolumesListAdminTestJSON-1996774731 None] Lock "b'cinder-da49635d-6ced-4b3a-ad4e-a22eec5e1837-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:15:49.219696 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-78060077-c17a-4302-900b-ed777119a05a tempest-VolumesListAdminTestJSON-1996774731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:49.288893 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-78060077-c17a-4302-900b-ed777119a05a tempest-VolumesListAdminTestJSON-1996774731 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:15:49.289566 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-78060077-c17a-4302-900b-ed777119a05a tempest-VolumesListAdminTestJSON-1996774731 None] Volume volume-da49635d-6ced-4b3a-ad4e-a22eec5e1837 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:15:49.308624 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-78060077-c17a-4302-900b-ed777119a05a tempest-VolumesListAdminTestJSON-1996774731 None] deleting rbd volume volume-da49635d-6ced-4b3a-ad4e-a22eec5e1837 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:15:49.330728 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:15:49.344628 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:15:49.345924 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:15:49.372399 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Flow 'volume_create_manager' (69cd5f28-b9b9-4001-91e3-68aa05f8db01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:49.381261 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082fbd28-56ca-4585-b155-5a241bd0645b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:49.390105 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:15:49.423803 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082fbd28-56ca-4585-b155-5a241bd0645b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-933075297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=402482a3-a7f5-4c5a-9cb4-3a46f827c903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73f6888043940b9b1344c6998b423da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:15:49Z,use_quota=True,user_id='8bee90d7a5af4246b85ff0cb89217700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:49.431707 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536a9846-0b0b-4b69-a76a-d103d8b9a09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:49.436351 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536a9846-0b0b-4b69-a76a-d103d8b9a09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:49.447058 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e4b6c2-d45b-45b4-bcba-a608ac682bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:49.449499 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e4b6c2-d45b-45b4-bcba-a608ac682bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '402482a3-a7f5-4c5a-9cb4-3a46f827c903', 'volume_name': 'volume-402482a3-a7f5-4c5a-9cb4-3a46f827c903', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:49.455627 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad9aa8fa-1650-4ea9-a4a6-0c25737b340a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:49.460663 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad9aa8fa-1650-4ea9-a4a6-0c25737b340a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:49.465554 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf6f139-334b-4b85-b2ab-ef495a275b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:49.466708 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Volume 402482a3-a7f5-4c5a-9cb4-3a46f827c903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-402482a3-a7f5-4c5a-9cb4-3a46f827c903', 'volume_size': 1} Mar 05 21:15:49.467107 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] creating volume 'volume-402482a3-a7f5-4c5a-9cb4-3a46f827c903' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:15:49.478272 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:49.577374 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:15:49.577765 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:15:49.584174 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf6f139-334b-4b85-b2ab-ef495a275b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-402482a3-a7f5-4c5a-9cb4-3a46f827c903', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:49.590430 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31aac2b-3a20-40eb-a951-ef9103fceeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:49.604894 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Volume volume-402482a3-a7f5-4c5a-9cb4-3a46f827c903 (402482a3-a7f5-4c5a-9cb4-3a46f827c903): created successfully Mar 05 21:15:49.610161 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31aac2b-3a20-40eb-a951-ef9103fceeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:49.619489 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Flow 'volume_create_manager' (69cd5f28-b9b9-4001-91e3-68aa05f8db01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:49.651503 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-a0e5ee9c-6018-47b3-879e-aef558620cd3 tempest-AttachVolumeNegativeTest-1565771773 None] Created volume successfully. Mar 05 21:15:49.687364 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-78060077-c17a-4302-900b-ed777119a05a tempest-VolumesListAdminTestJSON-1996774731 None] Created reservations ['7cd23293-279c-419e-a549-c0e18eced565', 'fa5c4748-a176-4c00-a571-7136a7da3906', 'f4106cc3-e063-468c-98b5-e61e320626e3', 'c3454131-0d69-4992-befc-1228fd33b040'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:15:49.756473 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-78060077-c17a-4302-900b-ed777119a05a tempest-VolumesListAdminTestJSON-1996774731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:49.809554 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-78060077-c17a-4302-900b-ed777119a05a tempest-VolumesListAdminTestJSON-1996774731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:49.868341 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-78060077-c17a-4302-900b-ed777119a05a tempest-VolumesListAdminTestJSON-1996774731 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:15:49.873874 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-78060077-c17a-4302-900b-ed777119a05a tempest-VolumesListAdminTestJSON-1996774731 None] Deleted volume successfully. Mar 05 21:15:49.917904 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-78060077-c17a-4302-900b-ed777119a05a tempest-VolumesListAdminTestJSON-1996774731 None] Lock "b'cinder-da49635d-6ced-4b3a-ad4e-a22eec5e1837-delete_volume'" released by "delete_volume" :: held 0.792s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:15:50.421117 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-a587b199-841f-4dd1-9981-b8d17b3c76a6 tempest-VolumesListAdminTestJSON-1996774731 None] Lock "b'cinder-fd53a6b7-93ee-4a7c-b003-cf6be432dca3-delete_volume'" acquired by "delete_volume" :: waited 0.038s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:15:50.498458 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a587b199-841f-4dd1-9981-b8d17b3c76a6 tempest-VolumesListAdminTestJSON-1996774731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:50.592152 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a587b199-841f-4dd1-9981-b8d17b3c76a6 tempest-VolumesListAdminTestJSON-1996774731 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:15:50.593566 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a587b199-841f-4dd1-9981-b8d17b3c76a6 tempest-VolumesListAdminTestJSON-1996774731 None] Volume volume-fd53a6b7-93ee-4a7c-b003-cf6be432dca3 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:15:50.610243 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a587b199-841f-4dd1-9981-b8d17b3c76a6 tempest-VolumesListAdminTestJSON-1996774731 None] deleting rbd volume volume-fd53a6b7-93ee-4a7c-b003-cf6be432dca3 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:15:51.005886 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-a3ff13e9-3539-4732-931e-bcefd7f06098 req-47c14246-b815-4069-b972-2bac1f880d9e tempest-AttachVolumeNegativeTest-1565771773 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:15:51.116554 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-a587b199-841f-4dd1-9981-b8d17b3c76a6 tempest-VolumesListAdminTestJSON-1996774731 None] Created reservations ['d6d1e5f9-7f44-46a4-b178-8eb48fccf41d', '7420e11f-584c-4d15-9418-2995f75d41f2', 'e4ec1dc1-6cd9-467b-9684-f3f23d9cb370', 'adb1d8c0-a16f-4d96-b9f1-e23325f045a8'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:15:51.210562 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a587b199-841f-4dd1-9981-b8d17b3c76a6 tempest-VolumesListAdminTestJSON-1996774731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:51.253341 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a587b199-841f-4dd1-9981-b8d17b3c76a6 tempest-VolumesListAdminTestJSON-1996774731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:51.323291 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-a587b199-841f-4dd1-9981-b8d17b3c76a6 tempest-VolumesListAdminTestJSON-1996774731 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:15:51.335300 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-a587b199-841f-4dd1-9981-b8d17b3c76a6 tempest-VolumesListAdminTestJSON-1996774731 None] Deleted volume successfully. Mar 05 21:15:51.365611 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-a587b199-841f-4dd1-9981-b8d17b3c76a6 tempest-VolumesListAdminTestJSON-1996774731 None] Lock "b'cinder-fd53a6b7-93ee-4a7c-b003-cf6be432dca3-delete_volume'" released by "delete_volume" :: held 0.944s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:15:52.191817 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-a3ff13e9-3539-4732-931e-bcefd7f06098 req-47c14246-b815-4069-b972-2bac1f880d9e tempest-AttachVolumeNegativeTest-1565771773 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.185s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:15:52.192760 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-a3ff13e9-3539-4732-931e-bcefd7f06098 req-47c14246-b815-4069-b972-2bac1f880d9e tempest-AttachVolumeNegativeTest-1565771773 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-402482a3-a7f5-4c5a-9cb4-3a46f827c903', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '402482a3-a7f5-4c5a-9cb4-3a46f827c903', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:15:52.237753 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-a3ff13e9-3539-4732-931e-bcefd7f06098 req-47c14246-b815-4069-b972-2bac1f880d9e tempest-AttachVolumeNegativeTest-1565771773 None] Connection info returned from driver {'name': 'volumes/volume-402482a3-a7f5-4c5a-9cb4-3a46f827c903', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '402482a3-a7f5-4c5a-9cb4-3a46f827c903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4adffc43-c0a9-4173-8bfd-d74537b1ab01'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:15:52.346903 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-a3ff13e9-3539-4732-931e-bcefd7f06098 req-47c14246-b815-4069-b972-2bac1f880d9e tempest-AttachVolumeNegativeTest-1565771773 None] attachment_update completed successfully. Mar 05 21:15:55.453365 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-2d688b95-3dca-447b-b4eb-560c0b753e81 req-7032bcf1-c640-4bd6-b8c4-538979f4be7f tempest-AttachVolumeNegativeTest-1565771773 None] Terminate volume connection completed successfully. Mar 05 21:15:55.454076 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-2d688b95-3dca-447b-b4eb-560c0b753e81 req-7032bcf1-c640-4bd6-b8c4-538979f4be7f tempest-AttachVolumeNegativeTest-1565771773 None] Deleting attachment 4adffc43-c0a9-4173-8bfd-d74537b1ab01. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:15:57.179642 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:15:57.187379 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:15:57.188532 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:15:57.217562 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Flow 'volume_create_manager' (2a47bc7a-83ac-4f07-bc37-16765e16055b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:57.228737 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31822a0-16aa-4904-9573-f04c7ee22f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:57.242452 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-1d81120c-7595-4c9f-b240-d091ba963a0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:15:57.279397 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31822a0-16aa-4904-9573-f04c7ee22f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1951246180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2b235070-e46f-4802-b5ac-7531e3c2899c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46aa322abe044eb7baa1f99f151b28cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:15:57Z,use_quota=True,user_id='2b581b22102f425daee098c1318c506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:57.287432 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5c54b6-e3ec-404a-b574-4ed3122468dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:57.292060 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5c54b6-e3ec-404a-b574-4ed3122468dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:57.298201 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fece3b37-d5f7-4bfc-8a93-51bcfb421d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:57.303795 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fece3b37-d5f7-4bfc-8a93-51bcfb421d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b235070-e46f-4802-b5ac-7531e3c2899c', 'volume_name': 'volume-2b235070-e46f-4802-b5ac-7531e3c2899c', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:57.309098 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a43f2e-ef74-4a5e-bd9a-5046f1f49d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:57.313673 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a43f2e-ef74-4a5e-bd9a-5046f1f49d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:57.318720 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed02c14-8e1f-4035-8ab4-3d42a350c89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:57.319912 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Volume 2b235070-e46f-4802-b5ac-7531e3c2899c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b235070-e46f-4802-b5ac-7531e3c2899c', 'volume_size': 1} Mar 05 21:15:57.320311 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] creating volume 'volume-2b235070-e46f-4802-b5ac-7531e3c2899c' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:15:57.321367 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:57.486783 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:15:57.487196 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:15:57.493848 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed02c14-8e1f-4035-8ab4-3d42a350c89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b235070-e46f-4802-b5ac-7531e3c2899c', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:57.498670 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45fde3a3-8767-46d4-806a-510f5161111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:15:57.513307 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Volume volume-2b235070-e46f-4802-b5ac-7531e3c2899c (2b235070-e46f-4802-b5ac-7531e3c2899c): created successfully Mar 05 21:15:57.517745 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45fde3a3-8767-46d4-806a-510f5161111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:15:57.525186 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Flow 'volume_create_manager' (2a47bc7a-83ac-4f07-bc37-16765e16055b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:15:57.539846 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-170c37eb-6eb6-4fbf-b92b-b86e7a0d9587 tempest-VolumesSnapshotTestJSON-163973597 None] Created volume successfully. Mar 05 21:15:58.470985 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b53c43e1-ae90-4c6f-aeec-f2b9e403be04 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:15:59.444483 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b53c43e1-ae90-4c6f-aeec-f2b9e403be04 tempest-VolumesSnapshotTestJSON-163973597 None] Create snapshot completed successfully Mar 05 21:16:00.824310 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.driver [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] Creating a new backup for volume volume-2b235070-e46f-4802-b5ac-7531e3c2899c. {{(pid=134747) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1212}} Mar 05 21:16:00.870864 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] cloning volumes/volume-2b235070-e46f-4802-b5ac-7531e3c2899c@snapshot-721f128b-3d36-425b-b691-ec50a945edf6 to volume-b4332c86-ff99-4ed6-b274-653113259fdb {{(pid=134747) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Mar 05 21:16:00.871924 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:00.926694 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:01.112349 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:16:01.112965 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:16:01.135748 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-05T21:16:00Z,data_timestamp=2022-03-05T21:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-938448643',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=0deae2ce-eba9-444d-bec9-6d109df62c50,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='46aa322abe044eb7baa1f99f151b28cc',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='721f128b-3d36-425b-b691-ec50a945edf6',status='creating',temp_snapshot_id=None,temp_volume_id='b4332c86-ff99-4ed6-b274-653113259fdb',updated_at=None,user_id='2b581b22102f425daee098c1318c506e',volume_id=2b235070-e46f-4802-b5ac-7531e3c2899c) Mar 05 21:16:01.137242 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.backup.rpcapi [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] continue_backup in rpcapi backup_id 0deae2ce-eba9-444d-bec9-6d109df62c50 {{(pid=134747) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 05 21:16:01.307010 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:16:01.441179 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b7d2ccc6-58a0-4746-9cd4-57e73f937f92 tempest-AttachVolumeNegativeTest-1565771773 None] Lock "b'cinder-402482a3-a7f5-4c5a-9cb4-3a46f827c903-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:16:01.495538 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b7d2ccc6-58a0-4746-9cd4-57e73f937f92 tempest-AttachVolumeNegativeTest-1565771773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:01.565358 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b7d2ccc6-58a0-4746-9cd4-57e73f937f92 tempest-AttachVolumeNegativeTest-1565771773 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:16:01.566085 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b7d2ccc6-58a0-4746-9cd4-57e73f937f92 tempest-AttachVolumeNegativeTest-1565771773 None] Volume volume-402482a3-a7f5-4c5a-9cb4-3a46f827c903 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:16:01.577633 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b7d2ccc6-58a0-4746-9cd4-57e73f937f92 tempest-AttachVolumeNegativeTest-1565771773 None] deleting rbd volume volume-402482a3-a7f5-4c5a-9cb4-3a46f827c903 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:16:01.967038 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-b7d2ccc6-58a0-4746-9cd4-57e73f937f92 tempest-AttachVolumeNegativeTest-1565771773 None] Created reservations ['ed1d5a3c-6fdb-40b0-82b7-9e5ee105f307', '84f1108f-f1e2-4efa-9606-bdecbb7e674f', '31fc68bc-a6a5-4737-944e-7837f64dee42', '9cb0f39e-6cb2-4eb8-8c9d-79a4c38b948d'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:16:02.040754 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b7d2ccc6-58a0-4746-9cd4-57e73f937f92 tempest-AttachVolumeNegativeTest-1565771773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:02.102752 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b7d2ccc6-58a0-4746-9cd4-57e73f937f92 tempest-AttachVolumeNegativeTest-1565771773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:02.138287 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-b7d2ccc6-58a0-4746-9cd4-57e73f937f92 tempest-AttachVolumeNegativeTest-1565771773 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:16:02.145099 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b7d2ccc6-58a0-4746-9cd4-57e73f937f92 tempest-AttachVolumeNegativeTest-1565771773 None] Deleted volume successfully. Mar 05 21:16:02.149923 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.843s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:16:02.150559 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b4332c86-ff99-4ed6-b274-653113259fdb', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'b4332c86-ff99-4ed6-b274-653113259fdb', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:16:02.165336 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b7d2ccc6-58a0-4746-9cd4-57e73f937f92 tempest-AttachVolumeNegativeTest-1565771773 None] Lock "b'cinder-402482a3-a7f5-4c5a-9cb4-3a46f827c903-delete_volume'" released by "delete_volume" :: held 0.725s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:16:02.168320 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] Initialize volume connection completed successfully. Mar 05 21:16:02.669600 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-239015d7-cfc1-45d2-b662-4a10c4dcf1b4 tempest-AttachVolumeNegativeTest-1565771773 None] Lock "b'cinder-1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:16:02.710436 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-239015d7-cfc1-45d2-b662-4a10c4dcf1b4 tempest-AttachVolumeNegativeTest-1565771773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:02.802417 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-239015d7-cfc1-45d2-b662-4a10c4dcf1b4 tempest-AttachVolumeNegativeTest-1565771773 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:16:02.802852 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-239015d7-cfc1-45d2-b662-4a10c4dcf1b4 tempest-AttachVolumeNegativeTest-1565771773 None] Volume volume-1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:16:02.829757 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-239015d7-cfc1-45d2-b662-4a10c4dcf1b4 tempest-AttachVolumeNegativeTest-1565771773 None] deleting rbd volume volume-1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:16:03.688642 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-f19f8fe3-66fb-4ab7-8c07-f9c4b5faa6e5 req-ab114143-315a-445b-ac9b-420a5d588f71 tempest-AttachVolumeShelveTestJSON-1318940295 None] No connector for attachment 3c161be8-d8c2-41e4-929d-4b2beab7729b; skipping storage backend terminate_connection call. {{(pid=134747) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4908}} Mar 05 21:16:03.689390 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-f19f8fe3-66fb-4ab7-8c07-f9c4b5faa6e5 req-ab114143-315a-445b-ac9b-420a5d588f71 tempest-AttachVolumeShelveTestJSON-1318940295 None] Deleting attachment 3c161be8-d8c2-41e4-929d-4b2beab7729b. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:16:03.803124 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-239015d7-cfc1-45d2-b662-4a10c4dcf1b4 tempest-AttachVolumeNegativeTest-1565771773 None] Created reservations ['68329aa0-bca7-4eec-8db3-6fd3ae65fe12', 'bbb68cf6-7f28-4011-8a01-f8bdf15c8f3b', '75465124-698b-487b-beaf-b5790e63cd09', 'a514d007-44aa-4e95-980c-a64720c11288'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:16:03.898095 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-239015d7-cfc1-45d2-b662-4a10c4dcf1b4 tempest-AttachVolumeNegativeTest-1565771773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:03.968607 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-239015d7-cfc1-45d2-b662-4a10c4dcf1b4 tempest-AttachVolumeNegativeTest-1565771773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:04.031368 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-239015d7-cfc1-45d2-b662-4a10c4dcf1b4 tempest-AttachVolumeNegativeTest-1565771773 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:16:04.041872 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-239015d7-cfc1-45d2-b662-4a10c4dcf1b4 tempest-AttachVolumeNegativeTest-1565771773 None] Deleted volume successfully. Mar 05 21:16:04.076942 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-239015d7-cfc1-45d2-b662-4a10c4dcf1b4 tempest-AttachVolumeNegativeTest-1565771773 None] Lock "b'cinder-1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f-delete_volume'" released by "delete_volume" :: held 1.407s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:16:05.161452 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-40b61b34-048d-4df5-bd0e-4f2438015568 tempest-AttachVolumeNegativeTest-1565771773 None] Lock "b'cinder-0a4054d8-18e9-4856-b7b4-20817b2ed9e5-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:16:05.236623 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-40b61b34-048d-4df5-bd0e-4f2438015568 tempest-AttachVolumeNegativeTest-1565771773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:05.320753 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-40b61b34-048d-4df5-bd0e-4f2438015568 tempest-AttachVolumeNegativeTest-1565771773 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:16:05.321258 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-40b61b34-048d-4df5-bd0e-4f2438015568 tempest-AttachVolumeNegativeTest-1565771773 None] Volume volume-0a4054d8-18e9-4856-b7b4-20817b2ed9e5 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:16:05.350712 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-40b61b34-048d-4df5-bd0e-4f2438015568 tempest-AttachVolumeNegativeTest-1565771773 None] deleting rbd volume volume-0a4054d8-18e9-4856-b7b4-20817b2ed9e5 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:16:06.072817 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-40b61b34-048d-4df5-bd0e-4f2438015568 tempest-AttachVolumeNegativeTest-1565771773 None] Created reservations ['c2f074e5-825d-4384-9409-c16d132bbb00', 'ada0d135-3759-41d3-bc52-e36580d5cd14', '59812191-5bfd-4014-bf1a-046129016f90', '64f0545a-b4d0-4a3e-b79e-54747c805434'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:16:06.147471 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-40b61b34-048d-4df5-bd0e-4f2438015568 tempest-AttachVolumeNegativeTest-1565771773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:06.203229 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-40b61b34-048d-4df5-bd0e-4f2438015568 tempest-AttachVolumeNegativeTest-1565771773 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:06.283915 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-40b61b34-048d-4df5-bd0e-4f2438015568 tempest-AttachVolumeNegativeTest-1565771773 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:16:06.290537 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-40b61b34-048d-4df5-bd0e-4f2438015568 tempest-AttachVolumeNegativeTest-1565771773 None] Deleted volume successfully. Mar 05 21:16:06.316681 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-40b61b34-048d-4df5-bd0e-4f2438015568 tempest-AttachVolumeNegativeTest-1565771773 None] Lock "b'cinder-0a4054d8-18e9-4856-b7b4-20817b2ed9e5-delete_volume'" released by "delete_volume" :: held 1.155s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:16:11.542035 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-08accd58-0229-4251-8ae9-e57701113c27 tempest-VolumesNegativeTest-1852983499 None] Lock "b'cinder-9e1d6099-db5b-4200-bae1-af2e6f129ed8-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:16:11.707242 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-08accd58-0229-4251-8ae9-e57701113c27 tempest-VolumesNegativeTest-1852983499 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:11.827030 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-08accd58-0229-4251-8ae9-e57701113c27 tempest-VolumesNegativeTest-1852983499 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:16:11.827839 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-08accd58-0229-4251-8ae9-e57701113c27 tempest-VolumesNegativeTest-1852983499 None] Volume volume-9e1d6099-db5b-4200-bae1-af2e6f129ed8 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:16:11.852233 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-08accd58-0229-4251-8ae9-e57701113c27 tempest-VolumesNegativeTest-1852983499 None] deleting rbd volume volume-9e1d6099-db5b-4200-bae1-af2e6f129ed8 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:16:12.599816 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-08accd58-0229-4251-8ae9-e57701113c27 tempest-VolumesNegativeTest-1852983499 None] Created reservations ['ce11c29f-6601-4074-a862-1afca8a2e4ec', 'dc858d46-16c1-4005-9b1c-d28ddf3d5a9d', 'ecf1b209-24e2-46f1-97be-0e975fe688d2', 'c9b31bb2-ee5d-452b-80c9-17f1ca53c398'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:16:12.705721 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-08accd58-0229-4251-8ae9-e57701113c27 tempest-VolumesNegativeTest-1852983499 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:12.762234 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-08accd58-0229-4251-8ae9-e57701113c27 tempest-VolumesNegativeTest-1852983499 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:12.876082 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-08accd58-0229-4251-8ae9-e57701113c27 tempest-VolumesNegativeTest-1852983499 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:16:12.886168 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-08accd58-0229-4251-8ae9-e57701113c27 tempest-VolumesNegativeTest-1852983499 None] Deleted volume successfully. Mar 05 21:16:12.924092 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-08accd58-0229-4251-8ae9-e57701113c27 tempest-VolumesNegativeTest-1852983499 None] Lock "b'cinder-9e1d6099-db5b-4200-bae1-af2e6f129ed8-delete_volume'" released by "delete_volume" :: held 1.381s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:16:15.661750 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] Terminate volume connection completed successfully. Mar 05 21:16:15.705831 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] Remove volume export completed successfully. Mar 05 21:16:15.778901 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-b4332c86-ff99-4ed6-b274-653113259fdb-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:16:15.806643 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:15.945045 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:16:15.968013 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] deleting rbd volume volume-b4332c86-ff99-4ed6-b274-653113259fdb {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:16:16.539715 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] Deleted volume successfully. Mar 05 21:16:16.545938 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-617d9854-f3b5-4080-a304-617252073d6b tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-b4332c86-ff99-4ed6-b274-653113259fdb-delete_volume'" released by "delete_volume" :: held 0.767s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:16:18.659354 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-22c6e0e0-ac17-48a3-a750-9aec6f0c37b3 tempest-TestVolumeBootPattern-160921740 None] Created reservations ['1c57f2c4-1888-4ca6-80aa-3eb1ece64ee2', '3173b8ad-9d9e-4f23-bd52-429dad5fc838', 'a84c00f4-2196-42d1-bd11-6e821d906a82', '86849919-81eb-471c-88e8-bcb8fa0153a8'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:16:18.797036 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-22c6e0e0-ac17-48a3-a750-9aec6f0c37b3 tempest-TestVolumeBootPattern-160921740 None] Delete snapshot completed successfully. Mar 05 21:16:18.811303 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-22c6e0e0-ac17-48a3-a750-9aec6f0c37b3 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-aa3b08df-4433-4b4f-ad93-0796031774bf-delete_snapshot'" released by "delete_snapshot" :: held 30.434s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:16:23.170467 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-97c14861-775c-4505-9dd2-d67b74859a45 req-aa77f025-6681-4504-a78f-28d75c657b87 tempest-TestVolumeBootPattern-160921740 None] Terminate volume connection completed successfully. Mar 05 21:16:23.171189 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-97c14861-775c-4505-9dd2-d67b74859a45 req-aa77f025-6681-4504-a78f-28d75c657b87 tempest-TestVolumeBootPattern-160921740 None] Deleting attachment 90506c1b-f3f5-4e4d-9bda-35107c9fb4ae. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:16:23.376236 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-97c14861-775c-4505-9dd2-d67b74859a45 req-9ef938da-7e34-4e74-bda1-9d9f73f04cf1 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-bfb78306-e19f-4d73-9333-7d277b32418e-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:16:23.496273 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-97c14861-775c-4505-9dd2-d67b74859a45 req-9ef938da-7e34-4e74-bda1-9d9f73f04cf1 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:23.626655 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-97c14861-775c-4505-9dd2-d67b74859a45 req-9ef938da-7e34-4e74-bda1-9d9f73f04cf1 tempest-TestVolumeBootPattern-160921740 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:16:23.638866 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-97c14861-775c-4505-9dd2-d67b74859a45 req-9ef938da-7e34-4e74-bda1-9d9f73f04cf1 tempest-TestVolumeBootPattern-160921740 None] deleting rbd volume volume-bfb78306-e19f-4d73-9333-7d277b32418e {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:16:24.100927 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-97c14861-775c-4505-9dd2-d67b74859a45 req-9ef938da-7e34-4e74-bda1-9d9f73f04cf1 tempest-TestVolumeBootPattern-160921740 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 21:16:24.149687 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-97c14861-775c-4505-9dd2-d67b74859a45 req-9ef938da-7e34-4e74-bda1-9d9f73f04cf1 tempest-TestVolumeBootPattern-160921740 None] deleting parent snapshot volume-bfb78306-e19f-4d73-9333-7d277b32418e.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 21:16:25.436290 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [req-97c14861-775c-4505-9dd2-d67b74859a45 req-9ef938da-7e34-4e74-bda1-9d9f73f04cf1 tempest-TestVolumeBootPattern-160921740 None] Created reservations ['84f2fdbe-515d-45f5-af11-ecd95d8aa483', '58d5095a-35bb-41a5-b478-95f284d17234', '326ccdb6-848f-453b-8f5d-61e7f2926111', 'a726ec81-71dd-496d-95fb-e9cda92ac6af'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:16:25.567755 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-97c14861-775c-4505-9dd2-d67b74859a45 req-9ef938da-7e34-4e74-bda1-9d9f73f04cf1 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:25.624531 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-97c14861-775c-4505-9dd2-d67b74859a45 req-9ef938da-7e34-4e74-bda1-9d9f73f04cf1 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:25.677012 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [req-97c14861-775c-4505-9dd2-d67b74859a45 req-9ef938da-7e34-4e74-bda1-9d9f73f04cf1 tempest-TestVolumeBootPattern-160921740 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:16:25.682792 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-97c14861-775c-4505-9dd2-d67b74859a45 req-9ef938da-7e34-4e74-bda1-9d9f73f04cf1 tempest-TestVolumeBootPattern-160921740 None] Deleted volume successfully. Mar 05 21:16:25.709186 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-97c14861-775c-4505-9dd2-d67b74859a45 req-9ef938da-7e34-4e74-bda1-9d9f73f04cf1 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-bfb78306-e19f-4d73-9333-7d277b32418e-delete_volume'" released by "delete_volume" :: held 2.333s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:16:31.031121 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:16:31.077021 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:16:31.078524 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:16:31.136778 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Flow 'volume_create_manager' (185abe8a-7a1f-48e9-bf36-13dffcd58dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:16:31.146466 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73782e8e-3849-4497-9b3b-4689237780f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:16:31.153639 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:16:31.179269 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73782e8e-3849-4497-9b3b-4689237780f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-113840388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d12389cd-038b-48ad-9624-b01e46ae00b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdcb29011e61419981c5bfc5f10677c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:16:31Z,use_quota=True,user_id='0c07bd2946594c3e8848bca133da0d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:16:31.185954 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c43b881-cacf-4845-812f-6e56efc67cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:16:31.191258 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c43b881-cacf-4845-812f-6e56efc67cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:16:31.196801 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5044fb4-8002-4917-ac21-c70807a810ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:16:31.312915 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5044fb4-8002-4917-ac21-c70807a810ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd12389cd-038b-48ad-9624-b01e46ae00b5', 'volume_name': 'volume-d12389cd-038b-48ad-9624-b01e46ae00b5', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:16:31.323837 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f0ec65-a777-4690-b8cc-dd0bfcd28645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:16:31.329901 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f0ec65-a777-4690-b8cc-dd0bfcd28645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:16:31.339259 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f864ac28-3f3e-4045-a985-13d39f5dc856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:16:31.340502 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Volume d12389cd-038b-48ad-9624-b01e46ae00b5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d12389cd-038b-48ad-9624-b01e46ae00b5', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 21:16:31.341174 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Cloning d12389cd-038b-48ad-9624-b01e46ae00b5 from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 21:16:31.358177 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:16:31.373377 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 16, 31, 363024)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:16:31.374056 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:16:31.374461 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Found cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 05 21:16:31.380361 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:16:31.381459 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 21:16:31.389508 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 16, 31, 386946)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:16:31.390194 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:16:31.390757 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Creating from source image-volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7 {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 05 21:16:31.409628 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:31.510639 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] creating snapshot='volume-d12389cd-038b-48ad-9624-b01e46ae00b5.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 21:16:32.232161 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] cloning 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7@volume-d12389cd-038b-48ad-9624-b01e46ae00b5.clone_snap' to 'volume-d12389cd-038b-48ad-9624-b01e46ae00b5' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 21:16:32.465147 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a.deleted is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:16:32.466419 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:16:32.466794 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:16:32.504895 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 21:16:32.505878 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Marking volume d12389cd-038b-48ad-9624-b01e46ae00b5 as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 21:16:32.519571 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to d12389cd-038b-48ad-9624-b01e46ae00b5. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 21:16:32.520882 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Creating volume glance metadata for volume d12389cd-038b-48ad-9624-b01e46ae00b5 backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 21:16:32.586744 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f864ac28-3f3e-4045-a985-13d39f5dc856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d12389cd-038b-48ad-9624-b01e46ae00b5', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:16:32.591707 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ad4361-27b6-4ffe-8cb1-e01438e614bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:16:32.601349 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Volume volume-d12389cd-038b-48ad-9624-b01e46ae00b5 (d12389cd-038b-48ad-9624-b01e46ae00b5): created successfully Mar 05 21:16:32.605940 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ad4361-27b6-4ffe-8cb1-e01438e614bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:16:32.611837 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Flow 'volume_create_manager' (185abe8a-7a1f-48e9-bf36-13dffcd58dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:16:32.620390 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c6b3c6e3-b4b4-4374-a2f6-d8ebaed9f486 tempest-TestVolumeBootPattern-160921740 None] Created volume successfully. Mar 05 21:16:34.483048 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:16:34.487453 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:16:34.488312 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:16:34.512276 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Flow 'volume_create_manager' (b43ac653-c601-4ad1-90c5-4e46216b1023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:16:34.521010 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9d182b-f449-4f4a-b1c8-0d62ee77efd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:16:34.528006 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:16:34.544225 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9d182b-f449-4f4a-b1c8-0d62ee77efd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1664041187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2406c7fe-3a07-47be-8091-9b368ce0b6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46aa322abe044eb7baa1f99f151b28cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:16:34Z,use_quota=True,user_id='2b581b22102f425daee098c1318c506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:16:34.551308 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d92294-a070-4441-acab-39ff83306913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:16:34.555762 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d92294-a070-4441-acab-39ff83306913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:16:34.561304 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672a7778-a09d-4ecb-9ba8-7f340e1458cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:16:34.666695 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672a7778-a09d-4ecb-9ba8-7f340e1458cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2406c7fe-3a07-47be-8091-9b368ce0b6e5', 'volume_name': 'volume-2406c7fe-3a07-47be-8091-9b368ce0b6e5', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:16:34.673605 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c05ec7-37ad-4020-bd44-e296cc712fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:16:34.679448 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c05ec7-37ad-4020-bd44-e296cc712fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:16:34.686020 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209c1eea-e0aa-4908-b984-a1480c30cda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:16:34.687747 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Volume 2406c7fe-3a07-47be-8091-9b368ce0b6e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2406c7fe-3a07-47be-8091-9b368ce0b6e5', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 21:16:34.688627 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Cloning 2406c7fe-3a07-47be-8091-9b368ce0b6e5 from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 21:16:34.703632 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:16:34.723841 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 16, 34, 710473)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:16:34.724696 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:16:34.725680 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Found cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 05 21:16:34.743455 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 0.040s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:16:34.752868 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 21:16:34.770241 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 16, 34, 756495)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:16:34.770661 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:16:34.771058 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Creating from source image-volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7 {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 05 21:16:34.816905 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:34.976323 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] creating snapshot='volume-2406c7fe-3a07-47be-8091-9b368ce0b6e5.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 21:16:35.442090 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] cloning 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7@volume-2406c7fe-3a07-47be-8091-9b368ce0b6e5.clone_snap' to 'volume-2406c7fe-3a07-47be-8091-9b368ce0b6e5' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 21:16:35.640086 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a.deleted is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:16:35.643137 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:16:35.644896 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:16:35.667377 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 21:16:35.668067 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Marking volume 2406c7fe-3a07-47be-8091-9b368ce0b6e5 as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 21:16:35.676594 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to 2406c7fe-3a07-47be-8091-9b368ce0b6e5. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 21:16:35.677169 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Creating volume glance metadata for volume 2406c7fe-3a07-47be-8091-9b368ce0b6e5 backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 21:16:35.727116 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209c1eea-e0aa-4908-b984-a1480c30cda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2406c7fe-3a07-47be-8091-9b368ce0b6e5', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:16:35.731790 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553bac7f-c9b3-47ec-afb7-ce82d20963fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:16:35.741275 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Volume volume-2406c7fe-3a07-47be-8091-9b368ce0b6e5 (2406c7fe-3a07-47be-8091-9b368ce0b6e5): created successfully Mar 05 21:16:35.745047 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553bac7f-c9b3-47ec-afb7-ce82d20963fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:16:35.750673 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Flow 'volume_create_manager' (b43ac653-c601-4ad1-90c5-4e46216b1023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:16:35.759456 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-1de1f000-9dd6-4294-882a-3cf797b4a9f4 tempest-VolumesSnapshotTestJSON-163973597 None] Created volume successfully. Mar 05 21:16:36.140919 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-79aa95f1-2b28-4803-9245-6192bc0a4e06 req-dc7f8921-edfd-45f6-ba6d-f8dd9cbbf55b tempest-TestVolumeBootPattern-160921740 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:16:37.128108 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-b2afebde-a501-4030-ac14-d07de4b2cba8 req-9a32d34e-d966-4296-8480-c04c05f2a0f6 tempest-VolumesSnapshotTestJSON-163973597 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:16:37.155869 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-79aa95f1-2b28-4803-9245-6192bc0a4e06 req-dc7f8921-edfd-45f6-ba6d-f8dd9cbbf55b tempest-TestVolumeBootPattern-160921740 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.014s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:16:37.157887 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-79aa95f1-2b28-4803-9245-6192bc0a4e06 req-dc7f8921-edfd-45f6-ba6d-f8dd9cbbf55b tempest-TestVolumeBootPattern-160921740 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d12389cd-038b-48ad-9624-b01e46ae00b5', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'd12389cd-038b-48ad-9624-b01e46ae00b5', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:16:37.210490 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-79aa95f1-2b28-4803-9245-6192bc0a4e06 req-dc7f8921-edfd-45f6-ba6d-f8dd9cbbf55b tempest-TestVolumeBootPattern-160921740 None] Connection info returned from driver {'name': 'volumes/volume-d12389cd-038b-48ad-9624-b01e46ae00b5', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd12389cd-038b-48ad-9624-b01e46ae00b5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '26e3120a-64a7-4f78-83fa-1ef1f81359a4'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:16:37.280599 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-79aa95f1-2b28-4803-9245-6192bc0a4e06 req-dc7f8921-edfd-45f6-ba6d-f8dd9cbbf55b tempest-TestVolumeBootPattern-160921740 None] attachment_update completed successfully. Mar 05 21:16:38.011880 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-b2afebde-a501-4030-ac14-d07de4b2cba8 req-9a32d34e-d966-4296-8480-c04c05f2a0f6 tempest-VolumesSnapshotTestJSON-163973597 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.884s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:16:38.012431 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-b2afebde-a501-4030-ac14-d07de4b2cba8 req-9a32d34e-d966-4296-8480-c04c05f2a0f6 tempest-VolumesSnapshotTestJSON-163973597 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2406c7fe-3a07-47be-8091-9b368ce0b6e5', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '2406c7fe-3a07-47be-8091-9b368ce0b6e5', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:16:38.051135 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-b2afebde-a501-4030-ac14-d07de4b2cba8 req-9a32d34e-d966-4296-8480-c04c05f2a0f6 tempest-VolumesSnapshotTestJSON-163973597 None] Connection info returned from driver {'name': 'volumes/volume-2406c7fe-3a07-47be-8091-9b368ce0b6e5', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2406c7fe-3a07-47be-8091-9b368ce0b6e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4c6d55ef-12d2-477f-a4ae-64647292e01a'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:16:38.124364 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-b2afebde-a501-4030-ac14-d07de4b2cba8 req-9a32d34e-d966-4296-8480-c04c05f2a0f6 tempest-VolumesSnapshotTestJSON-163973597 None] attachment_update completed successfully. Mar 05 21:16:40.353628 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-af1dbd32-9b5b-4ed1-ba76-fe307411e797 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:41.198196 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-af1dbd32-9b5b-4ed1-ba76-fe307411e797 tempest-VolumesSnapshotTestJSON-163973597 None] Create snapshot completed successfully Mar 05 21:16:41.568721 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6f2f4636-3441-4912-8e4f-c2f43213355b tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:42.248353 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6f2f4636-3441-4912-8e4f-c2f43213355b tempest-VolumesSnapshotTestJSON-163973597 None] Create snapshot completed successfully Mar 05 21:16:42.751753 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-21359cb2-fad2-401c-a15f-07d903cef2ab tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:43.276275 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-21359cb2-fad2-401c-a15f-07d903cef2ab tempest-VolumesSnapshotTestJSON-163973597 None] Create snapshot completed successfully Mar 05 21:16:43.831422 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-6c0663be-a148-442f-b2bd-ed96a58243ff tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-344240e4-cd44-4671-bbc8-656f169007e0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:16:43.832968 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6c0663be-a148-442f-b2bd-ed96a58243ff tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:45.612592 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:16:45.613984 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:45.645596 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:16:45.683075 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:17:08.068889 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-21c515fb-7f7f-4e0b-b654-3137b143055c tempest-AttachVolumeShelveTestJSON-1318940295 None] Lock "b'cinder-2c43501d-253b-49b5-9c77-8a8e525b5831-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:17:08.120415 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-21c515fb-7f7f-4e0b-b654-3137b143055c tempest-AttachVolumeShelveTestJSON-1318940295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:08.200270 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-21c515fb-7f7f-4e0b-b654-3137b143055c tempest-AttachVolumeShelveTestJSON-1318940295 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:17:08.200835 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-21c515fb-7f7f-4e0b-b654-3137b143055c tempest-AttachVolumeShelveTestJSON-1318940295 None] Volume volume-2c43501d-253b-49b5-9c77-8a8e525b5831 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:17:08.213602 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-21c515fb-7f7f-4e0b-b654-3137b143055c tempest-AttachVolumeShelveTestJSON-1318940295 None] deleting rbd volume volume-2c43501d-253b-49b5-9c77-8a8e525b5831 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:17:08.550419 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-21c515fb-7f7f-4e0b-b654-3137b143055c tempest-AttachVolumeShelveTestJSON-1318940295 None] Created reservations ['87819c3b-3ea0-4106-8256-604e70af5669', 'e875e2ed-fc02-4e07-a81e-ae9a311a898a', 'e32ea39e-abd1-4269-b658-c22de11b2398', '1ff3fd87-5dae-4971-884c-8a4e42850bba'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:17:08.602912 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-21c515fb-7f7f-4e0b-b654-3137b143055c tempest-AttachVolumeShelveTestJSON-1318940295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:08.632578 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-21c515fb-7f7f-4e0b-b654-3137b143055c tempest-AttachVolumeShelveTestJSON-1318940295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:08.664899 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-21c515fb-7f7f-4e0b-b654-3137b143055c tempest-AttachVolumeShelveTestJSON-1318940295 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:17:08.670551 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-21c515fb-7f7f-4e0b-b654-3137b143055c tempest-AttachVolumeShelveTestJSON-1318940295 None] Deleted volume successfully. Mar 05 21:17:08.684133 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-21c515fb-7f7f-4e0b-b654-3137b143055c tempest-AttachVolumeShelveTestJSON-1318940295 None] Lock "b'cinder-2c43501d-253b-49b5-9c77-8a8e525b5831-delete_volume'" released by "delete_volume" :: held 0.615s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:17:09.296988 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-fe86af54-7a65-4dc6-8863-43f6776674e0 tempest-AttachVolumeShelveTestJSON-1318940295 None] Lock "b'cinder-e28a20a7-45f6-4921-9f87-076085057103-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:17:09.332153 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fe86af54-7a65-4dc6-8863-43f6776674e0 tempest-AttachVolumeShelveTestJSON-1318940295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:09.377184 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fe86af54-7a65-4dc6-8863-43f6776674e0 tempest-AttachVolumeShelveTestJSON-1318940295 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:17:09.377930 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fe86af54-7a65-4dc6-8863-43f6776674e0 tempest-AttachVolumeShelveTestJSON-1318940295 None] Volume volume-e28a20a7-45f6-4921-9f87-076085057103 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:17:09.388932 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fe86af54-7a65-4dc6-8863-43f6776674e0 tempest-AttachVolumeShelveTestJSON-1318940295 None] deleting rbd volume volume-e28a20a7-45f6-4921-9f87-076085057103 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:17:09.637930 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-fe86af54-7a65-4dc6-8863-43f6776674e0 tempest-AttachVolumeShelveTestJSON-1318940295 None] Created reservations ['79cf02b6-51ed-4b9f-9907-dffc9ed5da85', '8f92388f-c791-4a21-9542-9726ea7fab7a', 'e935baa4-82bd-47d5-bccb-fe433d0f75ca', '7a62adfa-e2ac-49c7-a11e-a773121709a3'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:17:09.691134 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fe86af54-7a65-4dc6-8863-43f6776674e0 tempest-AttachVolumeShelveTestJSON-1318940295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:09.751993 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fe86af54-7a65-4dc6-8863-43f6776674e0 tempest-AttachVolumeShelveTestJSON-1318940295 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:09.783496 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-fe86af54-7a65-4dc6-8863-43f6776674e0 tempest-AttachVolumeShelveTestJSON-1318940295 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:17:09.789186 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-fe86af54-7a65-4dc6-8863-43f6776674e0 tempest-AttachVolumeShelveTestJSON-1318940295 None] Deleted volume successfully. Mar 05 21:17:09.803903 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-fe86af54-7a65-4dc6-8863-43f6776674e0 tempest-AttachVolumeShelveTestJSON-1318940295 None] Lock "b'cinder-e28a20a7-45f6-4921-9f87-076085057103-delete_volume'" released by "delete_volume" :: held 0.507s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:17:14.119063 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-6c0663be-a148-442f-b2bd-ed96a58243ff tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['8ee44167-11e8-4b3e-956d-d1d7c1a7a145', 'cfb46f4f-026b-4b55-82bb-09b1b854c22f', '6b210b4d-52b1-41da-9db5-33c568ca7e87', 'a8d36a3e-fbf1-4c26-8989-7964f87eb0af'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:17:14.185231 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6c0663be-a148-442f-b2bd-ed96a58243ff tempest-VolumesSnapshotTestJSON-163973597 None] Delete snapshot completed successfully. Mar 05 21:17:14.192861 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-6c0663be-a148-442f-b2bd-ed96a58243ff tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-344240e4-cd44-4671-bbc8-656f169007e0-delete_snapshot'" released by "delete_snapshot" :: held 30.361s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:17:15.077095 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-c0610351-ed56-4e43-a9f4-f5b69799b761 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-002d74c6-4c40-42d4-af84-3219878327a4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.026s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:17:15.082613 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c0610351-ed56-4e43-a9f4-f5b69799b761 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:43.642367 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d9bc845e-d53b-4162-9aa6-728ee8017beb tempest-BackendsCapabilitiesAdminTestsJSON-1025803150 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2fe49187-130a-4cfa-a03a-392504363329:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134747) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4731}} Mar 05 21:17:43.677358 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-91db7e1f-2824-44a6-956e-9c0ad26b7b9b tempest-BackendsCapabilitiesAdminTestsJSON-1025803150 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2fe49187-130a-4cfa-a03a-392504363329:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134747) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4731}} Mar 05 21:17:45.329614 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-c0610351-ed56-4e43-a9f4-f5b69799b761 tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['0d4df0f3-1336-4e1e-80db-993129f42c56', 'e15595c8-0628-4437-95d7-b13368884727', '99df4ff9-f7ab-4681-87c9-4c1d3c7ecee7', '29cec08e-0701-4938-9c27-8aff06bba5ec'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:17:45.377992 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c0610351-ed56-4e43-a9f4-f5b69799b761 tempest-VolumesSnapshotTestJSON-163973597 None] Delete snapshot completed successfully. Mar 05 21:17:45.383038 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-c0610351-ed56-4e43-a9f4-f5b69799b761 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-002d74c6-4c40-42d4-af84-3219878327a4-delete_snapshot'" released by "delete_snapshot" :: held 30.307s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:17:45.608632 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:17:45.609804 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:45.643171 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:45.676863 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:17:46.302272 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-31f34dd1-62aa-4374-ab65-9ec74510ef58 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-9b1c8d42-b46f-4f8a-8138-b30b31abaa78-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:17:46.304138 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-31f34dd1-62aa-4374-ab65-9ec74510ef58 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:47.026726 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:17:47.030517 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:17:47.031186 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:17:47.051897 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Flow 'volume_create_manager' (8630ea3b-592d-4ec1-b79f-3cdba077edd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:17:47.059062 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b2f9df-ae7d-4994-ad66-ad649eb790fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:17:47.066806 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:17:47.082288 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b2f9df-ae7d-4994-ad66-ad649eb790fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1007437849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3463c0e3-186b-4095-b954-4728cc97438f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4cfd6d6415046db953032e632beed81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:17:47Z,use_quota=True,user_id='b095dac3c85c4c6985762228a31d6198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f34ba81-5fa6-4154-8e26-55defaf2540f),volume_type_id=6f34ba81-5fa6-4154-8e26-55defaf2540f)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:17:47.087923 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a24a8c-dff4-49db-a39f-825958bc69df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:17:47.092148 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a24a8c-dff4-49db-a39f-825958bc69df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:17:47.098561 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8018541a-1ab1-4391-98c4-38bc1ab6048b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:17:47.102827 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8018541a-1ab1-4391-98c4-38bc1ab6048b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3463c0e3-186b-4095-b954-4728cc97438f', 'volume_name': 'volume-3463c0e3-186b-4095-b954-4728cc97438f', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:17:47.107858 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5e15b2-74b1-478d-bc26-a0bee04e5d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:17:47.113005 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5e15b2-74b1-478d-bc26-a0bee04e5d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:17:47.117786 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b46297d-3a4e-4f6e-aa81-c457fd600af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:17:47.118888 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Volume 3463c0e3-186b-4095-b954-4728cc97438f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3463c0e3-186b-4095-b954-4728cc97438f', 'volume_size': 1} Mar 05 21:17:47.119286 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] creating volume 'volume-3463c0e3-186b-4095-b954-4728cc97438f' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:17:47.120314 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:47.181828 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] extra_specs: {} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:17:47.182203 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] extra_specs: {} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:17:47.186044 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b46297d-3a4e-4f6e-aa81-c457fd600af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3463c0e3-186b-4095-b954-4728cc97438f', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:17:47.191161 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6324981e-9305-4c94-a444-8b844eb0a3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:17:47.200747 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Volume volume-3463c0e3-186b-4095-b954-4728cc97438f (3463c0e3-186b-4095-b954-4728cc97438f): created successfully Mar 05 21:17:47.204691 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6324981e-9305-4c94-a444-8b844eb0a3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:17:47.210432 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Flow 'volume_create_manager' (8630ea3b-592d-4ec1-b79f-3cdba077edd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:17:47.219236 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d24efcdc-7cad-4f07-8a94-b3f72002f6bc tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Created volume successfully. Mar 05 21:17:48.331469 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-be3d3d4b-f468-41a5-915d-7687e7be7286 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:48.354979 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-be3d3d4b-f468-41a5-915d-7687e7be7286 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:48.396148 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-be3d3d4b-f468-41a5-915d-7687e7be7286 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:17:48.402184 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-be3d3d4b-f468-41a5-915d-7687e7be7286 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Retype volume completed successfully. Mar 05 21:17:49.507654 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-37f302da-d73c-44f9-9a68-2bd7d01179d1 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Lock "b'cinder-3463c0e3-186b-4095-b954-4728cc97438f-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:17:49.540632 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-37f302da-d73c-44f9-9a68-2bd7d01179d1 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:49.586975 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-37f302da-d73c-44f9-9a68-2bd7d01179d1 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:17:49.587338 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-37f302da-d73c-44f9-9a68-2bd7d01179d1 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Volume volume-3463c0e3-186b-4095-b954-4728cc97438f is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:17:49.594702 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-37f302da-d73c-44f9-9a68-2bd7d01179d1 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] deleting rbd volume volume-3463c0e3-186b-4095-b954-4728cc97438f {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:17:49.809321 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-37f302da-d73c-44f9-9a68-2bd7d01179d1 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:17:49.810300 ncdv-master-1 cinder-volume[134747]: WARNING cinder.quota [None req-37f302da-d73c-44f9-9a68-2bd7d01179d1 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Mar 05 21:17:49.824691 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-37f302da-d73c-44f9-9a68-2bd7d01179d1 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Created reservations ['7053a614-bf7a-43cc-bd4a-fa8c08afb2d8', '3a763fed-90e7-4781-8d59-91855f5d52d4', '0a3bbe25-d18a-476b-b90d-ade3f583d010', 'eef7fd71-e306-4d02-92e8-04085629ae49'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:17:49.868335 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-37f302da-d73c-44f9-9a68-2bd7d01179d1 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:49.897055 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-37f302da-d73c-44f9-9a68-2bd7d01179d1 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:17:49.926060 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-37f302da-d73c-44f9-9a68-2bd7d01179d1 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:17:49.930276 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-37f302da-d73c-44f9-9a68-2bd7d01179d1 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Deleted volume successfully. Mar 05 21:17:49.942825 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-37f302da-d73c-44f9-9a68-2bd7d01179d1 tempest-VolumeRetypeWithoutMigrationTest-2041444353 None] Lock "b'cinder-3463c0e3-186b-4095-b954-4728cc97438f-delete_volume'" released by "delete_volume" :: held 0.435s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:17:59.987374 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-444d5501-012d-4e8b-b9cb-fe3aff7e42d2 tempest-GroupsV320Test-784862727 None] Group tempest-GroupsV320Test-Group-202276928: creating Mar 05 21:18:00.002669 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-444d5501-012d-4e8b-b9cb-fe3aff7e42d2 tempest-GroupsV320Test-784862727 None] Group tempest-GroupsV320Test-Group-202276928: created successfully Mar 05 21:18:00.010764 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-444d5501-012d-4e8b-b9cb-fe3aff7e42d2 tempest-GroupsV320Test-784862727 None] Create group completed successfully. Mar 05 21:18:01.420452 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-f47845ce-889f-404e-a4cb-2a3484bf4a8b tempest-GroupsV320Test-784862727 None] Created reservations ['c2b126d0-b734-46bd-81b7-474aa39a57d4'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:01.449957 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f47845ce-889f-404e-a4cb-2a3484bf4a8b tempest-GroupsV320Test-784862727 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:01.470613 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f47845ce-889f-404e-a4cb-2a3484bf4a8b tempest-GroupsV320Test-784862727 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:01.491947 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-f47845ce-889f-404e-a4cb-2a3484bf4a8b tempest-GroupsV320Test-784862727 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:01.495837 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f47845ce-889f-404e-a4cb-2a3484bf4a8b tempest-GroupsV320Test-784862727 None] Delete group completed successfully. Mar 05 21:18:05.345808 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:05.350239 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:05.350703 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:05.371121 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Flow 'volume_create_manager' (edeb779e-4d22-4b23-85a4-118f81640c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:05.378931 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf519b15-5405-420b-9da5-238bdb76ab27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:05.386525 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:05.401767 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf519b15-5405-420b-9da5-238bdb76ab27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-182354903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=18029220-1c5f-4c8e-9340-cdd00e1f85b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cfcba5155da44638aee171993a640c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:05Z,use_quota=True,user_id='24dec71ae8d9478ab8b63d2c96441b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:05.407618 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c34191d-b8fb-411e-b8aa-881ce88ae32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:05.411885 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c34191d-b8fb-411e-b8aa-881ce88ae32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:05.417638 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f96f55-f857-4610-a500-af2b54fb89c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:05.422078 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f96f55-f857-4610-a500-af2b54fb89c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18029220-1c5f-4c8e-9340-cdd00e1f85b0', 'volume_name': 'volume-18029220-1c5f-4c8e-9340-cdd00e1f85b0', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:05.427782 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da1d73a-ad80-41f0-85d8-70d5c5762d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:05.431879 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da1d73a-ad80-41f0-85d8-70d5c5762d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:05.436648 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b14943-a2fd-4630-a7d0-b5b2a20a42dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:05.437733 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Volume 18029220-1c5f-4c8e-9340-cdd00e1f85b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18029220-1c5f-4c8e-9340-cdd00e1f85b0', 'volume_size': 1} Mar 05 21:18:05.438901 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] creating volume 'volume-18029220-1c5f-4c8e-9340-cdd00e1f85b0' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:18:05.439969 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:05.488794 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:05.489178 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:05.493237 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b14943-a2fd-4630-a7d0-b5b2a20a42dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18029220-1c5f-4c8e-9340-cdd00e1f85b0', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:05.497752 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac732f21-71dd-473e-b0e4-7e01de455793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:05.508656 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Volume volume-18029220-1c5f-4c8e-9340-cdd00e1f85b0 (18029220-1c5f-4c8e-9340-cdd00e1f85b0): created successfully Mar 05 21:18:05.512680 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac732f21-71dd-473e-b0e4-7e01de455793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:05.519034 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Flow 'volume_create_manager' (edeb779e-4d22-4b23-85a4-118f81640c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:05.532916 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-96e057c1-7c98-4cef-be7c-0ced21d067dc tempest-SnapshotsActionsTest-2110605389 None] Created volume successfully. Mar 05 21:18:05.999475 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:06.003445 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:06.003917 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:06.044132 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Flow 'volume_create_manager' (bb24b77c-a8ba-417e-9a81-fc058dc7da6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:06.051309 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b4d84d-699a-440d-bc69-e1890bd97b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:06.057858 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:06.072685 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b4d84d-699a-440d-bc69-e1890bd97b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-877836669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=68cc44b9-722e-4b65-b64f-3b78785c39d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab95caff9f845b1951f04a7a03185a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:06Z,use_quota=True,user_id='96ec8e4bd1044eb286b5427f02a1f4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:06.078188 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d69a44f-3a75-4f8b-8985-973dea3bb7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:06.082649 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d69a44f-3a75-4f8b-8985-973dea3bb7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:06.087862 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c972fcb-6c8d-4c22-9d93-7d8e1212f9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:06.092094 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c972fcb-6c8d-4c22-9d93-7d8e1212f9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68cc44b9-722e-4b65-b64f-3b78785c39d4', 'volume_name': 'volume-68cc44b9-722e-4b65-b64f-3b78785c39d4', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:06.097272 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb1b5c4-ee32-442a-b150-2ce7b3326511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:06.101311 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb1b5c4-ee32-442a-b150-2ce7b3326511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:06.106086 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45eb3e53-46ac-4fdf-845d-5cb2f53f4c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:06.107157 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Volume 68cc44b9-722e-4b65-b64f-3b78785c39d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68cc44b9-722e-4b65-b64f-3b78785c39d4', 'volume_size': 1} Mar 05 21:18:06.107549 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] creating volume 'volume-68cc44b9-722e-4b65-b64f-3b78785c39d4' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:18:06.108557 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:06.157890 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:06.158246 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:06.162252 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45eb3e53-46ac-4fdf-845d-5cb2f53f4c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68cc44b9-722e-4b65-b64f-3b78785c39d4', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:06.167138 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c2555a-ab63-48d7-a32d-c93b04d9bc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:06.177075 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Volume volume-68cc44b9-722e-4b65-b64f-3b78785c39d4 (68cc44b9-722e-4b65-b64f-3b78785c39d4): created successfully Mar 05 21:18:06.180773 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c2555a-ab63-48d7-a32d-c93b04d9bc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:06.186339 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Flow 'volume_create_manager' (bb24b77c-a8ba-417e-9a81-fc058dc7da6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:06.194170 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-88d57820-80c0-4888-a862-65d61a731615 tempest-VolumesActionsTest-1079041022 None] Created volume successfully. Mar 05 21:18:06.536429 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-cb267372-b343-4bee-9bbc-4d1bebfa819a tempest-SnapshotsActionsTest-2110605389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:07.047862 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-9348f532-7470-4bfa-a898-37ce79ec5539 tempest-VolumesActionsTest-1079041022 None] Lock "b'cinder-68cc44b9-722e-4b65-b64f-3b78785c39d4'" acquired by "attach_volume" :: waited 0.008s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:07.083849 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-9348f532-7470-4bfa-a898-37ce79ec5539 tempest-VolumesActionsTest-1079041022 None] Attaching volume 68cc44b9-722e-4b65-b64f-3b78785c39d4 to instance 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d at mountpoint /dev/sdb on host None. Mar 05 21:18:07.105727 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-9348f532-7470-4bfa-a898-37ce79ec5539 tempest-VolumesActionsTest-1079041022 None] Attach volume completed successfully. Mar 05 21:18:07.110379 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-9348f532-7470-4bfa-a898-37ce79ec5539 tempest-VolumesActionsTest-1079041022 None] Lock "b'cinder-68cc44b9-722e-4b65-b64f-3b78785c39d4'" released by "attach_volume" :: held 0.063s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:07.458114 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-cb267372-b343-4bee-9bbc-4d1bebfa819a tempest-SnapshotsActionsTest-2110605389 None] Create snapshot completed successfully Mar 05 21:18:07.511554 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-2e828ec9-78e2-43d1-bceb-b2115fa31b82 tempest-VolumesActionsTest-709656168 None] Terminate volume connection completed successfully. Mar 05 21:18:07.547376 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-2e828ec9-78e2-43d1-bceb-b2115fa31b82 tempest-VolumesActionsTest-709656168 None] Lock "b'cinder-68cc44b9-722e-4b65-b64f-3b78785c39d4-detach_volume'" acquired by "detach_volume" :: waited 0.014s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:07.558724 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-2e828ec9-78e2-43d1-bceb-b2115fa31b82 tempest-VolumesActionsTest-709656168 None] Detaching volume 68cc44b9-722e-4b65-b64f-3b78785c39d4 from instance 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d. Mar 05 21:18:07.586250 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-2e828ec9-78e2-43d1-bceb-b2115fa31b82 tempest-VolumesActionsTest-709656168 None] Detach volume completed successfully. Mar 05 21:18:07.590717 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-2e828ec9-78e2-43d1-bceb-b2115fa31b82 tempest-VolumesActionsTest-709656168 None] Lock "b'cinder-68cc44b9-722e-4b65-b64f-3b78785c39d4-detach_volume'" released by "detach_volume" :: held 0.043s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:07.735451 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-d3753deb-387d-4e8b-8be8-fd21ac134f48 tempest-VolumesActionsTest-1079041022 None] Lock "b'cinder-68cc44b9-722e-4b65-b64f-3b78785c39d4-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:07.735921 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d3753deb-387d-4e8b-8be8-fd21ac134f48 tempest-VolumesActionsTest-1079041022 None] Volume detach called, but volume not attached. Mar 05 21:18:07.747528 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-d3753deb-387d-4e8b-8be8-fd21ac134f48 tempest-VolumesActionsTest-1079041022 None] Lock "b'cinder-68cc44b9-722e-4b65-b64f-3b78785c39d4-detach_volume'" released by "detach_volume" :: held 0.012s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:07.946428 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2d8ed662-dbdd-438a-b816-82480bae086d tempest-SnapshotsActionsTest-2110605389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:08.459300 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-2d8ed662-dbdd-438a-b816-82480bae086d tempest-SnapshotsActionsTest-2110605389 None] Create snapshot completed successfully Mar 05 21:18:09.091768 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-4c3ccc37-a04a-42c8-b219-54f234132bc1 tempest-SnapshotsActionsTest-1135738162 None] Lock "b'cinder-eec3e5e9-07e3-484b-850b-6733d78e0699-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:09.093160 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4c3ccc37-a04a-42c8-b219-54f234132bc1 tempest-SnapshotsActionsTest-1135738162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:09.498960 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-4c3ccc37-a04a-42c8-b219-54f234132bc1 tempest-SnapshotsActionsTest-1135738162 None] Created reservations ['69febc32-e311-4ecc-85f9-a775f97babf2', 'b4f1660b-36f8-43ca-bab9-bce62e525648', '1ea57486-3270-4c62-91e2-9a0373abd7ad', 'a69597b6-3fba-4687-b950-104c5ec8526d'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:09.533023 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-4c3ccc37-a04a-42c8-b219-54f234132bc1 tempest-SnapshotsActionsTest-1135738162 None] Delete snapshot completed successfully. Mar 05 21:18:09.538061 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-4c3ccc37-a04a-42c8-b219-54f234132bc1 tempest-SnapshotsActionsTest-1135738162 None] Lock "b'cinder-eec3e5e9-07e3-484b-850b-6733d78e0699-delete_snapshot'" released by "delete_snapshot" :: held 0.446s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:10.390113 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-109004d6-855c-42e4-828d-5b3b9506d5a5 tempest-SnapshotsActionsTest-2110605389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:10.701063 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:10.704373 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:10.704817 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:10.725721 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Flow 'volume_create_manager' (e42e1f9f-9190-4894-b190-827fadd1d564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:10.732255 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12415f87-bc25-4710-be6a-f8bc43215910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:10.738543 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:10.752151 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12415f87-bc25-4710-be6a-f8bc43215910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1416976714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a3b822e1-6262-4f32-a5c3-69a4f7f373c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab95caff9f845b1951f04a7a03185a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:11Z,use_quota=True,user_id='96ec8e4bd1044eb286b5427f02a1f4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:10.758091 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6735b9e1-d51d-4d63-9580-518d1e4d9d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:10.762513 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6735b9e1-d51d-4d63-9580-518d1e4d9d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:10.767798 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552bb5fb-8bfa-4d8c-a3d6-2915f0c6e6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:10.773119 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552bb5fb-8bfa-4d8c-a3d6-2915f0c6e6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3b822e1-6262-4f32-a5c3-69a4f7f373c9', 'volume_name': 'volume-a3b822e1-6262-4f32-a5c3-69a4f7f373c9', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:10.778022 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2b3e8c-dae8-4a03-9d0c-7a77dd01210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:10.782050 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2b3e8c-dae8-4a03-9d0c-7a77dd01210e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:10.788010 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08576b6f-1637-482e-b194-a873aad6e741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:10.789093 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Volume a3b822e1-6262-4f32-a5c3-69a4f7f373c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3b822e1-6262-4f32-a5c3-69a4f7f373c9', 'volume_size': 1} Mar 05 21:18:10.789503 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] creating volume 'volume-a3b822e1-6262-4f32-a5c3-69a4f7f373c9' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:18:10.790471 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:10.842185 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:10.842567 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:10.846459 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08576b6f-1637-482e-b194-a873aad6e741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3b822e1-6262-4f32-a5c3-69a4f7f373c9', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:10.851771 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3877074-0a93-4950-adf4-5c72481004ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:10.860685 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Volume volume-a3b822e1-6262-4f32-a5c3-69a4f7f373c9 (a3b822e1-6262-4f32-a5c3-69a4f7f373c9): created successfully Mar 05 21:18:10.864373 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3877074-0a93-4950-adf4-5c72481004ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:10.869928 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Flow 'volume_create_manager' (e42e1f9f-9190-4894-b190-827fadd1d564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:10.877533 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-2d2458b4-d63f-48b1-9194-3fe91c17c31d tempest-VolumesActionsTest-1079041022 None] Created volume successfully. Mar 05 21:18:11.492914 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-109004d6-855c-42e4-828d-5b3b9506d5a5 tempest-SnapshotsActionsTest-2110605389 None] Create snapshot completed successfully Mar 05 21:18:11.870931 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-1a8c8a2a-fa19-4e2f-a79d-821b132c4e9f tempest-VolumesActionsTest-709656168 None] Lock "b'cinder-a3b822e1-6262-4f32-a5c3-69a4f7f373c9-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:11.895844 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1a8c8a2a-fa19-4e2f-a79d-821b132c4e9f tempest-VolumesActionsTest-709656168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:11.936008 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1a8c8a2a-fa19-4e2f-a79d-821b132c4e9f tempest-VolumesActionsTest-709656168 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:11.936464 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1a8c8a2a-fa19-4e2f-a79d-821b132c4e9f tempest-VolumesActionsTest-709656168 None] Volume volume-a3b822e1-6262-4f32-a5c3-69a4f7f373c9 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:11.941147 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1a8c8a2a-fa19-4e2f-a79d-821b132c4e9f tempest-VolumesActionsTest-709656168 None] deleting rbd volume volume-a3b822e1-6262-4f32-a5c3-69a4f7f373c9 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:12.145090 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-1a8c8a2a-fa19-4e2f-a79d-821b132c4e9f tempest-VolumesActionsTest-709656168 None] Created reservations ['2e57877b-4ad3-4799-8d85-d6f14393f0a0', 'f02208a8-46e2-43e1-915d-ece8b19d0b8b', 'e38366a7-b25a-4be9-9cf0-aded85b16b7c', 'b5c2c0e2-92e1-4d92-8f63-14639e52ff5f'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:12.186161 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1a8c8a2a-fa19-4e2f-a79d-821b132c4e9f tempest-VolumesActionsTest-709656168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:12.207648 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-1a8c8a2a-fa19-4e2f-a79d-821b132c4e9f tempest-VolumesActionsTest-709656168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:12.230061 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-1a8c8a2a-fa19-4e2f-a79d-821b132c4e9f tempest-VolumesActionsTest-709656168 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:12.234133 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-1a8c8a2a-fa19-4e2f-a79d-821b132c4e9f tempest-VolumesActionsTest-709656168 None] Deleted volume successfully. Mar 05 21:18:12.245522 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-1a8c8a2a-fa19-4e2f-a79d-821b132c4e9f tempest-VolumesActionsTest-709656168 None] Lock "b'cinder-a3b822e1-6262-4f32-a5c3-69a4f7f373c9-delete_volume'" released by "delete_volume" :: held 0.375s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:12.551562 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-8ed9221c-88b2-45e3-bbdf-ee89dded5aba tempest-SnapshotsActionsTest-1135738162 None] Lock "b'cinder-26bf0f0d-cec5-42ed-8110-355c368992de-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:12.553248 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8ed9221c-88b2-45e3-bbdf-ee89dded5aba tempest-SnapshotsActionsTest-1135738162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:13.230860 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:13.234016 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:13.234460 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:13.254117 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Flow 'volume_create_manager' (ff229d9c-b93d-47ca-ab87-8786b6079d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:13.260907 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82510856-743c-4196-b16d-eefbd23eaf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:13.267643 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:13.281506 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82510856-743c-4196-b16d-eefbd23eaf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-675841538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b2a58f65-99a8-462a-b2f4-acc9e7c8d534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab95caff9f845b1951f04a7a03185a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:13Z,use_quota=True,user_id='96ec8e4bd1044eb286b5427f02a1f4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:13.287646 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6eb641-e51c-4df7-bca2-40d9fa1b9454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:13.291857 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6eb641-e51c-4df7-bca2-40d9fa1b9454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:13.297033 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628bfda6-be5b-43a2-867f-799ae4fbd6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:13.302105 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628bfda6-be5b-43a2-867f-799ae4fbd6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a58f65-99a8-462a-b2f4-acc9e7c8d534', 'volume_name': 'volume-b2a58f65-99a8-462a-b2f4-acc9e7c8d534', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:13.307126 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06610a6a-4e60-4172-be26-cf6edab175db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:13.311180 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06610a6a-4e60-4172-be26-cf6edab175db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:13.316070 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (230852f2-f8da-4edc-ba70-47e5cad11c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:13.317151 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Volume b2a58f65-99a8-462a-b2f4-acc9e7c8d534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a58f65-99a8-462a-b2f4-acc9e7c8d534', 'volume_size': 1} Mar 05 21:18:13.317542 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] creating volume 'volume-b2a58f65-99a8-462a-b2f4-acc9e7c8d534' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:18:13.318508 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:13.366912 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:13.367319 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:13.371144 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (230852f2-f8da-4edc-ba70-47e5cad11c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a58f65-99a8-462a-b2f4-acc9e7c8d534', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:13.375759 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031816f6-5849-4abb-81bd-3ec82ebf0825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:13.385071 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Volume volume-b2a58f65-99a8-462a-b2f4-acc9e7c8d534 (b2a58f65-99a8-462a-b2f4-acc9e7c8d534): created successfully Mar 05 21:18:13.388636 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031816f6-5849-4abb-81bd-3ec82ebf0825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:13.394383 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Flow 'volume_create_manager' (ff229d9c-b93d-47ca-ab87-8786b6079d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:13.401899 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6403d096-2920-4e56-99b0-190723a365ee tempest-VolumesActionsTest-1079041022 None] Created volume successfully. Mar 05 21:18:13.524233 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-8ed9221c-88b2-45e3-bbdf-ee89dded5aba tempest-SnapshotsActionsTest-1135738162 None] Created reservations ['27547c47-c124-44b0-af61-84250b44180e', '5d989fc2-f5c2-4e95-b02c-a142ee106fcf', '439f041a-f99f-48df-954d-513eb7c8c5c6', 'c8fb8fc6-4330-497f-9ccf-7cca251c0f29'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:13.556925 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8ed9221c-88b2-45e3-bbdf-ee89dded5aba tempest-SnapshotsActionsTest-1135738162 None] Delete snapshot completed successfully. Mar 05 21:18:13.561565 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-8ed9221c-88b2-45e3-bbdf-ee89dded5aba tempest-SnapshotsActionsTest-1135738162 None] Lock "b'cinder-26bf0f0d-cec5-42ed-8110-355c368992de-delete_snapshot'" released by "delete_snapshot" :: held 1.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:13.832137 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9bf08ff6-8415-420a-b052-cf3dd4bde880 tempest-SnapshotsActionsTest-2110605389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:14.396996 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-9f2f03a9-f981-45ec-9c8f-d138038a47c9 tempest-VolumesActionsTest-709656168 None] Lock "b'cinder-b2a58f65-99a8-462a-b2f4-acc9e7c8d534-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:14.420895 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9f2f03a9-f981-45ec-9c8f-d138038a47c9 tempest-VolumesActionsTest-709656168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:14.457851 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9f2f03a9-f981-45ec-9c8f-d138038a47c9 tempest-VolumesActionsTest-709656168 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:14.458223 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9f2f03a9-f981-45ec-9c8f-d138038a47c9 tempest-VolumesActionsTest-709656168 None] Volume volume-b2a58f65-99a8-462a-b2f4-acc9e7c8d534 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:14.467275 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9f2f03a9-f981-45ec-9c8f-d138038a47c9 tempest-VolumesActionsTest-709656168 None] deleting rbd volume volume-b2a58f65-99a8-462a-b2f4-acc9e7c8d534 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:14.550834 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-9bf08ff6-8415-420a-b052-cf3dd4bde880 tempest-SnapshotsActionsTest-2110605389 None] Create snapshot completed successfully Mar 05 21:18:14.677009 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-9f2f03a9-f981-45ec-9c8f-d138038a47c9 tempest-VolumesActionsTest-709656168 None] Created reservations ['21a1eca7-ab9f-4529-a2ab-4dd82ce685ab', '3b6c05f6-8b7c-4e4b-95f7-854c7d41f7a9', 'ecbb9740-a0e0-4450-936f-997bc0731087', 'd605ee54-3873-4c71-a8a8-04e6e0c61fa3'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:14.718762 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9f2f03a9-f981-45ec-9c8f-d138038a47c9 tempest-VolumesActionsTest-709656168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:14.739511 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9f2f03a9-f981-45ec-9c8f-d138038a47c9 tempest-VolumesActionsTest-709656168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:14.762516 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-9f2f03a9-f981-45ec-9c8f-d138038a47c9 tempest-VolumesActionsTest-709656168 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:14.766511 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-9f2f03a9-f981-45ec-9c8f-d138038a47c9 tempest-VolumesActionsTest-709656168 None] Deleted volume successfully. Mar 05 21:18:14.778413 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-9f2f03a9-f981-45ec-9c8f-d138038a47c9 tempest-VolumesActionsTest-709656168 None] Lock "b'cinder-b2a58f65-99a8-462a-b2f4-acc9e7c8d534-delete_volume'" released by "delete_volume" :: held 0.381s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:14.972820 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-82740df5-1abd-46b2-b2a3-3fe141f0510d tempest-SnapshotsActionsTest-1135738162 None] Lock "b'cinder-93f96bf8-b2ed-4ae5-a58c-9b0b5076ea4b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:14.974374 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-82740df5-1abd-46b2-b2a3-3fe141f0510d tempest-SnapshotsActionsTest-1135738162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:15.589636 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-82740df5-1abd-46b2-b2a3-3fe141f0510d tempest-SnapshotsActionsTest-1135738162 None] Created reservations ['1ef64c5f-8c8b-441b-be19-ce6c4a5c35b3', 'd280ad1f-d63e-4bde-b820-0be90ea0fda3', 'cbddd11f-0718-402b-b3d2-b8eb90dce20e', '552d9f8a-696c-4778-bf03-1c303d54917d'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:15.625751 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-82740df5-1abd-46b2-b2a3-3fe141f0510d tempest-SnapshotsActionsTest-1135738162 None] Delete snapshot completed successfully. Mar 05 21:18:15.630796 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-82740df5-1abd-46b2-b2a3-3fe141f0510d tempest-SnapshotsActionsTest-1135738162 None] Lock "b'cinder-93f96bf8-b2ed-4ae5-a58c-9b0b5076ea4b-delete_snapshot'" released by "delete_snapshot" :: held 0.658s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:15.776472 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:15.780258 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:15.780711 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:15.800779 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Flow 'volume_create_manager' (89ce9874-4f73-442f-ba80-cd5bef6b3286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:15.807315 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ccd21d-6dd3-49ad-be2e-12a210fdddb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:15.814016 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:15.827984 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ccd21d-6dd3-49ad-be2e-12a210fdddb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1279136118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2786b2a6-7641-4678-8c3d-93044ab8e805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab95caff9f845b1951f04a7a03185a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:16Z,use_quota=True,user_id='96ec8e4bd1044eb286b5427f02a1f4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:15.834344 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c585179-d970-40cb-af5d-e21179cb7fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:15.838518 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c585179-d970-40cb-af5d-e21179cb7fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:15.843705 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c6c9f5-7f14-437e-97e2-6403c33eda70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:15.848995 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c6c9f5-7f14-437e-97e2-6403c33eda70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2786b2a6-7641-4678-8c3d-93044ab8e805', 'volume_name': 'volume-2786b2a6-7641-4678-8c3d-93044ab8e805', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:15.854035 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2782de95-2876-4ff8-bdad-f19fb792f91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:15.858080 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2782de95-2876-4ff8-bdad-f19fb792f91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:15.863380 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb529092-e88f-4c0b-8336-c66120b157fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:15.864516 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Volume 2786b2a6-7641-4678-8c3d-93044ab8e805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2786b2a6-7641-4678-8c3d-93044ab8e805', 'volume_size': 1} Mar 05 21:18:15.864916 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] creating volume 'volume-2786b2a6-7641-4678-8c3d-93044ab8e805' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:18:15.865891 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:15.917664 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:15.918044 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:15.922446 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb529092-e88f-4c0b-8336-c66120b157fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2786b2a6-7641-4678-8c3d-93044ab8e805', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:15.927242 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f0a2b8-c315-4ef5-8b43-504ee098298f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:15.936649 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Volume volume-2786b2a6-7641-4678-8c3d-93044ab8e805 (2786b2a6-7641-4678-8c3d-93044ab8e805): created successfully Mar 05 21:18:15.940326 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f0a2b8-c315-4ef5-8b43-504ee098298f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:15.945886 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Flow 'volume_create_manager' (89ce9874-4f73-442f-ba80-cd5bef6b3286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:15.953156 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ad5f2383-1c0c-4f69-aa0a-de0ff9b8ad22 tempest-VolumesActionsTest-1079041022 None] Created volume successfully. Mar 05 21:18:16.260901 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ce47e7a3-b008-4238-9636-d2776c5a45b4 tempest-SnapshotsActionsTest-2110605389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:16.471297 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-31f34dd1-62aa-4374-ab65-9ec74510ef58 tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['1884fbbf-6487-41cc-a5e7-32288555f821', 'bc255963-14ed-4498-aae8-c19b37d61903', 'b027da2f-8cfa-4e7a-9b2b-de8b4fa2c39d', '43091838-131a-4a14-96be-26cb35c018b6'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:16.513598 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-31f34dd1-62aa-4374-ab65-9ec74510ef58 tempest-VolumesSnapshotTestJSON-163973597 None] Delete snapshot completed successfully. Mar 05 21:18:16.519009 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-31f34dd1-62aa-4374-ab65-9ec74510ef58 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-9b1c8d42-b46f-4f8a-8138-b30b31abaa78-delete_snapshot'" released by "delete_snapshot" :: held 30.217s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:16.568190 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ce47e7a3-b008-4238-9636-d2776c5a45b4 tempest-SnapshotsActionsTest-2110605389 None] Create snapshot completed successfully Mar 05 21:18:16.948824 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-81b7dc4a-6ebd-427c-a696-47f4e80c7788 tempest-VolumesActionsTest-709656168 None] Lock "b'cinder-2786b2a6-7641-4678-8c3d-93044ab8e805-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:16.974502 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-81b7dc4a-6ebd-427c-a696-47f4e80c7788 tempest-VolumesActionsTest-709656168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:17.013663 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-81b7dc4a-6ebd-427c-a696-47f4e80c7788 tempest-VolumesActionsTest-709656168 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:17.014018 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-81b7dc4a-6ebd-427c-a696-47f4e80c7788 tempest-VolumesActionsTest-709656168 None] Volume volume-2786b2a6-7641-4678-8c3d-93044ab8e805 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:17.019071 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-81b7dc4a-6ebd-427c-a696-47f4e80c7788 tempest-VolumesActionsTest-709656168 None] deleting rbd volume volume-2786b2a6-7641-4678-8c3d-93044ab8e805 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:17.221074 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-81b7dc4a-6ebd-427c-a696-47f4e80c7788 tempest-VolumesActionsTest-709656168 None] Created reservations ['7658483e-7aba-43a1-b026-07ed92b59884', 'b093cb1d-5752-4c01-8920-931b93f032c9', 'b8af3206-6a53-4540-8154-fe4e255a4935', '5775960b-f2f6-4d7b-a4a1-f2159fd78d1a'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:17.272580 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-81b7dc4a-6ebd-427c-a696-47f4e80c7788 tempest-VolumesActionsTest-709656168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:17.298125 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-81b7dc4a-6ebd-427c-a696-47f4e80c7788 tempest-VolumesActionsTest-709656168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:17.355302 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-81b7dc4a-6ebd-427c-a696-47f4e80c7788 tempest-VolumesActionsTest-709656168 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:17.360660 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-81b7dc4a-6ebd-427c-a696-47f4e80c7788 tempest-VolumesActionsTest-709656168 None] Deleted volume successfully. Mar 05 21:18:17.375569 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-81b7dc4a-6ebd-427c-a696-47f4e80c7788 tempest-VolumesActionsTest-709656168 None] Lock "b'cinder-2786b2a6-7641-4678-8c3d-93044ab8e805-delete_volume'" released by "delete_volume" :: held 0.427s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:17.447978 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-c9dfa542-c4bf-46d1-bc83-615be908d299 tempest-SnapshotsActionsTest-1135738162 None] Lock "b'cinder-599d4924-de8a-47c7-85a6-2bd1c2d874ad-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.026s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:17.449568 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c9dfa542-c4bf-46d1-bc83-615be908d299 tempest-SnapshotsActionsTest-1135738162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:18.040173 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-9ce80fda-2ee2-4d94-8d8b-11ea3f6b0a8b req-83765046-decb-493a-befa-a26b493b0077 tempest-VolumesSnapshotTestJSON-163973597 None] Terminate volume connection completed successfully. Mar 05 21:18:18.040736 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-9ce80fda-2ee2-4d94-8d8b-11ea3f6b0a8b req-83765046-decb-493a-befa-a26b493b0077 tempest-VolumesSnapshotTestJSON-163973597 None] Deleting attachment 4c6d55ef-12d2-477f-a4ae-64647292e01a. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:18:18.321120 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:18.324890 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:18.325391 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:18.344581 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Flow 'volume_create_manager' (40b14113-cf1c-4491-9509-b664a9057ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:18.351412 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e756b4-2e26-42f7-946f-eabaf73faa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:18.358018 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:18.371784 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e756b4-2e26-42f7-946f-eabaf73faa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-491863202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=059e1162-27d9-4a04-8b1f-67cb0368a51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab95caff9f845b1951f04a7a03185a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:18Z,use_quota=True,user_id='96ec8e4bd1044eb286b5427f02a1f4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:18.377290 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ada4524-3f0b-489d-8738-27a05167b662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:18.382069 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ada4524-3f0b-489d-8738-27a05167b662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:18.387528 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b4c7dc-e8f9-4bde-8a71-668511102f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:18.391910 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b4c7dc-e8f9-4bde-8a71-668511102f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '059e1162-27d9-4a04-8b1f-67cb0368a51a', 'volume_name': 'volume-059e1162-27d9-4a04-8b1f-67cb0368a51a', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:18.397702 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca820a0-b61d-48c1-8139-e167db3f41e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:18.401799 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca820a0-b61d-48c1-8139-e167db3f41e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:18.406622 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd3fc16-6eb4-4b22-8504-8851ee9cad7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:18.407729 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Volume 059e1162-27d9-4a04-8b1f-67cb0368a51a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-059e1162-27d9-4a04-8b1f-67cb0368a51a', 'volume_size': 1} Mar 05 21:18:18.408119 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] creating volume 'volume-059e1162-27d9-4a04-8b1f-67cb0368a51a' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:18:18.409151 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:18.457421 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:18.457799 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:18.461938 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd3fc16-6eb4-4b22-8504-8851ee9cad7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-059e1162-27d9-4a04-8b1f-67cb0368a51a', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:18.466620 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702d0eef-5ac8-4c24-b80c-98ea812179b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:18.477010 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Volume volume-059e1162-27d9-4a04-8b1f-67cb0368a51a (059e1162-27d9-4a04-8b1f-67cb0368a51a): created successfully Mar 05 21:18:18.480948 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702d0eef-5ac8-4c24-b80c-98ea812179b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:18.486573 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Flow 'volume_create_manager' (40b14113-cf1c-4491-9509-b664a9057ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:18.495573 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-acf4ee15-1be0-482c-837b-9a79279f5c6d tempest-VolumesActionsTest-1079041022 None] Created volume successfully. Mar 05 21:18:18.607979 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-c9dfa542-c4bf-46d1-bc83-615be908d299 tempest-SnapshotsActionsTest-1135738162 None] Created reservations ['21db24e8-c492-4b16-825c-2dc3d8be9aef', 'e68d03f1-4ac9-4841-8835-22172dcfd39b', '3610c575-1497-4d29-a212-eca260c54ae1', '96b089ef-ca26-4513-8da5-8b9ea82b18bb'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:18.644454 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c9dfa542-c4bf-46d1-bc83-615be908d299 tempest-SnapshotsActionsTest-1135738162 None] Delete snapshot completed successfully. Mar 05 21:18:18.649868 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-c9dfa542-c4bf-46d1-bc83-615be908d299 tempest-SnapshotsActionsTest-1135738162 None] Lock "b'cinder-599d4924-de8a-47c7-85a6-2bd1c2d874ad-delete_snapshot'" released by "delete_snapshot" :: held 1.202s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:19.488966 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-493134c0-d32c-40d9-b9bb-b0906b192672 tempest-VolumesActionsTest-709656168 None] Lock "b'cinder-059e1162-27d9-4a04-8b1f-67cb0368a51a-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:19.516708 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-493134c0-d32c-40d9-b9bb-b0906b192672 tempest-VolumesActionsTest-709656168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:19.571514 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-493134c0-d32c-40d9-b9bb-b0906b192672 tempest-VolumesActionsTest-709656168 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:19.572175 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-493134c0-d32c-40d9-b9bb-b0906b192672 tempest-VolumesActionsTest-709656168 None] Volume volume-059e1162-27d9-4a04-8b1f-67cb0368a51a is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:19.579910 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-493134c0-d32c-40d9-b9bb-b0906b192672 tempest-VolumesActionsTest-709656168 None] deleting rbd volume volume-059e1162-27d9-4a04-8b1f-67cb0368a51a {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:19.797830 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-493134c0-d32c-40d9-b9bb-b0906b192672 tempest-VolumesActionsTest-709656168 None] Created reservations ['d6279eb3-49c7-4311-9ec5-7d616a3412a2', '42625ad6-7105-4223-97f7-a5783cd0aaa2', '99897df3-372c-4fae-b964-557442777c15', '8e1d0522-344f-43a5-ad97-4059449b83ea'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:19.858709 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-493134c0-d32c-40d9-b9bb-b0906b192672 tempest-VolumesActionsTest-709656168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:19.900733 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-493134c0-d32c-40d9-b9bb-b0906b192672 tempest-VolumesActionsTest-709656168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:19.945660 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-493134c0-d32c-40d9-b9bb-b0906b192672 tempest-VolumesActionsTest-709656168 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:19.951659 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-493134c0-d32c-40d9-b9bb-b0906b192672 tempest-VolumesActionsTest-709656168 None] Deleted volume successfully. Mar 05 21:18:19.973773 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-493134c0-d32c-40d9-b9bb-b0906b192672 tempest-VolumesActionsTest-709656168 None] Lock "b'cinder-059e1162-27d9-4a04-8b1f-67cb0368a51a-delete_volume'" released by "delete_volume" :: held 0.485s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:19.978901 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-dd754ba3-5665-493b-a6a7-62b1803ef2ab tempest-SnapshotsActionsTest-2110605389 None] Lock "b'cinder-24d4eff7-3683-4e29-90f9-f979422252a0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:19.980983 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-dd754ba3-5665-493b-a6a7-62b1803ef2ab tempest-SnapshotsActionsTest-2110605389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:20.670967 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-dd754ba3-5665-493b-a6a7-62b1803ef2ab tempest-SnapshotsActionsTest-2110605389 None] Created reservations ['e187ad4c-ff1a-4e5a-adcc-9bfde430d0a3', '3b49ef01-4f05-4fbf-bf1c-37469dd41326', 'b77b5b2e-9bd0-432e-b747-43278e7499af', '422779d6-5f62-4599-8af7-829a56c6d602'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:20.722826 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-dd754ba3-5665-493b-a6a7-62b1803ef2ab tempest-SnapshotsActionsTest-2110605389 None] Delete snapshot completed successfully. Mar 05 21:18:20.729158 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-dd754ba3-5665-493b-a6a7-62b1803ef2ab tempest-SnapshotsActionsTest-2110605389 None] Lock "b'cinder-24d4eff7-3683-4e29-90f9-f979422252a0-delete_snapshot'" released by "delete_snapshot" :: held 0.750s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:20.898060 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:20.902535 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:20.909290 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:20.922786 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Flow 'volume_create_manager' (7736c073-e030-477f-8466-fb1e8e1d130d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:20.930036 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b69b03-2fe5-4088-808b-1d3b81dc0cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:20.937238 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:20.952235 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b69b03-2fe5-4088-808b-1d3b81dc0cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1578376165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6ef5419a-6abb-4482-9107-5e7d9f168444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab95caff9f845b1951f04a7a03185a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:21Z,use_quota=True,user_id='96ec8e4bd1044eb286b5427f02a1f4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:20.958388 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6823f16d-d430-4606-8b0b-2fef068439d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:20.962642 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6823f16d-d430-4606-8b0b-2fef068439d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:20.968059 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c309b8-5aeb-434e-b27a-5f630cb5fa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:20.972452 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c309b8-5aeb-434e-b27a-5f630cb5fa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef5419a-6abb-4482-9107-5e7d9f168444', 'volume_name': 'volume-6ef5419a-6abb-4482-9107-5e7d9f168444', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:20.977550 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44980f2-19d5-4b9f-90af-26cc5eb6f5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:20.981557 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44980f2-19d5-4b9f-90af-26cc5eb6f5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:20.986362 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d126426-bce6-4b40-bfbe-c75e4c9ee4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:20.987974 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Volume 6ef5419a-6abb-4482-9107-5e7d9f168444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef5419a-6abb-4482-9107-5e7d9f168444', 'volume_size': 1} Mar 05 21:18:20.988373 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] creating volume 'volume-6ef5419a-6abb-4482-9107-5e7d9f168444' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:18:20.989361 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:21.061350 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:21.061774 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:21.066733 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d126426-bce6-4b40-bfbe-c75e4c9ee4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef5419a-6abb-4482-9107-5e7d9f168444', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:21.072690 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a0a572-94e9-4855-b2f7-52309c7cf5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:21.083058 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Volume volume-6ef5419a-6abb-4482-9107-5e7d9f168444 (6ef5419a-6abb-4482-9107-5e7d9f168444): created successfully Mar 05 21:18:21.086756 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a0a572-94e9-4855-b2f7-52309c7cf5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:21.093054 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Flow 'volume_create_manager' (7736c073-e030-477f-8466-fb1e8e1d130d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:21.117886 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6b1a0dfa-8107-4639-9c23-edec17d62273 tempest-VolumesActionsTest-1079041022 None] Created volume successfully. Mar 05 21:18:21.121921 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-92a47a15-aad4-4390-b707-006b07b495cf tempest-SnapshotsActionsTest-2110605389 None] Lock "b'cinder-18029220-1c5f-4c8e-9340-cdd00e1f85b0-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:21.158293 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-92a47a15-aad4-4390-b707-006b07b495cf tempest-SnapshotsActionsTest-2110605389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:21.200959 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-92a47a15-aad4-4390-b707-006b07b495cf tempest-SnapshotsActionsTest-2110605389 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:21.201404 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-92a47a15-aad4-4390-b707-006b07b495cf tempest-SnapshotsActionsTest-2110605389 None] Volume volume-18029220-1c5f-4c8e-9340-cdd00e1f85b0 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:21.207268 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-92a47a15-aad4-4390-b707-006b07b495cf tempest-SnapshotsActionsTest-2110605389 None] deleting rbd volume volume-18029220-1c5f-4c8e-9340-cdd00e1f85b0 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:21.295197 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-85b6988d-e7bd-4651-ad5b-83888e14199b tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:21.427649 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-92a47a15-aad4-4390-b707-006b07b495cf tempest-SnapshotsActionsTest-2110605389 None] Created reservations ['da4224a5-58a2-490b-84f2-baeb4c99ce76', '3808f37c-c667-486b-9ec7-92cbccae519c', '1d549513-c1ed-46b5-ae13-d3cdbfe2cfcd', 'f7e78bec-859e-43f6-a6f3-65c8866de7a2'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:21.470275 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-92a47a15-aad4-4390-b707-006b07b495cf tempest-SnapshotsActionsTest-2110605389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:21.492510 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-92a47a15-aad4-4390-b707-006b07b495cf tempest-SnapshotsActionsTest-2110605389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:21.516380 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-92a47a15-aad4-4390-b707-006b07b495cf tempest-SnapshotsActionsTest-2110605389 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:21.521263 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-92a47a15-aad4-4390-b707-006b07b495cf tempest-SnapshotsActionsTest-2110605389 None] Deleted volume successfully. Mar 05 21:18:21.534418 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-92a47a15-aad4-4390-b707-006b07b495cf tempest-SnapshotsActionsTest-2110605389 None] Lock "b'cinder-18029220-1c5f-4c8e-9340-cdd00e1f85b0-delete_volume'" released by "delete_volume" :: held 0.412s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:21.647561 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-85b6988d-e7bd-4651-ad5b-83888e14199b tempest-VolumesSnapshotTestJSON-163973597 None] Create snapshot completed successfully Mar 05 21:18:22.410835 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-f3c64dda-93b4-4a5a-9561-d38a4f3d9adb tempest-VolumesActionsTest-1079041022 None] Lock "b'cinder-6ef5419a-6abb-4482-9107-5e7d9f168444-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:22.457922 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3c64dda-93b4-4a5a-9561-d38a4f3d9adb tempest-VolumesActionsTest-1079041022 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:22.514962 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3c64dda-93b4-4a5a-9561-d38a4f3d9adb tempest-VolumesActionsTest-1079041022 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:22.515421 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3c64dda-93b4-4a5a-9561-d38a4f3d9adb tempest-VolumesActionsTest-1079041022 None] Volume volume-6ef5419a-6abb-4482-9107-5e7d9f168444 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:22.523069 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3c64dda-93b4-4a5a-9561-d38a4f3d9adb tempest-VolumesActionsTest-1079041022 None] deleting rbd volume volume-6ef5419a-6abb-4482-9107-5e7d9f168444 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:22.546179 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ad6db983-5476-4528-885e-043920e2283d tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-4d5b65c7-7bae-467b-ba3e-257da8e682f1-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:22.547850 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ad6db983-5476-4528-885e-043920e2283d tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:22.817050 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-f3c64dda-93b4-4a5a-9561-d38a4f3d9adb tempest-VolumesActionsTest-1079041022 None] Created reservations ['93d68ebc-06d2-46fc-b486-cf00ee4d0f08', 'eeb1ceda-394d-4545-9350-e5bd88dc9bb3', '4dfcd9e6-5f43-41ec-9864-0fa8789c1982', 'a50dcc78-26f4-49e6-92f0-84f35d379dd1'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:22.861541 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3c64dda-93b4-4a5a-9561-d38a4f3d9adb tempest-VolumesActionsTest-1079041022 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:22.887255 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f3c64dda-93b4-4a5a-9561-d38a4f3d9adb tempest-VolumesActionsTest-1079041022 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:22.919117 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-f3c64dda-93b4-4a5a-9561-d38a4f3d9adb tempest-VolumesActionsTest-1079041022 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:22.925993 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f3c64dda-93b4-4a5a-9561-d38a4f3d9adb tempest-VolumesActionsTest-1079041022 None] Deleted volume successfully. Mar 05 21:18:22.937994 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-f3c64dda-93b4-4a5a-9561-d38a4f3d9adb tempest-VolumesActionsTest-1079041022 None] Lock "b'cinder-6ef5419a-6abb-4482-9107-5e7d9f168444-delete_volume'" released by "delete_volume" :: held 0.527s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:23.646791 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-d6df5391-167f-4728-8aee-d0f22db29a10 tempest-VolumesActionsTest-1079041022 None] Lock "b'cinder-68cc44b9-722e-4b65-b64f-3b78785c39d4-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:23.704278 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d6df5391-167f-4728-8aee-d0f22db29a10 tempest-VolumesActionsTest-1079041022 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:23.751535 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d6df5391-167f-4728-8aee-d0f22db29a10 tempest-VolumesActionsTest-1079041022 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:23.752006 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d6df5391-167f-4728-8aee-d0f22db29a10 tempest-VolumesActionsTest-1079041022 None] Volume volume-68cc44b9-722e-4b65-b64f-3b78785c39d4 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:23.758569 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d6df5391-167f-4728-8aee-d0f22db29a10 tempest-VolumesActionsTest-1079041022 None] deleting rbd volume volume-68cc44b9-722e-4b65-b64f-3b78785c39d4 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:23.789208 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-ad6db983-5476-4528-885e-043920e2283d tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['2ddbf74d-8dbf-4546-93ba-c77627f9d6fd', 'cd39768d-0e3a-48a1-8355-8241c425aeb9', '317aaf7e-0d5c-4914-85a1-b139424c02be', 'e7ce1873-ed3e-4a82-8c37-a83d6ccfbaaf'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:23.834242 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ad6db983-5476-4528-885e-043920e2283d tempest-VolumesSnapshotTestJSON-163973597 None] Delete snapshot completed successfully. Mar 05 21:18:23.839561 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ad6db983-5476-4528-885e-043920e2283d tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-4d5b65c7-7bae-467b-ba3e-257da8e682f1-delete_snapshot'" released by "delete_snapshot" :: held 1.293s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:24.012077 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-d6df5391-167f-4728-8aee-d0f22db29a10 tempest-VolumesActionsTest-1079041022 None] Created reservations ['cb9bdcbc-bed7-4108-a433-b8af56db5a9f', '49102247-b1f8-4cab-938d-fa8e1033064c', '446c162f-ec6d-4689-8210-80b228a219ec', '5e870e8d-4e54-426a-8109-8f132c7ab076'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:24.062576 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d6df5391-167f-4728-8aee-d0f22db29a10 tempest-VolumesActionsTest-1079041022 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:24.096597 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d6df5391-167f-4728-8aee-d0f22db29a10 tempest-VolumesActionsTest-1079041022 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:24.122456 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-d6df5391-167f-4728-8aee-d0f22db29a10 tempest-VolumesActionsTest-1079041022 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:24.126308 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d6df5391-167f-4728-8aee-d0f22db29a10 tempest-VolumesActionsTest-1079041022 None] Deleted volume successfully. Mar 05 21:18:24.140029 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-d6df5391-167f-4728-8aee-d0f22db29a10 tempest-VolumesActionsTest-1079041022 None] Lock "b'cinder-68cc44b9-722e-4b65-b64f-3b78785c39d4-delete_volume'" released by "delete_volume" :: held 0.494s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:24.793931 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ae8840cd-3e95-4c49-925a-cd4187f3ec32 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:25.506854 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:25.510509 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:25.510985 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:25.530659 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Flow 'volume_create_manager' (87136f1d-8c79-448b-ba7b-01a9926a9889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:25.538041 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b71f981-6804-4d3d-8569-5e41995a8613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:25.545179 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:25.560416 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b71f981-6804-4d3d-8569-5e41995a8613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1427053435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a4796609-4ada-4750-b421-6deaa4c14a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e8920e4cd04b14bda24016ed84f82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:25Z,use_quota=True,user_id='1772229aa9cc4baab428cd11a55ee6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:25.566764 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fc2bef-60ae-4076-925e-b68862769452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:25.571641 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fc2bef-60ae-4076-925e-b68862769452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:25.577032 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481c3623-d298-4fd1-a0de-3d1698765b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:25.581537 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481c3623-d298-4fd1-a0de-3d1698765b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4796609-4ada-4750-b421-6deaa4c14a52', 'volume_name': 'volume-a4796609-4ada-4750-b421-6deaa4c14a52', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:25.586581 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7470c0-4f70-4687-8b0f-73e71d7f5d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:25.590677 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7470c0-4f70-4687-8b0f-73e71d7f5d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:25.595467 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5ea1f9-c32f-4371-b2b9-fb50158b5d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:25.596644 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Volume a4796609-4ada-4750-b421-6deaa4c14a52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4796609-4ada-4750-b421-6deaa4c14a52', 'volume_size': 1} Mar 05 21:18:25.597216 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] creating volume 'volume-a4796609-4ada-4750-b421-6deaa4c14a52' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:18:25.598212 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:25.684784 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:25.685333 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:25.689501 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5ea1f9-c32f-4371-b2b9-fb50158b5d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4796609-4ada-4750-b421-6deaa4c14a52', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:25.695997 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789a3a6b-dc93-47da-9d7c-6122a90028b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:25.710618 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Volume volume-a4796609-4ada-4750-b421-6deaa4c14a52 (a4796609-4ada-4750-b421-6deaa4c14a52): created successfully Mar 05 21:18:25.714455 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789a3a6b-dc93-47da-9d7c-6122a90028b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:25.720489 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Flow 'volume_create_manager' (87136f1d-8c79-448b-ba7b-01a9926a9889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:25.738395 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-4f13660c-b6a6-4d92-9abc-7c6bd7d3fe0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Created volume successfully. Mar 05 21:18:25.742229 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ae8840cd-3e95-4c49-925a-cd4187f3ec32 tempest-VolumesSnapshotTestJSON-163973597 None] Create snapshot completed successfully Mar 05 21:18:26.766485 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-9a4dcfe5-0675-46d7-a198-0950b720e105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:27.417480 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-9a4dcfe5-0675-46d7-a198-0950b720e105 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Create snapshot completed successfully Mar 05 21:18:27.983214 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:27.987844 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:27.988974 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:28.012027 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Flow 'volume_create_manager' (5e6c0c30-e742-460e-a0e1-afe3a6f0d08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:28.020747 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26ff603-4b14-4f74-8a1c-62310a0bc106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:28.033962 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:28.051582 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26ff603-4b14-4f74-8a1c-62310a0bc106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-858807671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aa175cc7-7913-4c64-8afb-84f4fdda43fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d895e52c624b5ab4c178e45633ac78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:28Z,use_quota=True,user_id='1249e990ca11452a9eed50095f852bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:28.057255 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f082e7-6524-42eb-8b8a-2431dda23d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:28.061597 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f082e7-6524-42eb-8b8a-2431dda23d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:28.066991 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6353760c-fc6e-41f9-9bfc-45faf7399d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:28.071310 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6353760c-fc6e-41f9-9bfc-45faf7399d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa175cc7-7913-4c64-8afb-84f4fdda43fc', 'volume_name': 'volume-aa175cc7-7913-4c64-8afb-84f4fdda43fc', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:28.083400 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22939e6-ba78-4571-8dae-2c75b237ec3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:28.088643 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22939e6-ba78-4571-8dae-2c75b237ec3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:28.093566 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9bb4bd-a391-41db-8f04-cde0a60b6511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:28.094688 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Volume aa175cc7-7913-4c64-8afb-84f4fdda43fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa175cc7-7913-4c64-8afb-84f4fdda43fc', 'volume_size': 1} Mar 05 21:18:28.095102 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] creating volume 'volume-aa175cc7-7913-4c64-8afb-84f4fdda43fc' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:18:28.096660 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:28.163890 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:28.164366 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:28.168146 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9bb4bd-a391-41db-8f04-cde0a60b6511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa175cc7-7913-4c64-8afb-84f4fdda43fc', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:28.172764 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977d2e3f-97e1-4aa2-a6f3-8455e8616b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:28.182715 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Volume volume-aa175cc7-7913-4c64-8afb-84f4fdda43fc (aa175cc7-7913-4c64-8afb-84f4fdda43fc): created successfully Mar 05 21:18:28.188063 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977d2e3f-97e1-4aa2-a6f3-8455e8616b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:28.195334 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Flow 'volume_create_manager' (5e6c0c30-e742-460e-a0e1-afe3a6f0d08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:28.212235 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-57dbaea7-4a52-4fc2-9e0e-1dcf361c1afb tempest-SnapshotMetadataTestJSON-369573029 None] Created volume successfully. Mar 05 21:18:28.220955 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-77b063a5-fc12-4469-a1ec-a170c0709ac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Lock "b'cinder-47954f6f-6c7f-4e52-bfbf-23e3c814d53f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:28.223112 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-77b063a5-fc12-4469-a1ec-a170c0709ac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:28.740878 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-77b063a5-fc12-4469-a1ec-a170c0709ac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Created reservations ['9de40cbb-ab05-431c-bf16-6bcf74812bb1', '44532fc8-6f51-4922-b50a-7c3f0ad02e97', '0cf9a24b-3c04-484b-8dc7-163235be6c02', '867ec274-09de-4749-9ee5-4aab6dda9176'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:28.777080 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-77b063a5-fc12-4469-a1ec-a170c0709ac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Delete snapshot completed successfully. Mar 05 21:18:28.781944 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-77b063a5-fc12-4469-a1ec-a170c0709ac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Lock "b'cinder-47954f6f-6c7f-4e52-bfbf-23e3c814d53f-delete_snapshot'" released by "delete_snapshot" :: held 0.561s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:29.181172 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-77a70543-e31c-4dad-8c14-c58e1d2e0bb7 tempest-SnapshotMetadataTestJSON-369573029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:29.323254 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-c254843f-b369-45c5-ad97-b375fedc9874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Lock "b'cinder-a4796609-4ada-4750-b421-6deaa4c14a52-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:29.355398 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c254843f-b369-45c5-ad97-b375fedc9874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:29.396704 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c254843f-b369-45c5-ad97-b375fedc9874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:29.397143 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c254843f-b369-45c5-ad97-b375fedc9874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Volume volume-a4796609-4ada-4750-b421-6deaa4c14a52 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:29.402967 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c254843f-b369-45c5-ad97-b375fedc9874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] deleting rbd volume volume-a4796609-4ada-4750-b421-6deaa4c14a52 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:29.633800 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-c254843f-b369-45c5-ad97-b375fedc9874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Created reservations ['3e66c0e7-d89c-471a-b1dd-33a11983727a', '230ca1f9-0ef9-417b-a580-9210c52072b1', 'ff2202aa-c837-42cc-9a6c-5fe60a0ff26c', '997d5e81-2736-4af1-9257-9bea94c20634'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:29.686135 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c254843f-b369-45c5-ad97-b375fedc9874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:29.719064 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c254843f-b369-45c5-ad97-b375fedc9874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:29.742926 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-c254843f-b369-45c5-ad97-b375fedc9874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:29.746936 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c254843f-b369-45c5-ad97-b375fedc9874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Deleted volume successfully. Mar 05 21:18:29.764067 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-c254843f-b369-45c5-ad97-b375fedc9874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1988379684 None] Lock "b'cinder-a4796609-4ada-4750-b421-6deaa4c14a52-delete_volume'" released by "delete_volume" :: held 0.441s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:29.800671 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-77a70543-e31c-4dad-8c14-c58e1d2e0bb7 tempest-SnapshotMetadataTestJSON-369573029 None] Create snapshot completed successfully Mar 05 21:18:30.876391 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e1ef1866-12de-47f3-9340-46eb2ff146f4 tempest-SnapshotMetadataTestJSON-369573029 None] Lock "b'cinder-704f7dc0-a869-492d-82b4-a7348e8968c3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:30.878052 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e1ef1866-12de-47f3-9340-46eb2ff146f4 tempest-SnapshotMetadataTestJSON-369573029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:31.768620 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-e1ef1866-12de-47f3-9340-46eb2ff146f4 tempest-SnapshotMetadataTestJSON-369573029 None] Created reservations ['6e9b3ec3-7fe6-4fe4-90cb-5a43379e4a3b', '5721feed-92a6-43ba-8667-d72445249871', 'cb3fb19b-1b6f-4ebd-a8ed-8e48b90f92b5', 'bb200622-ee00-466b-b97f-335cb44c544d'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:31.814036 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-e1ef1866-12de-47f3-9340-46eb2ff146f4 tempest-SnapshotMetadataTestJSON-369573029 None] Delete snapshot completed successfully. Mar 05 21:18:31.819264 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-e1ef1866-12de-47f3-9340-46eb2ff146f4 tempest-SnapshotMetadataTestJSON-369573029 None] Lock "b'cinder-704f7dc0-a869-492d-82b4-a7348e8968c3-delete_snapshot'" released by "delete_snapshot" :: held 0.943s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:31.979794 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-f57d5298-1830-49cc-9a8b-dd4b4aaa6324 tempest-SnapshotMetadataTestJSON-369573029 None] Lock "b'cinder-aa175cc7-7913-4c64-8afb-84f4fdda43fc-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:32.014238 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f57d5298-1830-49cc-9a8b-dd4b4aaa6324 tempest-SnapshotMetadataTestJSON-369573029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:32.053935 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f57d5298-1830-49cc-9a8b-dd4b4aaa6324 tempest-SnapshotMetadataTestJSON-369573029 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:32.054458 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f57d5298-1830-49cc-9a8b-dd4b4aaa6324 tempest-SnapshotMetadataTestJSON-369573029 None] Volume volume-aa175cc7-7913-4c64-8afb-84f4fdda43fc is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:32.059204 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f57d5298-1830-49cc-9a8b-dd4b4aaa6324 tempest-SnapshotMetadataTestJSON-369573029 None] deleting rbd volume volume-aa175cc7-7913-4c64-8afb-84f4fdda43fc {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:32.322242 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-f57d5298-1830-49cc-9a8b-dd4b4aaa6324 tempest-SnapshotMetadataTestJSON-369573029 None] Created reservations ['b634de35-294e-44f7-807b-d6829e7bb21b', 'c1bce689-603e-4114-a4a5-d9c02cdb2f67', 'dca1229d-e87f-4069-8eda-935bf1f9e332', '777a4f23-4e51-4054-a1c7-8ad1fd8bd56f'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:32.386969 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f57d5298-1830-49cc-9a8b-dd4b4aaa6324 tempest-SnapshotMetadataTestJSON-369573029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:32.416773 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f57d5298-1830-49cc-9a8b-dd4b4aaa6324 tempest-SnapshotMetadataTestJSON-369573029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:32.443442 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-f57d5298-1830-49cc-9a8b-dd4b4aaa6324 tempest-SnapshotMetadataTestJSON-369573029 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:32.449289 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f57d5298-1830-49cc-9a8b-dd4b4aaa6324 tempest-SnapshotMetadataTestJSON-369573029 None] Deleted volume successfully. Mar 05 21:18:32.462564 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-f57d5298-1830-49cc-9a8b-dd4b4aaa6324 tempest-SnapshotMetadataTestJSON-369573029 None] Lock "b'cinder-aa175cc7-7913-4c64-8afb-84f4fdda43fc-delete_volume'" released by "delete_volume" :: held 0.483s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:33.153963 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:33.157214 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:33.157661 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:33.177856 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Flow 'volume_create_manager' (b97059db-9930-4d66-9112-e621219665ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:33.184905 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e62ab7a-bc54-44ab-8c71-516d6a2dc054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:33.192139 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:33.209449 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e62ab7a-bc54-44ab-8c71-516d6a2dc054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-812575638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2556f950-e231-41cb-9e2c-cc953f1e4c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e60a806b1440cba9a7074d272717b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:33Z,use_quota=True,user_id='b6949ac8f1304764824496d63bed518b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:33.214926 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71ab9cf-c76e-4902-92c9-3a2e5ad1778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:33.219082 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71ab9cf-c76e-4902-92c9-3a2e5ad1778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:33.225207 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06670907-9c7a-49e7-8066-a8aa615cdb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:33.310713 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06670907-9c7a-49e7-8066-a8aa615cdb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2556f950-e231-41cb-9e2c-cc953f1e4c92', 'volume_name': 'volume-2556f950-e231-41cb-9e2c-cc953f1e4c92', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:33.316659 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd6280d-9363-4416-a5c6-b8644fd68b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:33.320835 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd6280d-9363-4416-a5c6-b8644fd68b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:33.325571 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ac75d3-6959-4f00-97f5-9a6979289b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:33.326717 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Volume 2556f950-e231-41cb-9e2c-cc953f1e4c92: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2556f950-e231-41cb-9e2c-cc953f1e4c92', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 21:18:33.327293 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Cloning 2556f950-e231-41cb-9e2c-cc953f1e4c92 from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 21:18:33.339063 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:33.349813 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 18, 33, 343380)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:18:33.350276 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:18:33.350715 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Found cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 05 21:18:33.355036 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:33.355972 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 21:18:33.361372 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 18, 33, 359159)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:18:33.362753 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:18:33.362753 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Creating from source image-volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7 {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 05 21:18:33.374434 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:33.430380 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] creating snapshot='volume-2556f950-e231-41cb-9e2c-cc953f1e4c92.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 21:18:33.746075 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] cloning 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7@volume-2556f950-e231-41cb-9e2c-cc953f1e4c92.clone_snap' to 'volume-2556f950-e231-41cb-9e2c-cc953f1e4c92' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 21:18:33.893925 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a.deleted is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:33.895256 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:33.895894 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:33.917209 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 21:18:33.917849 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Marking volume 2556f950-e231-41cb-9e2c-cc953f1e4c92 as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 21:18:33.926473 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to 2556f950-e231-41cb-9e2c-cc953f1e4c92. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 21:18:33.927107 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Creating volume glance metadata for volume 2556f950-e231-41cb-9e2c-cc953f1e4c92 backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 21:18:33.981900 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ac75d3-6959-4f00-97f5-9a6979289b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2556f950-e231-41cb-9e2c-cc953f1e4c92', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:33.987026 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ba62cc-2b1b-4662-a5c5-916a2bdcb02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:33.999321 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Volume volume-2556f950-e231-41cb-9e2c-cc953f1e4c92 (2556f950-e231-41cb-9e2c-cc953f1e4c92): created successfully Mar 05 21:18:34.004504 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ba62cc-2b1b-4662-a5c5-916a2bdcb02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:34.010905 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Flow 'volume_create_manager' (b97059db-9930-4d66-9112-e621219665ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:34.021457 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-4be4839f-0c01-4495-965c-9b2756e263ef tempest-VolumesCloneTest-2133259796 None] Created volume successfully. Mar 05 21:18:34.558476 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:34.563071 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:34.563756 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:34.596855 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Flow 'volume_create_manager' (8c50ecce-7a25-49bc-8a4d-11116498440e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:34.603451 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d24a7a-3be2-4f44-a110-d3bb0b089f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:34.611324 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:34.626147 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d24a7a-3be2-4f44-a110-d3bb0b089f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-671647878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6f054d27-e287-42ce-af9a-a88b2119efdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e60a806b1440cba9a7074d272717b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2556f950-e231-41cb-9e2c-cc953f1e4c92,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:35Z,use_quota=True,user_id='b6949ac8f1304764824496d63bed518b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:34.631850 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52689ed-06c1-4308-82ee-b83231b514d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:34.636281 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52689ed-06c1-4308-82ee-b83231b514d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:34.641429 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f3ecf2-9a16-40c7-b413-d232486cdd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:34.658469 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f3ecf2-9a16-40c7-b413-d232486cdd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6f054d27-e287-42ce-af9a-a88b2119efdd', 'volume_name': 'volume-6f054d27-e287-42ce-af9a-a88b2119efdd', 'volume_size': 1, 'source_volid': '2556f950-e231-41cb-9e2c-cc953f1e4c92', 'source_volstatus': 'available'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:34.664193 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413eb931-ce42-4d7e-aaeb-496b1b6bc6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:34.668325 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413eb931-ce42-4d7e-aaeb-496b1b6bc6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:34.673104 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e605a328-e275-41d9-87db-429ac0a00eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:34.674394 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Volume 6f054d27-e287-42ce-af9a-a88b2119efdd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6f054d27-e287-42ce-af9a-a88b2119efdd', 'volume_size': 1, 'source_volid': '2556f950-e231-41cb-9e2c-cc953f1e4c92', 'source_volstatus': 'available'} Mar 05 21:18:34.686249 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:34.758555 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] creating snapshot='volume-6f054d27-e287-42ce-af9a-a88b2119efdd.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 21:18:35.771991 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] cloning 'volume-2556f950-e231-41cb-9e2c-cc953f1e4c92@volume-6f054d27-e287-42ce-af9a-a88b2119efdd.clone_snap' to 'volume-6f054d27-e287-42ce-af9a-a88b2119efdd' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 21:18:36.003323 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a.deleted is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:36.004698 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:36.005540 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:36.029714 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 21:18:36.030232 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Marking volume 6f054d27-e287-42ce-af9a-a88b2119efdd as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 21:18:36.041007 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Copying metadata from source volume 2556f950-e231-41cb-9e2c-cc953f1e4c92 to 6f054d27-e287-42ce-af9a-a88b2119efdd. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Mar 05 21:18:36.071606 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e605a328-e275-41d9-87db-429ac0a00eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f054d27-e287-42ce-af9a-a88b2119efdd', 'volume_size': 1, 'source_volid': '2556f950-e231-41cb-9e2c-cc953f1e4c92', 'source_volstatus': 'available'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:36.076537 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7d16f5-2ef4-4daf-80bd-d400fdbe8dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:36.087181 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Volume volume-6f054d27-e287-42ce-af9a-a88b2119efdd (6f054d27-e287-42ce-af9a-a88b2119efdd): created successfully Mar 05 21:18:36.091327 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7d16f5-2ef4-4daf-80bd-d400fdbe8dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:36.097701 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Flow 'volume_create_manager' (8c50ecce-7a25-49bc-8a4d-11116498440e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:36.110764 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-adfea838-380a-4a07-b4dd-7353c2d30d62 tempest-VolumesCloneTest-2133259796 None] Created volume successfully. Mar 05 21:18:36.288543 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:36.291841 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:36.292241 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:36.310934 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Flow 'volume_create_manager' (c8a98b49-ba5e-46a5-bb5f-1a7759f77571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:36.318088 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31273e4b-3140-45b5-9659-78461b658b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:36.324919 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:36.340697 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31273e4b-3140-45b5-9659-78461b658b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-22150220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=02bde856-d54c-4955-907a-ee747a7ac286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77adfa66bee46fd83fb5e92e313c656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:36Z,use_quota=True,user_id='2aa76c9454e1437d92b5ccd1f15eccdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:36.346652 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f51ad0c-89fc-48bd-98e3-ee1e3a67981d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:36.350906 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f51ad0c-89fc-48bd-98e3-ee1e3a67981d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:36.356239 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95aaa8d2-2689-4002-97bb-c3f3a8011290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:36.360556 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95aaa8d2-2689-4002-97bb-c3f3a8011290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02bde856-d54c-4955-907a-ee747a7ac286', 'volume_name': 'volume-02bde856-d54c-4955-907a-ee747a7ac286', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:36.366257 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42315d8-4f1c-4c49-b93b-eb3bcb29caf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:36.370365 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42315d8-4f1c-4c49-b93b-eb3bcb29caf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:36.375128 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21520191-f775-446e-92f4-81a104d16d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:36.376254 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Volume 02bde856-d54c-4955-907a-ee747a7ac286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02bde856-d54c-4955-907a-ee747a7ac286', 'volume_size': 1} Mar 05 21:18:36.376651 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] creating volume 'volume-02bde856-d54c-4955-907a-ee747a7ac286' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:18:36.378376 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:36.432384 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:36.432770 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:36.436772 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21520191-f775-446e-92f4-81a104d16d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02bde856-d54c-4955-907a-ee747a7ac286', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:36.442420 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7a3ed6-8d09-4e2c-a28d-d6358985588d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:36.452466 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Volume volume-02bde856-d54c-4955-907a-ee747a7ac286 (02bde856-d54c-4955-907a-ee747a7ac286): created successfully Mar 05 21:18:36.456923 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7a3ed6-8d09-4e2c-a28d-d6358985588d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:36.462602 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Flow 'volume_create_manager' (c8a98b49-ba5e-46a5-bb5f-1a7759f77571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:36.471949 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-3904d680-9e7d-4dd4-a18c-3623aed08d13 tempest-VolumesTransfersTest-289898880 None] Created volume successfully. Mar 05 21:18:36.979378 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:36.982650 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:36.983101 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:37.006266 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Flow 'volume_create_manager' (4a9f5986-c9c0-4e2d-b1bb-77d9dac7c9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:37.013579 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e4e878-e6f3-4ec1-8a4b-8d28d7433d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:37.020759 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:37.035684 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e4e878-e6f3-4ec1-8a4b-8d28d7433d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2065133307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=99302f01-fba2-4290-9f0c-fb8c09be906b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e60a806b1440cba9a7074d272717b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:37Z,use_quota=True,user_id='b6949ac8f1304764824496d63bed518b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:37.041806 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d51e13-ea3e-4639-a448-1b12e5f6b8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:37.046443 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d51e13-ea3e-4639-a448-1b12e5f6b8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:37.052736 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8928c3fd-a4a3-418d-b3f8-5c25a87634e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:37.057000 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8928c3fd-a4a3-418d-b3f8-5c25a87634e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99302f01-fba2-4290-9f0c-fb8c09be906b', 'volume_name': 'volume-99302f01-fba2-4290-9f0c-fb8c09be906b', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:37.062232 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba462aeb-a7d0-4f67-babd-3331718c936c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:37.067246 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba462aeb-a7d0-4f67-babd-3331718c936c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:37.072129 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5e5ec2-d21e-4a40-87ef-e010bbe28d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:37.073477 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Volume 99302f01-fba2-4290-9f0c-fb8c09be906b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99302f01-fba2-4290-9f0c-fb8c09be906b', 'volume_size': 1} Mar 05 21:18:37.073883 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] creating volume 'volume-99302f01-fba2-4290-9f0c-fb8c09be906b' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:18:37.075029 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:37.134770 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:37.135276 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:37.139188 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5e5ec2-d21e-4a40-87ef-e010bbe28d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99302f01-fba2-4290-9f0c-fb8c09be906b', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:37.143935 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03b5915-cdde-4ecb-8303-e2c9371e2233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:37.152769 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Volume volume-99302f01-fba2-4290-9f0c-fb8c09be906b (99302f01-fba2-4290-9f0c-fb8c09be906b): created successfully Mar 05 21:18:37.156782 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03b5915-cdde-4ecb-8303-e2c9371e2233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:37.163378 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Flow 'volume_create_manager' (4a9f5986-c9c0-4e2d-b1bb-77d9dac7c9ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:37.172289 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-a7b1593d-1f85-4513-87db-ab17ec44526d tempest-VolumesCloneTest-2133259796 None] Created volume successfully. Mar 05 21:18:37.223167 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-53e626c2-9dd1-4229-bb48-f8c610db2291 req-e3aaf278-e863-4bc4-b20f-867b63a736e7 tempest-VolumesSnapshotTestJSON-163973597 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:18:37.791320 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-94ed6cd1-54e2-4197-9adb-a4c15c4eb190 tempest-VolumesTransfersTest-1496549397 None] Transfer volume completed successfully. Mar 05 21:18:37.883870 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-53e626c2-9dd1-4229-bb48-f8c610db2291 req-e3aaf278-e863-4bc4-b20f-867b63a736e7 tempest-VolumesSnapshotTestJSON-163973597 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.660s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:18:37.884925 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-53e626c2-9dd1-4229-bb48-f8c610db2291 req-e3aaf278-e863-4bc4-b20f-867b63a736e7 tempest-VolumesSnapshotTestJSON-163973597 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2b235070-e46f-4802-b5ac-7531e3c2899c', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '2b235070-e46f-4802-b5ac-7531e3c2899c', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:18:37.909805 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-53e626c2-9dd1-4229-bb48-f8c610db2291 req-e3aaf278-e863-4bc4-b20f-867b63a736e7 tempest-VolumesSnapshotTestJSON-163973597 None] Connection info returned from driver {'name': 'volumes/volume-2b235070-e46f-4802-b5ac-7531e3c2899c', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2b235070-e46f-4802-b5ac-7531e3c2899c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0e108306-bbe4-4baf-8dcc-554d80bf90e6'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:18:37.958959 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-53e626c2-9dd1-4229-bb48-f8c610db2291 req-e3aaf278-e863-4bc4-b20f-867b63a736e7 tempest-VolumesSnapshotTestJSON-163973597 None] attachment_update completed successfully. Mar 05 21:18:38.192037 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-31b8caf7-6139-4416-8b8f-3f2d318e4e1f tempest-VolumesTransfersTest-1537072613 None] Lock "b'cinder-02bde856-d54c-4955-907a-ee747a7ac286-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:38.222468 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-31b8caf7-6139-4416-8b8f-3f2d318e4e1f tempest-VolumesTransfersTest-1537072613 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:38.300142 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-31b8caf7-6139-4416-8b8f-3f2d318e4e1f tempest-VolumesTransfersTest-1537072613 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:38.300648 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-31b8caf7-6139-4416-8b8f-3f2d318e4e1f tempest-VolumesTransfersTest-1537072613 None] Volume volume-02bde856-d54c-4955-907a-ee747a7ac286 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:38.306675 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-31b8caf7-6139-4416-8b8f-3f2d318e4e1f tempest-VolumesTransfersTest-1537072613 None] deleting rbd volume volume-02bde856-d54c-4955-907a-ee747a7ac286 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:38.356228 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:38.360929 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:38.361970 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:38.394639 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Flow 'volume_create_manager' (b1cea431-c1d2-4707-a811-75d2ddb54f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:38.403162 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35899fc2-0531-42f9-a493-3facf796e3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:38.410433 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:38.428531 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35899fc2-0531-42f9-a493-3facf796e3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-724982460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=39c9be8d-f7a1-48fd-84ff-9a33260326c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e60a806b1440cba9a7074d272717b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=99302f01-fba2-4290-9f0c-fb8c09be906b,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:38Z,use_quota=True,user_id='b6949ac8f1304764824496d63bed518b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:38.434523 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a7e03d-a75b-4b63-a048-7e98dae680d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:38.439335 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a7e03d-a75b-4b63-a048-7e98dae680d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:38.444802 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76de027f-4fca-475e-bbbe-886e8d99aa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:38.462226 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76de027f-4fca-475e-bbbe-886e8d99aa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '39c9be8d-f7a1-48fd-84ff-9a33260326c3', 'volume_name': 'volume-39c9be8d-f7a1-48fd-84ff-9a33260326c3', 'volume_size': 2, 'source_volid': '99302f01-fba2-4290-9f0c-fb8c09be906b', 'source_volstatus': 'available'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:38.469251 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630c450e-98b0-4feb-bb29-4180ccdc2095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:38.474863 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630c450e-98b0-4feb-bb29-4180ccdc2095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:38.481430 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c7caa2-1bef-4c40-9b60-4d1679d0c705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:38.482666 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Volume 39c9be8d-f7a1-48fd-84ff-9a33260326c3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-39c9be8d-f7a1-48fd-84ff-9a33260326c3', 'volume_size': 2, 'source_volid': '99302f01-fba2-4290-9f0c-fb8c09be906b', 'source_volstatus': 'available'} Mar 05 21:18:38.497483 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:38.539047 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] creating snapshot='volume-39c9be8d-f7a1-48fd-84ff-9a33260326c3.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 21:18:39.390743 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] cloning 'volume-99302f01-fba2-4290-9f0c-fb8c09be906b@volume-39c9be8d-f7a1-48fd-84ff-9a33260326c3.clone_snap' to 'volume-39c9be8d-f7a1-48fd-84ff-9a33260326c3' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 21:18:39.449370 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-31b8caf7-6139-4416-8b8f-3f2d318e4e1f tempest-VolumesTransfersTest-1537072613 None] Created reservations ['27a933dd-e3c8-4dd7-b281-87039456dfa8', '05dd606d-bff7-4fa8-b531-4aff2dc5bcee', '5fd23656-7091-4bd5-a769-e49e16239946', '4dfb82ab-09c3-44aa-aac8-dd619c4ba7fb'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:39.512904 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Volume volume-99302f01-fba2-4290-9f0c-fb8c09be906b is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:39.514308 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:39.514688 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:39.529275 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] resize volume 'volume-39c9be8d-f7a1-48fd-84ff-9a33260326c3' from 1 to 2 {{(pid=134747) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:694}} Mar 05 21:18:39.530203 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:39.606982 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-31b8caf7-6139-4416-8b8f-3f2d318e4e1f tempest-VolumesTransfersTest-1537072613 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:39.632784 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-31b8caf7-6139-4416-8b8f-3f2d318e4e1f tempest-VolumesTransfersTest-1537072613 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:39.656838 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-31b8caf7-6139-4416-8b8f-3f2d318e4e1f tempest-VolumesTransfersTest-1537072613 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:39.666695 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 21:18:39.670512 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c7caa2-1bef-4c40-9b60-4d1679d0c705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c9be8d-f7a1-48fd-84ff-9a33260326c3', 'volume_size': 2, 'source_volid': '99302f01-fba2-4290-9f0c-fb8c09be906b', 'source_volstatus': 'available'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:39.675898 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73ca7f5-dc4f-4185-b154-0e982b990487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:39.683200 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3cd77561-7bc9-40e6-a9ef-7878490339fc tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:39.721899 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-31b8caf7-6139-4416-8b8f-3f2d318e4e1f tempest-VolumesTransfersTest-1537072613 None] Deleted volume successfully. Mar 05 21:18:39.726663 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Volume volume-39c9be8d-f7a1-48fd-84ff-9a33260326c3 (39c9be8d-f7a1-48fd-84ff-9a33260326c3): created successfully Mar 05 21:18:39.731031 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73ca7f5-dc4f-4185-b154-0e982b990487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:39.737561 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Flow 'volume_create_manager' (b1cea431-c1d2-4707-a811-75d2ddb54f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:39.745833 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-31b8caf7-6139-4416-8b8f-3f2d318e4e1f tempest-VolumesTransfersTest-1537072613 None] Lock "b'cinder-02bde856-d54c-4955-907a-ee747a7ac286-delete_volume'" released by "delete_volume" :: held 1.554s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:39.751812 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ea394b34-51dc-459e-b63c-354303cdfdd1 tempest-VolumesCloneTest-2133259796 None] Created volume successfully. Mar 05 21:18:40.441611 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-3cd77561-7bc9-40e6-a9ef-7878490339fc tempest-VolumesSnapshotTestJSON-163973597 None] Create snapshot completed successfully Mar 05 21:18:40.587413 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-11398192-84ca-4e81-921f-6da70c2d07ec tempest-VolumesCloneTest-2133259796 None] Lock "b'cinder-39c9be8d-f7a1-48fd-84ff-9a33260326c3-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:40.642795 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-11398192-84ca-4e81-921f-6da70c2d07ec tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:40.716727 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-11398192-84ca-4e81-921f-6da70c2d07ec tempest-VolumesCloneTest-2133259796 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:40.724035 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-11398192-84ca-4e81-921f-6da70c2d07ec tempest-VolumesCloneTest-2133259796 None] deleting rbd volume volume-39c9be8d-f7a1-48fd-84ff-9a33260326c3 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:40.747519 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:40.750366 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:40.750366 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:40.776257 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Flow 'volume_create_manager' (9e39872c-ce57-4183-bdf7-b27e48563f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:40.785481 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ec78f1-74dd-4cda-9c87-852dd6ffcdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:40.798213 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:40.818590 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ec78f1-74dd-4cda-9c87-852dd6ffcdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-49696351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3d871726-60a0-4c3b-9a6a-1459325e59b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77adfa66bee46fd83fb5e92e313c656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:41Z,use_quota=True,user_id='2aa76c9454e1437d92b5ccd1f15eccdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:40.825143 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabef20f-7992-4635-b33c-2c6547890213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:40.830065 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabef20f-7992-4635-b33c-2c6547890213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:40.836649 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1857428a-f44a-4298-8db1-5767b88261fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:40.841986 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1857428a-f44a-4298-8db1-5767b88261fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d871726-60a0-4c3b-9a6a-1459325e59b1', 'volume_name': 'volume-3d871726-60a0-4c3b-9a6a-1459325e59b1', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:40.849337 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732852fc-3848-48e6-bae3-71ac2238cd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:40.853879 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732852fc-3848-48e6-bae3-71ac2238cd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:40.860360 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58b6147-01b9-4be1-b4f5-4472e886afb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:40.861765 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Volume 3d871726-60a0-4c3b-9a6a-1459325e59b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d871726-60a0-4c3b-9a6a-1459325e59b1', 'volume_size': 1} Mar 05 21:18:40.862872 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] creating volume 'volume-3d871726-60a0-4c3b-9a6a-1459325e59b1' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:18:40.863503 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:40.915569 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8131c39b-7f26-4103-a25a-37ddfe39af35 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:40.970709 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:40.971419 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:40.976187 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58b6147-01b9-4be1-b4f5-4472e886afb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d871726-60a0-4c3b-9a6a-1459325e59b1', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:40.980963 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ad0db7-b895-40a6-acf7-f4874f1453b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:40.992399 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Volume volume-3d871726-60a0-4c3b-9a6a-1459325e59b1 (3d871726-60a0-4c3b-9a6a-1459325e59b1): created successfully Mar 05 21:18:40.998401 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ad0db7-b895-40a6-acf7-f4874f1453b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:41.006196 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Flow 'volume_create_manager' (9e39872c-ce57-4183-bdf7-b27e48563f04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:41.009826 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-11398192-84ca-4e81-921f-6da70c2d07ec tempest-VolumesCloneTest-2133259796 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 21:18:41.029603 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-11398192-84ca-4e81-921f-6da70c2d07ec tempest-VolumesCloneTest-2133259796 None] Volume volume-99302f01-fba2-4290-9f0c-fb8c09be906b is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:41.030260 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-11398192-84ca-4e81-921f-6da70c2d07ec tempest-VolumesCloneTest-2133259796 None] deleting parent snapshot volume-39c9be8d-f7a1-48fd-84ff-9a33260326c3.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 21:18:41.438923 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f2e047c8-3f85-4d3e-a18d-c2ff35ee7592 tempest-VolumesTransfersTest-289898880 None] Created volume successfully. Mar 05 21:18:41.482158 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8131c39b-7f26-4103-a25a-37ddfe39af35 tempest-VolumesSnapshotTestJSON-163973597 None] Create snapshot completed successfully Mar 05 21:18:41.485605 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-11398192-84ca-4e81-921f-6da70c2d07ec tempest-VolumesCloneTest-2133259796 None] Created reservations ['a916a213-7980-4511-aad2-9ee7298abaf3', 'e0fbd375-5610-4ec7-b318-cf328f2a5026', '4ff43a3c-a2c1-4c88-b621-89448871a6a0', '8d3eaddd-b672-42c8-994e-c19af1d2cef6'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:41.527632 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-11398192-84ca-4e81-921f-6da70c2d07ec tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:41.551486 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-11398192-84ca-4e81-921f-6da70c2d07ec tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:41.576690 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-11398192-84ca-4e81-921f-6da70c2d07ec tempest-VolumesCloneTest-2133259796 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:41.580579 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-11398192-84ca-4e81-921f-6da70c2d07ec tempest-VolumesCloneTest-2133259796 None] Deleted volume successfully. Mar 05 21:18:41.592345 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-11398192-84ca-4e81-921f-6da70c2d07ec tempest-VolumesCloneTest-2133259796 None] Lock "b'cinder-39c9be8d-f7a1-48fd-84ff-9a33260326c3-delete_volume'" released by "delete_volume" :: held 1.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:41.722941 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-01021913-4ea3-4123-9b63-3965f849df3a tempest-VolumesCloneTest-2133259796 None] Lock "b'cinder-99302f01-fba2-4290-9f0c-fb8c09be906b-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:41.755904 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-01021913-4ea3-4123-9b63-3965f849df3a tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:41.810896 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-01021913-4ea3-4123-9b63-3965f849df3a tempest-VolumesCloneTest-2133259796 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:41.811330 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-01021913-4ea3-4123-9b63-3965f849df3a tempest-VolumesCloneTest-2133259796 None] Volume volume-99302f01-fba2-4290-9f0c-fb8c09be906b is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:41.819142 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-01021913-4ea3-4123-9b63-3965f849df3a tempest-VolumesCloneTest-2133259796 None] deleting rbd volume volume-99302f01-fba2-4290-9f0c-fb8c09be906b {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:41.884935 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-dab51ee6-5f8e-4cc5-9ef5-0e261e814644 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-372a2a67-c284-403c-aac9-106724e72379-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:41.886399 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-dab51ee6-5f8e-4cc5-9ef5-0e261e814644 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:42.095499 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-7b77645a-ddc7-4934-9e86-46e2685b772d tempest-VolumesTransfersTest-1537072613 None] Lock "b'cinder-3d871726-60a0-4c3b-9a6a-1459325e59b1-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:42.120194 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-01021913-4ea3-4123-9b63-3965f849df3a tempest-VolumesCloneTest-2133259796 None] Created reservations ['14d310ee-3236-4c91-8ee8-e4b519433ac6', 'bc2076a5-0a73-4947-a17d-801c973967f5', 'bcc4b9e6-7f3a-4ecd-a990-51450d9d805b', '7c2d9422-c0bd-4d9d-be2f-26c8b81c09a4'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:42.132276 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-7b77645a-ddc7-4934-9e86-46e2685b772d tempest-VolumesTransfersTest-1537072613 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:42.170277 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-7b77645a-ddc7-4934-9e86-46e2685b772d tempest-VolumesTransfersTest-1537072613 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:42.170706 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-7b77645a-ddc7-4934-9e86-46e2685b772d tempest-VolumesTransfersTest-1537072613 None] Volume volume-3d871726-60a0-4c3b-9a6a-1459325e59b1 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:42.174955 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-7b77645a-ddc7-4934-9e86-46e2685b772d tempest-VolumesTransfersTest-1537072613 None] deleting rbd volume volume-3d871726-60a0-4c3b-9a6a-1459325e59b1 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:42.216821 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-01021913-4ea3-4123-9b63-3965f849df3a tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:42.239585 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-01021913-4ea3-4123-9b63-3965f849df3a tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:42.265375 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-01021913-4ea3-4123-9b63-3965f849df3a tempest-VolumesCloneTest-2133259796 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:42.271573 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-01021913-4ea3-4123-9b63-3965f849df3a tempest-VolumesCloneTest-2133259796 None] Deleted volume successfully. Mar 05 21:18:42.283771 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-01021913-4ea3-4123-9b63-3965f849df3a tempest-VolumesCloneTest-2133259796 None] Lock "b'cinder-99302f01-fba2-4290-9f0c-fb8c09be906b-delete_volume'" released by "delete_volume" :: held 0.561s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:42.386440 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-7b77645a-ddc7-4934-9e86-46e2685b772d tempest-VolumesTransfersTest-1537072613 None] Created reservations ['08e40d71-32ff-4e60-baf9-ab19c3e85ba0', '766e1715-6411-44b4-ac29-e34a1576f7bd', '9a92984f-a6f9-4930-9663-384939e6cb43', '48e5ddfe-884f-48b1-810b-00e51301cab3'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:42.442023 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-7b77645a-ddc7-4934-9e86-46e2685b772d tempest-VolumesTransfersTest-1537072613 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:42.464509 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-7b77645a-ddc7-4934-9e86-46e2685b772d tempest-VolumesTransfersTest-1537072613 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:42.488089 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-7b77645a-ddc7-4934-9e86-46e2685b772d tempest-VolumesTransfersTest-1537072613 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:42.492154 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-7b77645a-ddc7-4934-9e86-46e2685b772d tempest-VolumesTransfersTest-1537072613 None] Deleted volume successfully. Mar 05 21:18:42.503909 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-7b77645a-ddc7-4934-9e86-46e2685b772d tempest-VolumesTransfersTest-1537072613 None] Lock "b'cinder-3d871726-60a0-4c3b-9a6a-1459325e59b1-delete_volume'" released by "delete_volume" :: held 0.408s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:42.838331 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-06c20a40-d4b3-41f5-ac1e-92476d6b8fda tempest-VolumesCloneTest-2133259796 None] Lock "b'cinder-6f054d27-e287-42ce-af9a-a88b2119efdd-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:42.868086 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-06c20a40-d4b3-41f5-ac1e-92476d6b8fda tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:42.948348 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-06c20a40-d4b3-41f5-ac1e-92476d6b8fda tempest-VolumesCloneTest-2133259796 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:42.955452 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-06c20a40-d4b3-41f5-ac1e-92476d6b8fda tempest-VolumesCloneTest-2133259796 None] deleting rbd volume volume-6f054d27-e287-42ce-af9a-a88b2119efdd {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:43.127799 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-06c20a40-d4b3-41f5-ac1e-92476d6b8fda tempest-VolumesCloneTest-2133259796 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 21:18:43.177644 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-06c20a40-d4b3-41f5-ac1e-92476d6b8fda tempest-VolumesCloneTest-2133259796 None] deleting parent snapshot volume-6f054d27-e287-42ce-af9a-a88b2119efdd.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 21:18:43.492089 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-06c20a40-d4b3-41f5-ac1e-92476d6b8fda tempest-VolumesCloneTest-2133259796 None] Created reservations ['a3f2bb54-c2b9-4525-a6de-d962216ef552', 'c4eb72d2-510e-4112-96e4-1c79720ce3e2', '02e08996-1289-4ad8-b3bc-67e819d788a2', '419fee7a-7fbf-407e-899d-32bcb89b1728'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:43.540737 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-06c20a40-d4b3-41f5-ac1e-92476d6b8fda tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:43.569867 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-06c20a40-d4b3-41f5-ac1e-92476d6b8fda tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:43.598349 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-06c20a40-d4b3-41f5-ac1e-92476d6b8fda tempest-VolumesCloneTest-2133259796 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:43.602971 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-06c20a40-d4b3-41f5-ac1e-92476d6b8fda tempest-VolumesCloneTest-2133259796 None] Deleted volume successfully. Mar 05 21:18:43.620056 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-06c20a40-d4b3-41f5-ac1e-92476d6b8fda tempest-VolumesCloneTest-2133259796 None] Lock "b'cinder-6f054d27-e287-42ce-af9a-a88b2119efdd-delete_volume'" released by "delete_volume" :: held 0.781s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:43.984946 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-069e6d38-6a7d-4785-af5c-2a80bc2b0b82 tempest-VolumesCloneTest-2133259796 None] Lock "b'cinder-2556f950-e231-41cb-9e2c-cc953f1e4c92-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:44.018141 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-069e6d38-6a7d-4785-af5c-2a80bc2b0b82 tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:44.087457 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-069e6d38-6a7d-4785-af5c-2a80bc2b0b82 tempest-VolumesCloneTest-2133259796 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:44.096087 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-069e6d38-6a7d-4785-af5c-2a80bc2b0b82 tempest-VolumesCloneTest-2133259796 None] deleting rbd volume volume-2556f950-e231-41cb-9e2c-cc953f1e4c92 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:44.283113 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-069e6d38-6a7d-4785-af5c-2a80bc2b0b82 tempest-VolumesCloneTest-2133259796 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 21:18:44.316057 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-069e6d38-6a7d-4785-af5c-2a80bc2b0b82 tempest-VolumesCloneTest-2133259796 None] deleting parent snapshot volume-2556f950-e231-41cb-9e2c-cc953f1e4c92.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 21:18:44.506223 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-069e6d38-6a7d-4785-af5c-2a80bc2b0b82 tempest-VolumesCloneTest-2133259796 None] Created reservations ['e5c2980e-ae54-42a7-ab87-f455a71b778e', '3c8519ac-5a39-4408-a3c1-5c1537027db9', '81ae64f3-53fa-488f-883b-c7589255292c', '0d1c93e2-a645-48e7-b6e0-f32212025928'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:44.553166 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-069e6d38-6a7d-4785-af5c-2a80bc2b0b82 tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:44.581849 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-069e6d38-6a7d-4785-af5c-2a80bc2b0b82 tempest-VolumesCloneTest-2133259796 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:44.607149 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-069e6d38-6a7d-4785-af5c-2a80bc2b0b82 tempest-VolumesCloneTest-2133259796 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:44.611260 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-069e6d38-6a7d-4785-af5c-2a80bc2b0b82 tempest-VolumesCloneTest-2133259796 None] Deleted volume successfully. Mar 05 21:18:44.623150 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-069e6d38-6a7d-4785-af5c-2a80bc2b0b82 tempest-VolumesCloneTest-2133259796 None] Lock "b'cinder-2556f950-e231-41cb-9e2c-cc953f1e4c92-delete_volume'" released by "delete_volume" :: held 0.638s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:45.612261 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:18:45.615367 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:45.656533 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:45.705633 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:47.476472 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:47.480020 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:47.480531 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:47.500868 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Flow 'volume_create_manager' (e4439abd-176d-4498-aa5e-71b750e9fb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:47.508710 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c208d5-fd58-457a-a352-18dc598be868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:47.518663 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:47.534094 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c208d5-fd58-457a-a352-18dc598be868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1508767204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7a9f9fa9-7c0c-40e4-b769-54c44b857892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e97687dd6f409184dd2957fc3b56a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:47Z,use_quota=True,user_id='6c353cbf98c74e078610629c0f489a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:47.540243 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6268b60f-5a4e-48b6-9827-269644db93d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:47.544405 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6268b60f-5a4e-48b6-9827-269644db93d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:47.550004 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54282a1b-5f78-4f0e-82c1-443a662e2a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:47.555292 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54282a1b-5f78-4f0e-82c1-443a662e2a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a9f9fa9-7c0c-40e4-b769-54c44b857892', 'volume_name': 'volume-7a9f9fa9-7c0c-40e4-b769-54c44b857892', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:47.560871 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6eec07-6554-4223-884d-14bcbd6de2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:47.566145 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6eec07-6554-4223-884d-14bcbd6de2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:47.570262 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed38dfe-8501-4c8b-9d9a-9366b5b311c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:47.571369 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Volume 7a9f9fa9-7c0c-40e4-b769-54c44b857892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a9f9fa9-7c0c-40e4-b769-54c44b857892', 'volume_size': 1} Mar 05 21:18:47.571844 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] creating volume 'volume-7a9f9fa9-7c0c-40e4-b769-54c44b857892' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:18:47.572983 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:47.647196 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:47.647789 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:47.652781 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed38dfe-8501-4c8b-9d9a-9366b5b311c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9f9fa9-7c0c-40e4-b769-54c44b857892', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:47.658067 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd15937e-1d6d-4d50-bc05-ef6910ce0209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:47.667721 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Volume volume-7a9f9fa9-7c0c-40e4-b769-54c44b857892 (7a9f9fa9-7c0c-40e4-b769-54c44b857892): created successfully Mar 05 21:18:47.671400 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd15937e-1d6d-4d50-bc05-ef6910ce0209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:47.677853 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Flow 'volume_create_manager' (e4439abd-176d-4498-aa5e-71b750e9fb40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:47.685431 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-e877618a-f9ec-4826-bda6-f18628e29f38 tempest-VolumesTransfersV355Test-599213031 None] Created volume successfully. Mar 05 21:18:49.080166 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-23fe3753-243b-4f29-b632-0bc2f76a1378 tempest-VolumesTransfersV355Test-798879902 None] Transfer volume completed successfully. Mar 05 21:18:49.168105 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:49.171567 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:49.172133 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:49.190898 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Flow 'volume_create_manager' (919ce543-5df9-49de-9824-249d760cbd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:49.198615 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa83b63d-03eb-4720-ac36-6c03c5cae221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:49.206166 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:49.221941 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa83b63d-03eb-4720-ac36-6c03c5cae221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1905864516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=829930e1-4596-486f-8519-b0199e9b8691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daaaf64c5b754e5d8ccb4c6742e8bf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:49Z,use_quota=True,user_id='f4b28f2995ab47dcbfc32452278bb405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:49.228471 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ca3fea-3ea4-4942-88b7-165c8db05c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:49.233157 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ca3fea-3ea4-4942-88b7-165c8db05c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:49.238575 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3838c505-0e65-45a1-9857-01d8f3bf69f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:49.243008 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3838c505-0e65-45a1-9857-01d8f3bf69f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '829930e1-4596-486f-8519-b0199e9b8691', 'volume_name': 'volume-829930e1-4596-486f-8519-b0199e9b8691', 'volume_size': 2}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:49.248213 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c07952-d6cc-4e6f-b479-27607912a2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:49.252657 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c07952-d6cc-4e6f-b479-27607912a2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:49.258420 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c596eb-ef20-4ad4-99a7-343356dbdef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:49.259825 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Volume 829930e1-4596-486f-8519-b0199e9b8691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-829930e1-4596-486f-8519-b0199e9b8691', 'volume_size': 2} Mar 05 21:18:49.260223 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] creating volume 'volume-829930e1-4596-486f-8519-b0199e9b8691' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:18:49.261477 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:49.340115 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:49.340502 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:49.344705 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c596eb-ef20-4ad4-99a7-343356dbdef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-829930e1-4596-486f-8519-b0199e9b8691', 'volume_size': 2}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:49.350413 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e00aa47-a046-4ac1-9ea9-8fe115b644ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:49.359711 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Volume volume-829930e1-4596-486f-8519-b0199e9b8691 (829930e1-4596-486f-8519-b0199e9b8691): created successfully Mar 05 21:18:49.364575 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e00aa47-a046-4ac1-9ea9-8fe115b644ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:49.371201 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Flow 'volume_create_manager' (919ce543-5df9-49de-9824-249d760cbd5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:49.381081 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-f5dfb6c7-50a7-4c0b-8ae6-08a9e650701e tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Created volume successfully. Mar 05 21:18:49.562650 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-a7ba7fdd-fe22-445c-b279-4d9b44a8c7d3 tempest-VolumesTransfersV355Test-717151623 None] Lock "b'cinder-7a9f9fa9-7c0c-40e4-b769-54c44b857892-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:49.617166 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a7ba7fdd-fe22-445c-b279-4d9b44a8c7d3 tempest-VolumesTransfersV355Test-717151623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:49.658277 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a7ba7fdd-fe22-445c-b279-4d9b44a8c7d3 tempest-VolumesTransfersV355Test-717151623 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:49.658718 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a7ba7fdd-fe22-445c-b279-4d9b44a8c7d3 tempest-VolumesTransfersV355Test-717151623 None] Volume volume-7a9f9fa9-7c0c-40e4-b769-54c44b857892 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:49.666285 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a7ba7fdd-fe22-445c-b279-4d9b44a8c7d3 tempest-VolumesTransfersV355Test-717151623 None] deleting rbd volume volume-7a9f9fa9-7c0c-40e4-b769-54c44b857892 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:49.936463 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-a7ba7fdd-fe22-445c-b279-4d9b44a8c7d3 tempest-VolumesTransfersV355Test-717151623 None] Created reservations ['5a0254de-df2e-45b5-aeff-38c3b8d76163', '1037bb2e-f484-41a8-b0e2-34dca01905db', '07d3f2a2-5916-4852-a176-1652e231c427', '130e1ef7-f6bb-40e4-9007-d5557c31d3f7'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:49.982557 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a7ba7fdd-fe22-445c-b279-4d9b44a8c7d3 tempest-VolumesTransfersV355Test-717151623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:50.008366 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a7ba7fdd-fe22-445c-b279-4d9b44a8c7d3 tempest-VolumesTransfersV355Test-717151623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:50.034002 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-a7ba7fdd-fe22-445c-b279-4d9b44a8c7d3 tempest-VolumesTransfersV355Test-717151623 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:50.038461 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-a7ba7fdd-fe22-445c-b279-4d9b44a8c7d3 tempest-VolumesTransfersV355Test-717151623 None] Deleted volume successfully. Mar 05 21:18:50.049746 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-a7ba7fdd-fe22-445c-b279-4d9b44a8c7d3 tempest-VolumesTransfersV355Test-717151623 None] Lock "b'cinder-7a9f9fa9-7c0c-40e4-b769-54c44b857892-delete_volume'" released by "delete_volume" :: held 0.487s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:50.358501 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-18693a08-7257-4843-a716-11c9f503c8f9 tempest-VolumesSnapshotNegativeTestJSON-915393360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:50.949446 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:18:50.952908 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:18:50.953361 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:18:50.974376 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Flow 'volume_create_manager' (b9090b1a-0280-49f5-9f52-67b03db284ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:50.981506 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e10c46-e632-4bf8-80b6-922f1d8fc0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:50.988749 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:18:51.004571 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e10c46-e632-4bf8-80b6-922f1d8fc0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1157916955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=58326a46-40bb-4737-93c1-57d7d89fb211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e97687dd6f409184dd2957fc3b56a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:18:51Z,use_quota=True,user_id='6c353cbf98c74e078610629c0f489a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:51.010370 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60f592f-15ab-49c1-89fc-064fbe383543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:51.014556 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60f592f-15ab-49c1-89fc-064fbe383543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:51.020485 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c52530d-71be-48a2-8fe0-7c90f57dc805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:51.024724 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c52530d-71be-48a2-8fe0-7c90f57dc805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58326a46-40bb-4737-93c1-57d7d89fb211', 'volume_name': 'volume-58326a46-40bb-4737-93c1-57d7d89fb211', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:51.029815 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea3f990-e89c-45ce-85ee-510a4e81a800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:51.033873 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea3f990-e89c-45ce-85ee-510a4e81a800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:51.039407 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01bf26be-2823-4180-a515-f668aaaa4498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:51.040682 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Volume 58326a46-40bb-4737-93c1-57d7d89fb211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58326a46-40bb-4737-93c1-57d7d89fb211', 'volume_size': 1} Mar 05 21:18:51.040964 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] creating volume 'volume-58326a46-40bb-4737-93c1-57d7d89fb211' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:18:51.041968 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:51.105613 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:18:51.105993 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:18:51.109805 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01bf26be-2823-4180-a515-f668aaaa4498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58326a46-40bb-4737-93c1-57d7d89fb211', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:51.115559 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b981e385-c5f4-4712-9b63-b98438b18889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:18:51.123781 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Volume volume-58326a46-40bb-4737-93c1-57d7d89fb211 (58326a46-40bb-4737-93c1-57d7d89fb211): created successfully Mar 05 21:18:51.127336 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b981e385-c5f4-4712-9b63-b98438b18889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:18:51.134467 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Flow 'volume_create_manager' (b9090b1a-0280-49f5-9f52-67b03db284ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:18:51.141728 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-3adae84c-1dc1-412b-b71b-9e7f27ee367d tempest-VolumesTransfersV355Test-599213031 None] Created volume successfully. Mar 05 21:18:51.463887 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-18693a08-7257-4843-a716-11c9f503c8f9 tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Create snapshot completed successfully Mar 05 21:18:52.256779 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-d96bd07b-a389-454c-aea5-9ea2e5f65d3e tempest-VolumesTransfersV355Test-717151623 None] Lock "b'cinder-58326a46-40bb-4737-93c1-57d7d89fb211-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:52.283024 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d96bd07b-a389-454c-aea5-9ea2e5f65d3e tempest-VolumesTransfersV355Test-717151623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:52.320104 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d96bd07b-a389-454c-aea5-9ea2e5f65d3e tempest-VolumesTransfersV355Test-717151623 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:52.320541 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d96bd07b-a389-454c-aea5-9ea2e5f65d3e tempest-VolumesTransfersV355Test-717151623 None] Volume volume-58326a46-40bb-4737-93c1-57d7d89fb211 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:52.326006 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d96bd07b-a389-454c-aea5-9ea2e5f65d3e tempest-VolumesTransfersV355Test-717151623 None] deleting rbd volume volume-58326a46-40bb-4737-93c1-57d7d89fb211 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:52.528822 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-3e651ae4-0bf4-41b3-b01a-0b6f0d3e9309 tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Lock "b'cinder-2fa64e76-4aaf-4f4c-bc6f-a9d5c3ca9fa4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:52.530324 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-3e651ae4-0bf4-41b3-b01a-0b6f0d3e9309 tempest-VolumesSnapshotNegativeTestJSON-915393360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:52.627547 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-d96bd07b-a389-454c-aea5-9ea2e5f65d3e tempest-VolumesTransfersV355Test-717151623 None] Created reservations ['66c3a13f-d05e-4eb8-8336-c6c5e3620739', '323f4bb3-bb02-438c-bd76-584b44c41a2d', '8827fb96-e72c-4379-841a-22cad115e967', 'da788866-af59-4838-8637-d33cae30c959'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:52.668356 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d96bd07b-a389-454c-aea5-9ea2e5f65d3e tempest-VolumesTransfersV355Test-717151623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:52.690098 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-d96bd07b-a389-454c-aea5-9ea2e5f65d3e tempest-VolumesTransfersV355Test-717151623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:52.712890 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-d96bd07b-a389-454c-aea5-9ea2e5f65d3e tempest-VolumesTransfersV355Test-717151623 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:52.716976 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-d96bd07b-a389-454c-aea5-9ea2e5f65d3e tempest-VolumesTransfersV355Test-717151623 None] Deleted volume successfully. Mar 05 21:18:52.728562 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-d96bd07b-a389-454c-aea5-9ea2e5f65d3e tempest-VolumesTransfersV355Test-717151623 None] Lock "b'cinder-58326a46-40bb-4737-93c1-57d7d89fb211-delete_volume'" released by "delete_volume" :: held 0.472s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:53.482401 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-3e651ae4-0bf4-41b3-b01a-0b6f0d3e9309 tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Created reservations ['e0da94b7-9220-44e0-8b46-f82f84a4e618', 'e46b664f-e23e-42a8-9f5d-6dc5020af914', '05d59fed-c782-40f6-ba4f-c045b2c6b739', '8d1cc491-56e3-4bbe-acf8-3a42745cb6e1'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:53.533629 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-3e651ae4-0bf4-41b3-b01a-0b6f0d3e9309 tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Delete snapshot completed successfully. Mar 05 21:18:53.540343 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-3e651ae4-0bf4-41b3-b01a-0b6f0d3e9309 tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Lock "b'cinder-2fa64e76-4aaf-4f4c-bc6f-a9d5c3ca9fa4-delete_snapshot'" released by "delete_snapshot" :: held 1.011s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:18:53.649531 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-a493a065-ded8-45de-b405-48b83de4fadf tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Lock "b'cinder-829930e1-4596-486f-8519-b0199e9b8691-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:18:53.685600 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a493a065-ded8-45de-b405-48b83de4fadf tempest-VolumesSnapshotNegativeTestJSON-915393360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:53.727812 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a493a065-ded8-45de-b405-48b83de4fadf tempest-VolumesSnapshotNegativeTestJSON-915393360 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:18:53.728236 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a493a065-ded8-45de-b405-48b83de4fadf tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Volume volume-829930e1-4596-486f-8519-b0199e9b8691 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:18:53.737851 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a493a065-ded8-45de-b405-48b83de4fadf tempest-VolumesSnapshotNegativeTestJSON-915393360 None] deleting rbd volume volume-829930e1-4596-486f-8519-b0199e9b8691 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:18:53.975854 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-a493a065-ded8-45de-b405-48b83de4fadf tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Created reservations ['8c7ec41f-4c64-4dd1-80ae-766dd3747d63', 'fa26af75-5223-467e-b265-480c79c68758', '029c6eda-a419-4523-88f2-ee615bacbccd', 'b3d3e23b-3b70-47b5-9baa-019c244057ab'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:18:54.017686 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a493a065-ded8-45de-b405-48b83de4fadf tempest-VolumesSnapshotNegativeTestJSON-915393360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:54.043123 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a493a065-ded8-45de-b405-48b83de4fadf tempest-VolumesSnapshotNegativeTestJSON-915393360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:18:54.082652 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-a493a065-ded8-45de-b405-48b83de4fadf tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:18:54.088271 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-a493a065-ded8-45de-b405-48b83de4fadf tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Deleted volume successfully. Mar 05 21:18:54.104792 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-a493a065-ded8-45de-b405-48b83de4fadf tempest-VolumesSnapshotNegativeTestJSON-915393360 None] Lock "b'cinder-829930e1-4596-486f-8519-b0199e9b8691-delete_volume'" released by "delete_volume" :: held 0.457s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:19:08.072672 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-44817f74-0731-4d74-b99a-445d73954ee4 req-2dcc6a55-5d2c-40d4-8d75-54f9dcbf9f8b tempest-TestVolumeBootPattern-160921740 None] Terminate volume connection completed successfully. Mar 05 21:19:08.073234 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-44817f74-0731-4d74-b99a-445d73954ee4 req-2dcc6a55-5d2c-40d4-8d75-54f9dcbf9f8b tempest-TestVolumeBootPattern-160921740 None] Deleting attachment 26e3120a-64a7-4f78-83fa-1ef1f81359a4. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:19:12.134939 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-dab51ee6-5f8e-4cc5-9ef5-0e261e814644 tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['1773fca9-b437-4a4c-a610-9b08dbcb940e', '9ff5f887-2559-46e9-81df-ab4fc57f370e', '703e8b6b-0a7c-49e1-a871-ec7863a08079', '0daba00f-cd9f-4e3a-8e63-38f3b71952b2'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:19:12.214734 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-dab51ee6-5f8e-4cc5-9ef5-0e261e814644 tempest-VolumesSnapshotTestJSON-163973597 None] Delete snapshot completed successfully. Mar 05 21:19:12.221338 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-dab51ee6-5f8e-4cc5-9ef5-0e261e814644 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-372a2a67-c284-403c-aac9-106724e72379-delete_snapshot'" released by "delete_snapshot" :: held 30.336s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:19:12.370569 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 req-8744fd97-4658-446b-b13f-7cd37f959fd7 tempest-TestVolumeBootPattern-160921740 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:19:13.217099 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 req-8744fd97-4658-446b-b13f-7cd37f959fd7 tempest-TestVolumeBootPattern-160921740 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.846s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:19:13.219885 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 req-8744fd97-4658-446b-b13f-7cd37f959fd7 tempest-TestVolumeBootPattern-160921740 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d12389cd-038b-48ad-9624-b01e46ae00b5', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'd12389cd-038b-48ad-9624-b01e46ae00b5', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:19:13.304568 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 req-8744fd97-4658-446b-b13f-7cd37f959fd7 tempest-TestVolumeBootPattern-160921740 None] Connection info returned from driver {'name': 'volumes/volume-d12389cd-038b-48ad-9624-b01e46ae00b5', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd12389cd-038b-48ad-9624-b01e46ae00b5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '289b1789-ecc4-48a9-8c8c-cbee022a7479'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:19:13.319235 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-fe0390c8-62c7-4ccc-bcb2-c116f8fb21df tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-54a3d11c-6dd3-48dc-b6aa-7e5c5aff8ebb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.036s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:19:13.321196 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-fe0390c8-62c7-4ccc-bcb2-c116f8fb21df tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:19:13.459773 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 req-8744fd97-4658-446b-b13f-7cd37f959fd7 tempest-TestVolumeBootPattern-160921740 None] attachment_update completed successfully. Mar 05 21:19:43.511096 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-fe0390c8-62c7-4ccc-bcb2-c116f8fb21df tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['d779310e-e302-4aaf-85c2-61f6ee10b1b1', '2b7e4830-a3c0-4d2b-bba4-94a642ec6786', '614374f2-687f-4444-95d9-bfa54c4586bd', '75fb730e-c097-4c3f-8336-81f512c49176'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:19:43.543896 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-fe0390c8-62c7-4ccc-bcb2-c116f8fb21df tempest-VolumesSnapshotTestJSON-163973597 None] Delete snapshot completed successfully. Mar 05 21:19:43.548771 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-fe0390c8-62c7-4ccc-bcb2-c116f8fb21df tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-54a3d11c-6dd3-48dc-b6aa-7e5c5aff8ebb-delete_snapshot'" released by "delete_snapshot" :: held 30.230s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:19:44.412401 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-0bee6224-b39f-4b40-990f-d1475e7ec970 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-af1587a0-9c6c-402a-896c-0c32bc5abca4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:19:44.414565 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0bee6224-b39f-4b40-990f-d1475e7ec970 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:19:45.610822 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:19:45.611629 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:19:45.636006 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:19:45.663934 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:20:14.567739 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-0bee6224-b39f-4b40-990f-d1475e7ec970 tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['7c8fcc58-84da-42ed-ae59-a7c6415b84ab', '85c24bce-876e-456b-80e0-8bb8b4a18a72', 'd1f6a901-1154-4873-84ce-367430685110', '57a77631-50eb-446c-a210-4dd9891a95b2'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:20:14.601478 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-0bee6224-b39f-4b40-990f-d1475e7ec970 tempest-VolumesSnapshotTestJSON-163973597 None] Delete snapshot completed successfully. Mar 05 21:20:14.606109 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-0bee6224-b39f-4b40-990f-d1475e7ec970 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-af1587a0-9c6c-402a-896c-0c32bc5abca4-delete_snapshot'" released by "delete_snapshot" :: held 30.194s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:20:16.135809 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-6e37cfe4-85dc-4b24-b526-1f324bcea557 req-ac576d70-b2a4-4ca4-ae9c-d727e8848e94 tempest-VolumesSnapshotTestJSON-163973597 None] Terminate volume connection completed successfully. Mar 05 21:20:16.136468 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-6e37cfe4-85dc-4b24-b526-1f324bcea557 req-ac576d70-b2a4-4ca4-ae9c-d727e8848e94 tempest-VolumesSnapshotTestJSON-163973597 None] Deleting attachment 0e108306-bbe4-4baf-8dcc-554d80bf90e6. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:20:20.567833 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:20:20.571983 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:20:20.572489 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:20:20.592551 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Flow 'volume_create_manager' (3fca84dd-55e7-4a60-8c61-9f03ce404edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:20:20.599372 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19ac114-c8ba-4df4-aa56-bce5df5518ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:20.606378 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:20:20.620809 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19ac114-c8ba-4df4-aa56-bce5df5518ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-608119623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bc40611c-e00f-4523-8b02-61d529334b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46aa322abe044eb7baa1f99f151b28cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:20:21Z,use_quota=True,user_id='2b581b22102f425daee098c1318c506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:20.627096 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359dbb60-c039-4363-93b8-99f55ff66b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:20.631417 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359dbb60-c039-4363-93b8-99f55ff66b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:20.636963 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5bab098-f387-4def-9ef2-6f1c13b5d6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:20.641834 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5bab098-f387-4def-9ef2-6f1c13b5d6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc40611c-e00f-4523-8b02-61d529334b03', 'volume_name': 'volume-bc40611c-e00f-4523-8b02-61d529334b03', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:20.646840 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eee823e-6e71-4224-a3cf-6652eec4b35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:20.650925 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eee823e-6e71-4224-a3cf-6652eec4b35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:20.655783 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32bd532c-c8fb-405a-ba6d-d831e908caf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:20.656885 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Volume bc40611c-e00f-4523-8b02-61d529334b03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc40611c-e00f-4523-8b02-61d529334b03', 'volume_size': 1} Mar 05 21:20:20.657300 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] creating volume 'volume-bc40611c-e00f-4523-8b02-61d529334b03' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:20:20.658285 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:20.711503 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:20:20.711939 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:20:20.715792 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32bd532c-c8fb-405a-ba6d-d831e908caf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc40611c-e00f-4523-8b02-61d529334b03', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:20.720646 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59fe1d51-fe4d-4d28-85d5-62bd6723f019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:20.730187 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Volume volume-bc40611c-e00f-4523-8b02-61d529334b03 (bc40611c-e00f-4523-8b02-61d529334b03): created successfully Mar 05 21:20:20.734146 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59fe1d51-fe4d-4d28-85d5-62bd6723f019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:20.739798 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Flow 'volume_create_manager' (3fca84dd-55e7-4a60-8c61-9f03ce404edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:20:20.746963 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-0fc5e539-8913-442e-bbf5-5aa94cb38ff5 tempest-VolumesSnapshotTestJSON-163973597 None] Created volume successfully. Mar 05 21:20:21.751713 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-54062d89-ead9-4026-871f-347ae3450966 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:22.208286 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-54062d89-ead9-4026-871f-347ae3450966 tempest-VolumesSnapshotTestJSON-163973597 None] Create snapshot completed successfully Mar 05 21:20:23.222441 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:20:23.229092 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:20:23.229793 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:20:23.274775 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Flow 'volume_create_manager' (38b5e21d-b55f-40ff-9708-90d2dcb37301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:20:23.285527 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171264d6-3f99-4cc3-bd98-9514ff7af5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:23.294315 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:20:23.312951 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171264d6-3f99-4cc3-bd98-9514ff7af5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-370897696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=67d7947d-522f-4787-b520-e8a6266d86df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46aa322abe044eb7baa1f99f151b28cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:20:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e9f7d155-155a-4b53-bf0c-7679be63aeb5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:20:23Z,use_quota=True,user_id='2b581b22102f425daee098c1318c506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:23.320561 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4119ae38-74b4-45ac-8a30-ac3433b4272a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:23.325905 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4119ae38-74b4-45ac-8a30-ac3433b4272a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:23.332989 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (accf299f-427c-4ec2-a77a-884bdb1d4f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:23.338927 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (accf299f-427c-4ec2-a77a-884bdb1d4f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '67d7947d-522f-4787-b520-e8a6266d86df', 'volume_name': 'volume-67d7947d-522f-4787-b520-e8a6266d86df', 'volume_size': 2, 'snapshot_id': 'e9f7d155-155a-4b53-bf0c-7679be63aeb5'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:23.347787 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836d37d7-e966-4e45-b699-727d8b696447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:23.352438 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836d37d7-e966-4e45-b699-727d8b696447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:23.357931 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd1ea62-ed02-4e24-ba86-3b0b6538608c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:23.360550 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Volume 67d7947d-522f-4787-b520-e8a6266d86df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-67d7947d-522f-4787-b520-e8a6266d86df', 'volume_size': 2, 'snapshot_id': 'e9f7d155-155a-4b53-bf0c-7679be63aeb5'} Mar 05 21:20:23.383757 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] cloning volumes/volume-bc40611c-e00f-4523-8b02-61d529334b03@snapshot-e9f7d155-155a-4b53-bf0c-7679be63aeb5 to volume-67d7947d-522f-4787-b520-e8a6266d86df {{(pid=134747) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Mar 05 21:20:23.385634 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:23.446567 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:23.625561 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:20:23.625939 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:20:23.631129 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:23.763791 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd1ea62-ed02-4e24-ba86-3b0b6538608c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67d7947d-522f-4787-b520-e8a6266d86df', 'volume_size': 2, 'snapshot_id': 'e9f7d155-155a-4b53-bf0c-7679be63aeb5'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:23.771173 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb866e4-a8fb-45d1-922c-cd7056900186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:23.781711 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Volume volume-67d7947d-522f-4787-b520-e8a6266d86df (67d7947d-522f-4787-b520-e8a6266d86df): created successfully Mar 05 21:20:23.785744 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb866e4-a8fb-45d1-922c-cd7056900186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:23.791392 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Flow 'volume_create_manager' (38b5e21d-b55f-40ff-9708-90d2dcb37301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:20:23.812056 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-94003d36-e8cd-4ef3-a309-de66137ff899 tempest-VolumesSnapshotTestJSON-163973597 None] Created volume successfully. Mar 05 21:20:24.304722 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-553d7435-f0f4-4e71-bfdf-681a5a8d4a62 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-67d7947d-522f-4787-b520-e8a6266d86df-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:20:24.339886 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-553d7435-f0f4-4e71-bfdf-681a5a8d4a62 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:24.434998 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-553d7435-f0f4-4e71-bfdf-681a5a8d4a62 tempest-VolumesSnapshotTestJSON-163973597 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:20:24.443025 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-553d7435-f0f4-4e71-bfdf-681a5a8d4a62 tempest-VolumesSnapshotTestJSON-163973597 None] deleting rbd volume volume-67d7947d-522f-4787-b520-e8a6266d86df {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:20:24.732270 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-553d7435-f0f4-4e71-bfdf-681a5a8d4a62 tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['a2b5136e-ddac-4b4b-bdaf-10abef63d4c9', '6d8eef6e-d141-4500-9b8f-fc13aedfee8f', '89af84ae-279d-450b-9dd2-523b7da7f94f', '245b6201-0422-4fbf-8d92-4502a89f39ae'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:20:24.806707 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-553d7435-f0f4-4e71-bfdf-681a5a8d4a62 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:24.852534 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-553d7435-f0f4-4e71-bfdf-681a5a8d4a62 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:24.903119 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-553d7435-f0f4-4e71-bfdf-681a5a8d4a62 tempest-VolumesSnapshotTestJSON-163973597 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:20:24.912842 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-553d7435-f0f4-4e71-bfdf-681a5a8d4a62 tempest-VolumesSnapshotTestJSON-163973597 None] Deleted volume successfully. Mar 05 21:20:24.927992 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-553d7435-f0f4-4e71-bfdf-681a5a8d4a62 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-67d7947d-522f-4787-b520-e8a6266d86df-delete_volume'" released by "delete_volume" :: held 0.623s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:20:25.723655 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:20:25.727340 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:20:25.727839 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:20:25.749105 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Flow 'volume_create_manager' (017139f3-36c0-449b-8b35-4d8c85a4fd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:20:25.757535 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f33961-251b-41e3-a96a-1303ebfd8986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:25.765992 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:20:25.782428 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f33961-251b-41e3-a96a-1303ebfd8986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-684450118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9818b062-2a6b-4d72-9813-5774399c2fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46aa322abe044eb7baa1f99f151b28cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:20:26Z,use_quota=True,user_id='2b581b22102f425daee098c1318c506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:25.788873 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e46bc96-177d-4eaa-9dbb-649eeffb5f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:25.793740 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e46bc96-177d-4eaa-9dbb-649eeffb5f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:25.799357 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0c5194-93b1-427c-86f2-8de70a828c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:25.804325 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0c5194-93b1-427c-86f2-8de70a828c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9818b062-2a6b-4d72-9813-5774399c2fc6', 'volume_name': 'volume-9818b062-2a6b-4d72-9813-5774399c2fc6', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:25.809880 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ebdfce4-7d4d-4837-8624-d9c1116252d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:25.815254 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ebdfce4-7d4d-4837-8624-d9c1116252d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:25.821801 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b95022c-d1bf-44c4-a776-b83ddf161fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:25.822945 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Volume 9818b062-2a6b-4d72-9813-5774399c2fc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9818b062-2a6b-4d72-9813-5774399c2fc6', 'volume_size': 1} Mar 05 21:20:25.823348 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] creating volume 'volume-9818b062-2a6b-4d72-9813-5774399c2fc6' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:20:25.824385 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:25.899736 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:20:25.900122 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:20:25.904100 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b95022c-d1bf-44c4-a776-b83ddf161fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9818b062-2a6b-4d72-9813-5774399c2fc6', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:25.909537 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973740a4-36d2-44a2-aeb2-b1df10cdbc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:25.918664 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Volume volume-9818b062-2a6b-4d72-9813-5774399c2fc6 (9818b062-2a6b-4d72-9813-5774399c2fc6): created successfully Mar 05 21:20:25.923123 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973740a4-36d2-44a2-aeb2-b1df10cdbc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:25.929179 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Flow 'volume_create_manager' (017139f3-36c0-449b-8b35-4d8c85a4fd83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:20:25.937544 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-77e8f0f9-ef64-49af-a320-37b5e0d93129 tempest-VolumesSnapshotTestJSON-163973597 None] Created volume successfully. Mar 05 21:20:26.905503 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c113ae06-6e7b-45f7-a847-96e72d595195 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:27.288132 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c113ae06-6e7b-45f7-a847-96e72d595195 tempest-VolumesSnapshotTestJSON-163973597 None] Create snapshot completed successfully Mar 05 21:20:28.315314 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:20:28.318721 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:20:28.319153 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:20:28.348915 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Flow 'volume_create_manager' (6a1db29f-7a3d-4050-8215-a25332d643df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:20:28.355660 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d93e06c3-a17c-4f9f-ab0b-38f4f34e5e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:28.363098 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:20:28.378308 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d93e06c3-a17c-4f9f-ab0b-38f4f34e5e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-372455321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1405417b-1e2d-43ed-9b18-1f72a7f8bdbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46aa322abe044eb7baa1f99f151b28cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c517e21f-7ab7-4597-afaf-539625ac5429,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:20:28Z,use_quota=True,user_id='2b581b22102f425daee098c1318c506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:28.384137 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8aba704-38f4-453e-be10-4f069746e843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:28.388492 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8aba704-38f4-453e-be10-4f069746e843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:28.394941 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d59a37-7617-4c69-a482-8d2bb934a97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:28.399338 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d59a37-7617-4c69-a482-8d2bb934a97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1405417b-1e2d-43ed-9b18-1f72a7f8bdbe', 'volume_name': 'volume-1405417b-1e2d-43ed-9b18-1f72a7f8bdbe', 'volume_size': 1, 'snapshot_id': 'c517e21f-7ab7-4597-afaf-539625ac5429'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:28.404508 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0eb52e-c10c-4486-b95d-590ff7d37af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:28.409744 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0eb52e-c10c-4486-b95d-590ff7d37af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:28.414628 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cb4a42-4c50-4f92-8002-dd6a7b2cdef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:28.415715 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Volume 1405417b-1e2d-43ed-9b18-1f72a7f8bdbe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1405417b-1e2d-43ed-9b18-1f72a7f8bdbe', 'volume_size': 1, 'snapshot_id': 'c517e21f-7ab7-4597-afaf-539625ac5429'} Mar 05 21:20:28.434524 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] cloning volumes/volume-9818b062-2a6b-4d72-9813-5774399c2fc6@snapshot-c517e21f-7ab7-4597-afaf-539625ac5429 to volume-1405417b-1e2d-43ed-9b18-1f72a7f8bdbe {{(pid=134747) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Mar 05 21:20:28.435441 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:28.476621 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:28.602406 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:20:28.602724 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:20:28.621309 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cb4a42-4c50-4f92-8002-dd6a7b2cdef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1405417b-1e2d-43ed-9b18-1f72a7f8bdbe', 'volume_size': 1, 'snapshot_id': 'c517e21f-7ab7-4597-afaf-539625ac5429'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:28.626637 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36b922c-4146-4a17-bde5-d53be2000a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:20:28.635999 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Volume volume-1405417b-1e2d-43ed-9b18-1f72a7f8bdbe (1405417b-1e2d-43ed-9b18-1f72a7f8bdbe): created successfully Mar 05 21:20:28.639570 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36b922c-4146-4a17-bde5-d53be2000a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:20:28.645209 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Flow 'volume_create_manager' (6a1db29f-7a3d-4050-8215-a25332d643df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:20:28.656615 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-25525c43-9006-4dfa-bc89-d1be16919f92 tempest-VolumesSnapshotTestJSON-163973597 None] Created volume successfully. Mar 05 21:20:29.406945 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-c51adda4-479d-4a6b-9e20-ec94ccc2b94b tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-1405417b-1e2d-43ed-9b18-1f72a7f8bdbe-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:20:29.440711 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c51adda4-479d-4a6b-9e20-ec94ccc2b94b tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:29.490108 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c51adda4-479d-4a6b-9e20-ec94ccc2b94b tempest-VolumesSnapshotTestJSON-163973597 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:20:29.495307 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c51adda4-479d-4a6b-9e20-ec94ccc2b94b tempest-VolumesSnapshotTestJSON-163973597 None] deleting rbd volume volume-1405417b-1e2d-43ed-9b18-1f72a7f8bdbe {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:20:29.707225 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-c51adda4-479d-4a6b-9e20-ec94ccc2b94b tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['6d47fa13-ecbc-4899-ab9e-73594eaf37f8', 'e92c1215-0bff-414e-b1a2-3e2c9e17521d', '42f9c1c4-ab6b-4c6a-840c-775fd317861d', '67cb5492-04f7-4307-9b03-b929281ec1fa'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:20:29.748228 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c51adda4-479d-4a6b-9e20-ec94ccc2b94b tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:29.771065 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-c51adda4-479d-4a6b-9e20-ec94ccc2b94b tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:29.795092 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-c51adda4-479d-4a6b-9e20-ec94ccc2b94b tempest-VolumesSnapshotTestJSON-163973597 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:20:29.799297 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-c51adda4-479d-4a6b-9e20-ec94ccc2b94b tempest-VolumesSnapshotTestJSON-163973597 None] Deleted volume successfully. Mar 05 21:20:29.810869 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-c51adda4-479d-4a6b-9e20-ec94ccc2b94b tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-1405417b-1e2d-43ed-9b18-1f72a7f8bdbe-delete_volume'" released by "delete_volume" :: held 0.404s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:20:30.552228 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-57cd0184-fd18-493d-b820-01d711a60076 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-c517e21f-7ab7-4597-afaf-539625ac5429-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:20:30.553734 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-57cd0184-fd18-493d-b820-01d711a60076 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:31.289111 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-57cd0184-fd18-493d-b820-01d711a60076 tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['b7b22767-0153-415a-aecc-7760679cb2ec', '49152b97-afdf-4c44-ac0f-53a8b03bf252', '14abd202-935f-493e-bdaa-84017accd4c2', '7439ea0d-969b-4707-8989-901bb16fdc93'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:20:31.321829 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-57cd0184-fd18-493d-b820-01d711a60076 tempest-VolumesSnapshotTestJSON-163973597 None] Delete snapshot completed successfully. Mar 05 21:20:31.326251 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-57cd0184-fd18-493d-b820-01d711a60076 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-c517e21f-7ab7-4597-afaf-539625ac5429-delete_snapshot'" released by "delete_snapshot" :: held 0.774s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:20:31.654536 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-5c7459a0-092c-4d2a-bbdc-d9a736dc2428 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-9818b062-2a6b-4d72-9813-5774399c2fc6-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:20:31.686186 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5c7459a0-092c-4d2a-bbdc-d9a736dc2428 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:31.723175 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5c7459a0-092c-4d2a-bbdc-d9a736dc2428 tempest-VolumesSnapshotTestJSON-163973597 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:20:31.723626 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5c7459a0-092c-4d2a-bbdc-d9a736dc2428 tempest-VolumesSnapshotTestJSON-163973597 None] Volume volume-9818b062-2a6b-4d72-9813-5774399c2fc6 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:20:31.728700 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5c7459a0-092c-4d2a-bbdc-d9a736dc2428 tempest-VolumesSnapshotTestJSON-163973597 None] deleting rbd volume volume-9818b062-2a6b-4d72-9813-5774399c2fc6 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:20:31.936323 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-5c7459a0-092c-4d2a-bbdc-d9a736dc2428 tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['85beda5c-b611-4522-9d64-d974b4b8d11c', '6d1d3571-b350-4bb2-86e8-b3c476ceeca5', 'c119608c-ba8b-450d-93ba-ced2b5cb1e21', 'd7c9a8c8-6200-4a04-999a-f7d372a5ae15'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:20:31.978872 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5c7459a0-092c-4d2a-bbdc-d9a736dc2428 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:32.001415 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5c7459a0-092c-4d2a-bbdc-d9a736dc2428 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:32.025090 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-5c7459a0-092c-4d2a-bbdc-d9a736dc2428 tempest-VolumesSnapshotTestJSON-163973597 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:20:32.029084 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-5c7459a0-092c-4d2a-bbdc-d9a736dc2428 tempest-VolumesSnapshotTestJSON-163973597 None] Deleted volume successfully. Mar 05 21:20:32.041420 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-5c7459a0-092c-4d2a-bbdc-d9a736dc2428 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-9818b062-2a6b-4d72-9813-5774399c2fc6-delete_volume'" released by "delete_volume" :: held 0.387s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:20:32.795545 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-751fe8b0-7c24-4d7c-a575-dd6b37941ba3 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-e9f7d155-155a-4b53-bf0c-7679be63aeb5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:20:32.797169 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-751fe8b0-7c24-4d7c-a575-dd6b37941ba3 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:33.533036 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-751fe8b0-7c24-4d7c-a575-dd6b37941ba3 tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['053a5119-13af-46f3-af40-06796565e2ba', '1f545034-233d-485e-adec-16a72baadafa', 'df4ba277-7194-4a48-84a1-b743c15bbb3a', '99dfa358-4a22-4e59-974b-b2eda9ff2ef5'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:20:33.571162 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-751fe8b0-7c24-4d7c-a575-dd6b37941ba3 tempest-VolumesSnapshotTestJSON-163973597 None] Delete snapshot completed successfully. Mar 05 21:20:33.576366 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-751fe8b0-7c24-4d7c-a575-dd6b37941ba3 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-e9f7d155-155a-4b53-bf0c-7679be63aeb5-delete_snapshot'" released by "delete_snapshot" :: held 0.781s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:20:33.896793 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-0fb26a8f-11e7-495b-9057-774fab1a6773 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-bc40611c-e00f-4523-8b02-61d529334b03-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:20:33.930439 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0fb26a8f-11e7-495b-9057-774fab1a6773 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:33.968205 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0fb26a8f-11e7-495b-9057-774fab1a6773 tempest-VolumesSnapshotTestJSON-163973597 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:20:33.968738 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0fb26a8f-11e7-495b-9057-774fab1a6773 tempest-VolumesSnapshotTestJSON-163973597 None] Volume volume-bc40611c-e00f-4523-8b02-61d529334b03 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:20:33.974259 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0fb26a8f-11e7-495b-9057-774fab1a6773 tempest-VolumesSnapshotTestJSON-163973597 None] deleting rbd volume volume-bc40611c-e00f-4523-8b02-61d529334b03 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:20:34.170616 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-0fb26a8f-11e7-495b-9057-774fab1a6773 tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['698dd216-e410-4c02-9447-97ec8670fc53', 'dc8bb2d4-2b79-4461-8c81-f22f0dcff90a', '18917212-974b-4c72-a85f-96f2990bcc07', '537203ec-b932-439c-a964-d4fb64bda466'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:20:34.211611 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0fb26a8f-11e7-495b-9057-774fab1a6773 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:34.234397 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0fb26a8f-11e7-495b-9057-774fab1a6773 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:34.256935 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-0fb26a8f-11e7-495b-9057-774fab1a6773 tempest-VolumesSnapshotTestJSON-163973597 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:20:34.261142 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-0fb26a8f-11e7-495b-9057-774fab1a6773 tempest-VolumesSnapshotTestJSON-163973597 None] Deleted volume successfully. Mar 05 21:20:34.272147 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-0fb26a8f-11e7-495b-9057-774fab1a6773 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-bc40611c-e00f-4523-8b02-61d529334b03-delete_volume'" released by "delete_volume" :: held 0.375s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:20:35.143628 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-54b9e133-993f-492f-b120-28e04d1ef7b1 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-2406c7fe-3a07-47be-8091-9b368ce0b6e5-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:20:35.173792 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-54b9e133-993f-492f-b120-28e04d1ef7b1 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:35.234298 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-54b9e133-993f-492f-b120-28e04d1ef7b1 tempest-VolumesSnapshotTestJSON-163973597 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:20:35.240837 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-54b9e133-993f-492f-b120-28e04d1ef7b1 tempest-VolumesSnapshotTestJSON-163973597 None] deleting rbd volume volume-2406c7fe-3a07-47be-8091-9b368ce0b6e5 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:20:35.401511 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-54b9e133-993f-492f-b120-28e04d1ef7b1 tempest-VolumesSnapshotTestJSON-163973597 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 21:20:35.431619 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-54b9e133-993f-492f-b120-28e04d1ef7b1 tempest-VolumesSnapshotTestJSON-163973597 None] deleting parent snapshot volume-2406c7fe-3a07-47be-8091-9b368ce0b6e5.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 21:20:36.546072 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-54b9e133-993f-492f-b120-28e04d1ef7b1 tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['ce9fc09d-4e06-4451-8bb2-82248dfe12b7', '75f1ec18-19b4-4229-85fc-94786b338d1c', 'a1201f91-1fc9-4981-a9e3-a1d146a29116', '45cc6300-2888-4944-b379-f1bfaffe32df'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:20:36.590635 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-54b9e133-993f-492f-b120-28e04d1ef7b1 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:36.613478 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-54b9e133-993f-492f-b120-28e04d1ef7b1 tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:36.635711 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-54b9e133-993f-492f-b120-28e04d1ef7b1 tempest-VolumesSnapshotTestJSON-163973597 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:20:36.639576 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-54b9e133-993f-492f-b120-28e04d1ef7b1 tempest-VolumesSnapshotTestJSON-163973597 None] Deleted volume successfully. Mar 05 21:20:36.651164 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-54b9e133-993f-492f-b120-28e04d1ef7b1 tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-2406c7fe-3a07-47be-8091-9b368ce0b6e5-delete_volume'" released by "delete_volume" :: held 1.508s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:20:37.312835 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-8a202944-4024-4867-a5e9-a8e52b3d6f5e tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-721f128b-3d36-425b-b691-ec50a945edf6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:20:37.315659 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-8a202944-4024-4867-a5e9-a8e52b3d6f5e tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:37.520836 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-8a202944-4024-4867-a5e9-a8e52b3d6f5e tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['5a70d768-661e-46c8-b32f-2063041ce240', '6f323eaa-e636-41b2-9304-552cd6667ac9', '1156dc85-b68a-4dee-9f02-3273b874d3aa', 'e0355043-aa4e-46d4-8b3a-6a2595094403'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:20:37.553727 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-8a202944-4024-4867-a5e9-a8e52b3d6f5e tempest-VolumesSnapshotTestJSON-163973597 None] Delete snapshot completed successfully. Mar 05 21:20:37.558284 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-8a202944-4024-4867-a5e9-a8e52b3d6f5e tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-721f128b-3d36-425b-b691-ec50a945edf6-delete_snapshot'" released by "delete_snapshot" :: held 0.246s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:20:38.406360 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b4cf5c7b-3dbf-4f67-b2c9-8b15d7c5165c tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-2b235070-e46f-4802-b5ac-7531e3c2899c-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:20:38.437926 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b4cf5c7b-3dbf-4f67-b2c9-8b15d7c5165c tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:38.476699 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b4cf5c7b-3dbf-4f67-b2c9-8b15d7c5165c tempest-VolumesSnapshotTestJSON-163973597 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:20:38.477131 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b4cf5c7b-3dbf-4f67-b2c9-8b15d7c5165c tempest-VolumesSnapshotTestJSON-163973597 None] Volume volume-2b235070-e46f-4802-b5ac-7531e3c2899c is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:20:38.482465 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b4cf5c7b-3dbf-4f67-b2c9-8b15d7c5165c tempest-VolumesSnapshotTestJSON-163973597 None] deleting rbd volume volume-2b235070-e46f-4802-b5ac-7531e3c2899c {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:20:38.674642 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-b4cf5c7b-3dbf-4f67-b2c9-8b15d7c5165c tempest-VolumesSnapshotTestJSON-163973597 None] Created reservations ['f6a1cbc0-2f86-4903-9ee9-2a7734b5ebc7', '1f9f2e1f-eacb-487e-9756-94696c6448f5', '116c2db8-ab5c-45b2-a981-e1bdbf542048', 'aadc1491-86d8-4ca0-bf32-1f544dc045be'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:20:38.732831 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b4cf5c7b-3dbf-4f67-b2c9-8b15d7c5165c tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:38.767167 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-b4cf5c7b-3dbf-4f67-b2c9-8b15d7c5165c tempest-VolumesSnapshotTestJSON-163973597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:38.794304 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-b4cf5c7b-3dbf-4f67-b2c9-8b15d7c5165c tempest-VolumesSnapshotTestJSON-163973597 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:20:38.798023 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-b4cf5c7b-3dbf-4f67-b2c9-8b15d7c5165c tempest-VolumesSnapshotTestJSON-163973597 None] Deleted volume successfully. Mar 05 21:20:38.810838 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-b4cf5c7b-3dbf-4f67-b2c9-8b15d7c5165c tempest-VolumesSnapshotTestJSON-163973597 None] Lock "b'cinder-2b235070-e46f-4802-b5ac-7531e3c2899c-delete_volume'" released by "delete_volume" :: held 0.404s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:20:45.609534 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:20:45.610192 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:45.633136 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:20:45.659392 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:21:06.982128 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a967887f-69b9-42f6-ac92-33f111d1faf3 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:21:07.242721 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-a967887f-69b9-42f6-ac92-33f111d1faf3 tempest-TestVolumeBootPattern-160921740 None] Create snapshot completed successfully Mar 05 21:21:08.567605 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:21:08.572106 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:21:08.572781 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:21:08.618824 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Flow 'volume_create_manager' (15276cff-53ac-41f2-8869-fc306360bde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:21:08.628602 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f84095-80e5-4ca1-b0f2-fa4053ff8d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:21:08.636057 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:21:08.654953 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f84095-80e5-4ca1-b0f2-fa4053ff8d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1256512571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=01335ff0-455d-4442-8826-b96e8565b6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdcb29011e61419981c5bfc5f10677c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=865e76e5-9636-4219-85f9-b8eaa617247f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:21:09Z,use_quota=True,user_id='0c07bd2946594c3e8848bca133da0d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:21:08.661847 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f29a63d-cd2c-4b7a-bee3-05d2c3ca8a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:21:08.666119 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f29a63d-cd2c-4b7a-bee3-05d2c3ca8a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:21:08.671472 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9a32e0-5c0e-4ad8-a4ac-1ba079a129b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:21:08.676440 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9a32e0-5c0e-4ad8-a4ac-1ba079a129b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '01335ff0-455d-4442-8826-b96e8565b6f9', 'volume_name': 'volume-01335ff0-455d-4442-8826-b96e8565b6f9', 'volume_size': 1, 'snapshot_id': '865e76e5-9636-4219-85f9-b8eaa617247f'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:21:08.681679 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f70c37-263c-461d-bc8d-88a0f8ce54f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:21:08.685833 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f70c37-263c-461d-bc8d-88a0f8ce54f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:21:08.691725 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85f1e37-4444-4eed-bb78-aabdab925242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:21:08.692860 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Volume 01335ff0-455d-4442-8826-b96e8565b6f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-01335ff0-455d-4442-8826-b96e8565b6f9', 'volume_size': 1, 'snapshot_id': '865e76e5-9636-4219-85f9-b8eaa617247f'} Mar 05 21:21:08.715556 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] cloning volumes/volume-d12389cd-038b-48ad-9624-b01e46ae00b5@snapshot-865e76e5-9636-4219-85f9-b8eaa617247f to volume-01335ff0-455d-4442-8826-b96e8565b6f9 {{(pid=134747) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Mar 05 21:21:08.716564 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:21:08.806510 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:21:09.022006 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:21:09.022637 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:21:09.044254 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Marking volume 01335ff0-455d-4442-8826-b96e8565b6f9 as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 21:21:09.052459 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Copying metadata from snapshot 865e76e5-9636-4219-85f9-b8eaa617247f to 01335ff0-455d-4442-8826-b96e8565b6f9. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Mar 05 21:21:09.129662 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85f1e37-4444-4eed-bb78-aabdab925242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01335ff0-455d-4442-8826-b96e8565b6f9', 'volume_size': 1, 'snapshot_id': '865e76e5-9636-4219-85f9-b8eaa617247f'}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:21:09.141638 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930bf6bf-2215-4586-8069-579a7b17daa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:21:09.156266 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Volume volume-01335ff0-455d-4442-8826-b96e8565b6f9 (01335ff0-455d-4442-8826-b96e8565b6f9): created successfully Mar 05 21:21:09.162331 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930bf6bf-2215-4586-8069-579a7b17daa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:21:09.168923 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Flow 'volume_create_manager' (15276cff-53ac-41f2-8869-fc306360bde2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:21:09.193221 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-5625a4e9-e0a8-42c7-adf6-c2fcdc1f8150 tempest-TestVolumeBootPattern-160921740 None] Created volume successfully. Mar 05 21:21:12.255408 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 req-5f11fa96-eb0d-4b75-b279-5c0a8833c6ea tempest-TestVolumeBootPattern-160921740 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:21:13.003122 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 req-5f11fa96-eb0d-4b75-b279-5c0a8833c6ea tempest-TestVolumeBootPattern-160921740 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.747s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:21:13.004253 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 req-5f11fa96-eb0d-4b75-b279-5c0a8833c6ea tempest-TestVolumeBootPattern-160921740 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-01335ff0-455d-4442-8826-b96e8565b6f9', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '01335ff0-455d-4442-8826-b96e8565b6f9', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:21:13.044183 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 req-5f11fa96-eb0d-4b75-b279-5c0a8833c6ea tempest-TestVolumeBootPattern-160921740 None] Connection info returned from driver {'name': 'volumes/volume-01335ff0-455d-4442-8826-b96e8565b6f9', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '01335ff0-455d-4442-8826-b96e8565b6f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e7467787-a71e-4b89-a5ef-a306ce47d2d3'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:21:13.101170 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 req-5f11fa96-eb0d-4b75-b279-5c0a8833c6ea tempest-TestVolumeBootPattern-160921740 None] attachment_update completed successfully. Mar 05 21:21:45.615112 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:21:45.616243 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:21:45.645452 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:21:45.669338 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:22:45.614741 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:22:45.615483 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:22:45.637495 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:22:45.659551 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:23:07.577797 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-9246f3e0-af47-42ff-82f5-f52bb8d3ef09 req-ec376b35-bb1d-4bd5-aae6-706f7ad72947 tempest-TestVolumeBootPattern-160921740 None] Terminate volume connection completed successfully. Mar 05 21:23:07.579026 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-9246f3e0-af47-42ff-82f5-f52bb8d3ef09 req-ec376b35-bb1d-4bd5-aae6-706f7ad72947 tempest-TestVolumeBootPattern-160921740 None] Deleting attachment e7467787-a71e-4b89-a5ef-a306ce47d2d3. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:23:08.867376 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-65d885c5-b06d-4bbd-ba0c-3ac8f23a1ff6 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-01335ff0-455d-4442-8826-b96e8565b6f9-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:23:08.944850 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-65d885c5-b06d-4bbd-ba0c-3ac8f23a1ff6 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:23:09.070639 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-65d885c5-b06d-4bbd-ba0c-3ac8f23a1ff6 tempest-TestVolumeBootPattern-160921740 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:23:09.079768 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-65d885c5-b06d-4bbd-ba0c-3ac8f23a1ff6 tempest-TestVolumeBootPattern-160921740 None] deleting rbd volume volume-01335ff0-455d-4442-8826-b96e8565b6f9 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:23:09.462527 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-65d885c5-b06d-4bbd-ba0c-3ac8f23a1ff6 tempest-TestVolumeBootPattern-160921740 None] Created reservations ['010267ed-8024-4822-a686-8a58448d83ec', '681e58df-bd80-480b-a80b-1ecf16f370b2', '5c17cc97-1c90-4edb-b051-c7a773e833fd', 'd28b5048-0ce6-43ea-afc9-f2d94d70a2aa'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:23:09.525168 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-65d885c5-b06d-4bbd-ba0c-3ac8f23a1ff6 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:23:09.574136 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-65d885c5-b06d-4bbd-ba0c-3ac8f23a1ff6 tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:23:09.629363 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-65d885c5-b06d-4bbd-ba0c-3ac8f23a1ff6 tempest-TestVolumeBootPattern-160921740 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:23:09.633794 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-65d885c5-b06d-4bbd-ba0c-3ac8f23a1ff6 tempest-TestVolumeBootPattern-160921740 None] Deleted volume successfully. Mar 05 21:23:09.652140 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-65d885c5-b06d-4bbd-ba0c-3ac8f23a1ff6 tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-01335ff0-455d-4442-8826-b96e8565b6f9-delete_volume'" released by "delete_volume" :: held 0.785s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:23:10.067351 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-373d683d-8c41-44b1-844c-7f23e01ffa6f tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-865e76e5-9636-4219-85f9-b8eaa617247f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:23:10.071715 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-373d683d-8c41-44b1-844c-7f23e01ffa6f tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:23:40.314539 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-373d683d-8c41-44b1-844c-7f23e01ffa6f tempest-TestVolumeBootPattern-160921740 None] Created reservations ['e178f9ad-5a0f-4618-b990-22f53d1a231f', '41913019-dfb7-4a7c-b1f6-efc1b1429c3b', 'b64821e2-f6cc-40e6-ba11-85879b4f5328', '90877fce-b0af-4123-ac8c-2004878ee3a7'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:23:40.351174 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-373d683d-8c41-44b1-844c-7f23e01ffa6f tempest-TestVolumeBootPattern-160921740 None] Delete snapshot completed successfully. Mar 05 21:23:40.355614 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-373d683d-8c41-44b1-844c-7f23e01ffa6f tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-865e76e5-9636-4219-85f9-b8eaa617247f-delete_snapshot'" released by "delete_snapshot" :: held 30.288s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:23:44.069095 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-5db97c60-2e5e-46db-bff3-dab9fd53c869 req-57ee8617-89c0-4b7d-b1ff-f4080949c44e tempest-TestVolumeBootPattern-160921740 None] Terminate volume connection completed successfully. Mar 05 21:23:44.069780 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-5db97c60-2e5e-46db-bff3-dab9fd53c869 req-57ee8617-89c0-4b7d-b1ff-f4080949c44e tempest-TestVolumeBootPattern-160921740 None] Deleting attachment 289b1789-ecc4-48a9-8c8c-cbee022a7479. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:23:45.614144 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:23:45.615828 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:23:45.637643 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:23:45.664795 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:23:46.392727 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-6db9e65b-cd0b-4f72-ae57-9ae5f90b632d tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-d12389cd-038b-48ad-9624-b01e46ae00b5-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:23:46.422226 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6db9e65b-cd0b-4f72-ae57-9ae5f90b632d tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:23:46.482274 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6db9e65b-cd0b-4f72-ae57-9ae5f90b632d tempest-TestVolumeBootPattern-160921740 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:23:46.488609 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6db9e65b-cd0b-4f72-ae57-9ae5f90b632d tempest-TestVolumeBootPattern-160921740 None] deleting rbd volume volume-d12389cd-038b-48ad-9624-b01e46ae00b5 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:23:46.716800 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6db9e65b-cd0b-4f72-ae57-9ae5f90b632d tempest-TestVolumeBootPattern-160921740 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 21:23:46.747474 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6db9e65b-cd0b-4f72-ae57-9ae5f90b632d tempest-TestVolumeBootPattern-160921740 None] deleting parent snapshot volume-d12389cd-038b-48ad-9624-b01e46ae00b5.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 21:23:47.224127 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-6db9e65b-cd0b-4f72-ae57-9ae5f90b632d tempest-TestVolumeBootPattern-160921740 None] Created reservations ['57af2ad2-07ce-49bd-b97b-2c4ffeb41269', '39308ac2-0f55-4980-876b-9ec1c78cdcc7', '1dd996cb-4bc5-41e7-bd0c-df29c7b08db9', '2b37592f-9fa4-4266-a3d1-8e1a714b290d'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:23:47.266504 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6db9e65b-cd0b-4f72-ae57-9ae5f90b632d tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:23:47.288368 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-6db9e65b-cd0b-4f72-ae57-9ae5f90b632d tempest-TestVolumeBootPattern-160921740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:23:47.311201 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-6db9e65b-cd0b-4f72-ae57-9ae5f90b632d tempest-TestVolumeBootPattern-160921740 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:23:47.318451 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-6db9e65b-cd0b-4f72-ae57-9ae5f90b632d tempest-TestVolumeBootPattern-160921740 None] Deleted volume successfully. Mar 05 21:23:47.334444 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-6db9e65b-cd0b-4f72-ae57-9ae5f90b632d tempest-TestVolumeBootPattern-160921740 None] Lock "b'cinder-d12389cd-038b-48ad-9624-b01e46ae00b5-delete_volume'" released by "delete_volume" :: held 0.942s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:24:45.619566 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:24:45.620935 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:24:45.642494 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:24:45.664473 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:25:45.620619 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:25:45.621348 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:25:45.646535 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:25:45.671640 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:26:45.618685 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:26:45.619456 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:26:45.646816 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:26:45.673461 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:27:45.619843 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:27:45.620512 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:27:45.649757 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:27:45.678349 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:28:45.624470 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:28:45.625126 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:28:45.649859 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:28:45.684941 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:29:45.621036 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:29:45.621765 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:29:45.643766 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:29:45.665640 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:30:45.620897 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:30:45.621642 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:30:45.651523 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:30:45.695149 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:31:45.622300 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:31:45.623054 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:31:45.663317 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:31:45.707448 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:32:45.618272 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:32:45.619782 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:32:45.652483 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:32:45.678622 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:32:57.015550 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:32:57.019833 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:32:57.020326 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:32:57.041993 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Flow 'volume_create_manager' (abacd691-ae6b-44be-9564-8964bab86006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:32:57.049020 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f358ab-912a-42ab-bc4e-f782b1fde0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:32:57.057388 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:32:57.072511 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f358ab-912a-42ab-bc4e-f782b1fde0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1880646150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a2dcc93e-3ce5-4d99-a342-9c3017d739d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cb16655b3348048ea81b796af0da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:32:57Z,use_quota=True,user_id='a2def15483f54bf282b64a4712ba0ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:32:57.078158 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fce491b-c846-4577-9257-45d8c7786607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:32:57.082491 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fce491b-c846-4577-9257-45d8c7786607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:32:57.088153 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80198c1-4eaa-46a3-85a8-13c202e72f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:32:57.092533 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80198c1-4eaa-46a3-85a8-13c202e72f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'volume_name': 'volume-a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:32:57.097835 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cdb581-6de0-46e6-b825-360764ced4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:32:57.102523 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cdb581-6de0-46e6-b825-360764ced4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:32:57.107361 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb7e78a-8a63-4998-acf8-2215c9074209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:32:57.108511 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Volume a2dcc93e-3ce5-4d99-a342-9c3017d739d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'volume_size': 1} Mar 05 21:32:57.108919 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] creating volume 'volume-a2dcc93e-3ce5-4d99-a342-9c3017d739d2' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:32:57.109937 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:32:57.173067 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:32:57.173447 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:32:57.177476 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb7e78a-8a63-4998-acf8-2215c9074209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:32:57.182967 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9de870-97fa-4b03-bd17-dffc0dc3992d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:32:57.195967 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Volume volume-a2dcc93e-3ce5-4d99-a342-9c3017d739d2 (a2dcc93e-3ce5-4d99-a342-9c3017d739d2): created successfully Mar 05 21:32:57.201181 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9de870-97fa-4b03-bd17-dffc0dc3992d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:32:57.211322 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Flow 'volume_create_manager' (abacd691-ae6b-44be-9564-8964bab86006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:32:57.220567 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-92b24d07-c7a6-422e-8963-fa9c58576100 tempest-ServerActionsTestJSON-961807460 None] Created volume successfully. Mar 05 21:32:58.589193 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-eac19681-9c00-462a-a9c8-c4d1510cd257 req-a2c5b568-0bd8-43c0-ac40-46563fb95c3a tempest-ServerActionsTestJSON-961807460 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:32:59.221943 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-eac19681-9c00-462a-a9c8-c4d1510cd257 req-a2c5b568-0bd8-43c0-ac40-46563fb95c3a tempest-ServerActionsTestJSON-961807460 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.632s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:32:59.222719 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-eac19681-9c00-462a-a9c8-c4d1510cd257 req-a2c5b568-0bd8-43c0-ac40-46563fb95c3a tempest-ServerActionsTestJSON-961807460 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:32:59.245130 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-eac19681-9c00-462a-a9c8-c4d1510cd257 req-a2c5b568-0bd8-43c0-ac40-46563fb95c3a tempest-ServerActionsTestJSON-961807460 None] Connection info returned from driver {'name': 'volumes/volume-a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '20230ca3-7ae6-4907-b594-2b0c90312633'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:32:59.290382 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-eac19681-9c00-462a-a9c8-c4d1510cd257 req-a2c5b568-0bd8-43c0-ac40-46563fb95c3a tempest-ServerActionsTestJSON-961807460 None] attachment_update completed successfully. Mar 05 21:33:24.830827 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a req-4f99ade3-25ca-464d-94fb-c5b0ad46a425 tempest-ServerActionsTestJSON-961807460 None] Terminate volume connection completed successfully. Mar 05 21:33:24.831480 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a req-4f99ade3-25ca-464d-94fb-c5b0ad46a425 tempest-ServerActionsTestJSON-961807460 None] Deleting attachment 20230ca3-7ae6-4907-b594-2b0c90312633. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:33:26.627645 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a req-229e9f8e-0b12-4d00-9512-52d6f0fcdac5 tempest-ServerActionsTestJSON-961807460 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:33:27.265673 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a req-229e9f8e-0b12-4d00-9512-52d6f0fcdac5 tempest-ServerActionsTestJSON-961807460 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.638s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:33:27.266492 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a req-229e9f8e-0b12-4d00-9512-52d6f0fcdac5 tempest-ServerActionsTestJSON-961807460 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:33:27.290071 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a req-229e9f8e-0b12-4d00-9512-52d6f0fcdac5 tempest-ServerActionsTestJSON-961807460 None] Connection info returned from driver {'name': 'volumes/volume-a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '77f39e73-1bb3-4612-86eb-517d0db5d038'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:33:27.338074 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a req-229e9f8e-0b12-4d00-9512-52d6f0fcdac5 tempest-ServerActionsTestJSON-961807460 None] attachment_update completed successfully. Mar 05 21:33:34.299476 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 req-460ab603-135d-4a9f-8e30-5aa5a4a85d15 tempest-ServerActionsTestJSON-961807460 None] Terminate volume connection completed successfully. Mar 05 21:33:34.300051 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 req-460ab603-135d-4a9f-8e30-5aa5a4a85d15 tempest-ServerActionsTestJSON-961807460 None] Deleting attachment 77f39e73-1bb3-4612-86eb-517d0db5d038. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:33:36.456020 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 req-b24ad340-aae0-45c8-9e67-1d3ca43be06c tempest-ServerActionsTestJSON-961807460 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:33:37.100730 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 req-b24ad340-aae0-45c8-9e67-1d3ca43be06c tempest-ServerActionsTestJSON-961807460 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.644s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:33:37.101494 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 req-b24ad340-aae0-45c8-9e67-1d3ca43be06c tempest-ServerActionsTestJSON-961807460 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': 'a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:33:37.126412 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 req-b24ad340-aae0-45c8-9e67-1d3ca43be06c tempest-ServerActionsTestJSON-961807460 None] Connection info returned from driver {'name': 'volumes/volume-a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a2dcc93e-3ce5-4d99-a342-9c3017d739d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'da203b1c-7512-4c35-bc0d-428a1f54f40f'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:33:37.171345 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 req-b24ad340-aae0-45c8-9e67-1d3ca43be06c tempest-ServerActionsTestJSON-961807460 None] attachment_update completed successfully. Mar 05 21:33:43.392271 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-9a301bcb-1ec8-47b2-a8f8-e58345990072 req-e10cbc56-6c8e-4f62-af31-5c71f4c9cfb8 tempest-ServerActionsTestJSON-961807460 None] Terminate volume connection completed successfully. Mar 05 21:33:43.392956 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-9a301bcb-1ec8-47b2-a8f8-e58345990072 req-e10cbc56-6c8e-4f62-af31-5c71f4c9cfb8 tempest-ServerActionsTestJSON-961807460 None] Deleting attachment da203b1c-7512-4c35-bc0d-428a1f54f40f. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:33:44.544949 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-4389b64d-7c7c-4037-b067-4d8e8471c6d7 tempest-ServerActionsTestJSON-961807460 None] Lock "b'cinder-a2dcc93e-3ce5-4d99-a342-9c3017d739d2-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:33:44.575105 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4389b64d-7c7c-4037-b067-4d8e8471c6d7 tempest-ServerActionsTestJSON-961807460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:33:44.616091 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4389b64d-7c7c-4037-b067-4d8e8471c6d7 tempest-ServerActionsTestJSON-961807460 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:33:44.616564 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4389b64d-7c7c-4037-b067-4d8e8471c6d7 tempest-ServerActionsTestJSON-961807460 None] Volume volume-a2dcc93e-3ce5-4d99-a342-9c3017d739d2 is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:33:44.622047 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4389b64d-7c7c-4037-b067-4d8e8471c6d7 tempest-ServerActionsTestJSON-961807460 None] deleting rbd volume volume-a2dcc93e-3ce5-4d99-a342-9c3017d739d2 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:33:44.814840 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-4389b64d-7c7c-4037-b067-4d8e8471c6d7 tempest-ServerActionsTestJSON-961807460 None] Created reservations ['4a2c8eea-d41c-4149-a9a9-f0e386b0e3e1', '7991997c-46c6-40cb-9a6e-996de1ba373a', 'f6ee0752-3171-4fa4-a412-0f512804a5f5', '60b6334b-da2d-4b22-955c-0c3e7be794d1'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:33:44.856408 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4389b64d-7c7c-4037-b067-4d8e8471c6d7 tempest-ServerActionsTestJSON-961807460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:33:44.879569 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-4389b64d-7c7c-4037-b067-4d8e8471c6d7 tempest-ServerActionsTestJSON-961807460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:33:44.908563 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-4389b64d-7c7c-4037-b067-4d8e8471c6d7 tempest-ServerActionsTestJSON-961807460 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:33:44.913762 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-4389b64d-7c7c-4037-b067-4d8e8471c6d7 tempest-ServerActionsTestJSON-961807460 None] Deleted volume successfully. Mar 05 21:33:44.926447 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-4389b64d-7c7c-4037-b067-4d8e8471c6d7 tempest-ServerActionsTestJSON-961807460 None] Lock "b'cinder-a2dcc93e-3ce5-4d99-a342-9c3017d739d2-delete_volume'" released by "delete_volume" :: held 0.382s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:33:45.615259 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:33:45.616167 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:33:45.656668 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:33:45.688441 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:34:45.613096 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:34:45.614481 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:34:45.652905 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:34:45.703220 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:35:15.302700 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:35:15.306865 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:35:15.307368 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:35:15.327281 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Flow 'volume_create_manager' (d322a8a1-e732-4ea6-a454-076571b8d4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:35:15.333936 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b800b994-1a63-4c1f-b18c-a5be945c1914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:35:15.341268 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:35:15.355189 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b800b994-1a63-4c1f-b18c-a5be945c1914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-803171143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8028eb84-fe39-47df-a0d7-e87cb202377c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63f0b6da33924ffea363d98139111178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:35:15Z,use_quota=True,user_id='69f2f1f38a5447528d0c5f1162d604c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:35:15.360686 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05874a60-342e-4ad5-8f4b-8995baf3c54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:35:15.364873 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05874a60-342e-4ad5-8f4b-8995baf3c54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:35:15.370089 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f31f334-b1be-4adc-a703-c03a0d98f5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:35:15.374305 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f31f334-b1be-4adc-a703-c03a0d98f5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8028eb84-fe39-47df-a0d7-e87cb202377c', 'volume_name': 'volume-8028eb84-fe39-47df-a0d7-e87cb202377c', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:35:15.379546 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f77e41-05d9-474a-bd51-8b6dde84f67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:35:15.384301 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f77e41-05d9-474a-bd51-8b6dde84f67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:35:15.389053 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8ce6b4-2ed8-46b6-ae5d-b734499d2048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:35:15.390133 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Volume 8028eb84-fe39-47df-a0d7-e87cb202377c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8028eb84-fe39-47df-a0d7-e87cb202377c', 'volume_size': 1} Mar 05 21:35:15.390529 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] creating volume 'volume-8028eb84-fe39-47df-a0d7-e87cb202377c' {{(pid=134747) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Mar 05 21:35:15.391509 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:35:15.485151 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:35:15.485451 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:35:15.489239 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8ce6b4-2ed8-46b6-ae5d-b734499d2048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8028eb84-fe39-47df-a0d7-e87cb202377c', 'volume_size': 1}' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:35:15.494889 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a878c4e-8f7c-4722-9632-6d7b7bc159fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:35:15.504187 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Volume volume-8028eb84-fe39-47df-a0d7-e87cb202377c (8028eb84-fe39-47df-a0d7-e87cb202377c): created successfully Mar 05 21:35:15.508915 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a878c4e-8f7c-4722-9632-6d7b7bc159fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:35:15.514495 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Flow 'volume_create_manager' (d322a8a1-e732-4ea6-a454-076571b8d4ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:35:15.522397 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-0f7ecfdd-c8fa-4519-9f49-57d334f75e2c tempest-TestMinimumBasicScenario-1143423445 None] Created volume successfully. Mar 05 21:35:16.850068 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-a438fa21-5ffd-4ffc-8168-7d0954abdb0b req-19903725-3762-4e56-badf-32c8761e18e5 tempest-TestMinimumBasicScenario-1143423445 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:35:17.965790 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-a438fa21-5ffd-4ffc-8168-7d0954abdb0b req-19903725-3762-4e56-badf-32c8761e18e5 tempest-TestMinimumBasicScenario-1143423445 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.115s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:35:17.966563 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-a438fa21-5ffd-4ffc-8168-7d0954abdb0b req-19903725-3762-4e56-badf-32c8761e18e5 tempest-TestMinimumBasicScenario-1143423445 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8028eb84-fe39-47df-a0d7-e87cb202377c', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '8028eb84-fe39-47df-a0d7-e87cb202377c', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:35:17.986051 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-a438fa21-5ffd-4ffc-8168-7d0954abdb0b req-19903725-3762-4e56-badf-32c8761e18e5 tempest-TestMinimumBasicScenario-1143423445 None] Connection info returned from driver {'name': 'volumes/volume-8028eb84-fe39-47df-a0d7-e87cb202377c', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8028eb84-fe39-47df-a0d7-e87cb202377c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '24ed3719-762e-46d9-b4c3-0d6b61380a13'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:35:18.030497 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-a438fa21-5ffd-4ffc-8168-7d0954abdb0b req-19903725-3762-4e56-badf-32c8761e18e5 tempest-TestMinimumBasicScenario-1143423445 None] attachment_update completed successfully. Mar 05 21:35:45.612793 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:35:45.613803 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:35:45.638779 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:35:45.663235 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:36:40.015726 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-97cb159e-c419-4769-bee8-673b8fa3aaef req-517f10be-d2c8-4de5-a016-c1b6ac8f8c71 tempest-TestMinimumBasicScenario-1143423445 None] Terminate volume connection completed successfully. Mar 05 21:36:40.016446 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-97cb159e-c419-4769-bee8-673b8fa3aaef req-517f10be-d2c8-4de5-a016-c1b6ac8f8c71 tempest-TestMinimumBasicScenario-1143423445 None] Deleting attachment 24ed3719-762e-46d9-b4c3-0d6b61380a13. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:36:40.629239 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ea4142bc-8ff2-4148-957a-200d096ac9d4 tempest-TestMinimumBasicScenario-1143423445 None] Lock "b'cinder-8028eb84-fe39-47df-a0d7-e87cb202377c-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:36:40.658459 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ea4142bc-8ff2-4148-957a-200d096ac9d4 tempest-TestMinimumBasicScenario-1143423445 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:36:40.696583 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ea4142bc-8ff2-4148-957a-200d096ac9d4 tempest-TestMinimumBasicScenario-1143423445 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:36:40.697487 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ea4142bc-8ff2-4148-957a-200d096ac9d4 tempest-TestMinimumBasicScenario-1143423445 None] Volume volume-8028eb84-fe39-47df-a0d7-e87cb202377c is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:36:40.702618 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ea4142bc-8ff2-4148-957a-200d096ac9d4 tempest-TestMinimumBasicScenario-1143423445 None] deleting rbd volume volume-8028eb84-fe39-47df-a0d7-e87cb202377c {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:36:40.899413 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [None req-ea4142bc-8ff2-4148-957a-200d096ac9d4 tempest-TestMinimumBasicScenario-1143423445 None] Created reservations ['661f61b2-6948-46b7-8047-f8781a172376', 'b7bff407-29d9-4840-ac2d-a667411bbb5e', '4c008a97-b082-4cc9-8db7-ed805d08f695', '45d6b014-2ab3-4a07-96a0-0b2b2a7e52f4'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:36:40.941101 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ea4142bc-8ff2-4148-957a-200d096ac9d4 tempest-TestMinimumBasicScenario-1143423445 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:36:40.963723 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-ea4142bc-8ff2-4148-957a-200d096ac9d4 tempest-TestMinimumBasicScenario-1143423445 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:36:40.986993 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-ea4142bc-8ff2-4148-957a-200d096ac9d4 tempest-TestMinimumBasicScenario-1143423445 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:36:40.991735 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-ea4142bc-8ff2-4148-957a-200d096ac9d4 tempest-TestMinimumBasicScenario-1143423445 None] Deleted volume successfully. Mar 05 21:36:41.003106 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-ea4142bc-8ff2-4148-957a-200d096ac9d4 tempest-TestMinimumBasicScenario-1143423445 None] Lock "b'cinder-8028eb84-fe39-47df-a0d7-e87cb202377c-delete_volume'" released by "delete_volume" :: held 0.374s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:36:45.609201 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:36:45.610020 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:36:45.637306 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:36:45.666735 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:37:45.612916 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:37:45.613622 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:37:45.636249 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:37:45.662277 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:38:45.617024 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:38:45.618125 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:38:45.639751 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:38:45.662254 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:39:45.617924 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:39:45.618616 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:39:45.656151 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:39:45.691560 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:40:45.616756 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:40:45.617788 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:40:45.639259 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:40:45.664700 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:41:45.619942 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:41:45.620909 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:41:45.657511 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:41:45.694768 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:42:45.620112 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:42:45.620800 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:42:45.642943 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:42:45.669476 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:43:45.624382 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:43:45.625094 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:43:45.648206 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:43:45.679517 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:44:45.625310 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:44:45.627603 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:44:45.673353 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:44:45.715010 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:45:45.630462 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:45:45.631166 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:45:45.654976 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:45:45.682359 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:47:45.632257 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:47:45.633043 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:47:45.654355 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:47:45.677009 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:48:45.631572 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:48:45.632317 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:48:45.655767 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:48:45.678779 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:48:52.627298 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 05 21:48:52.632459 ncdv-master-1 cinder-volume[134747]: WARNING stevedore.named [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 05 21:48:52.632937 ncdv-master-1 cinder-volume[134747]: WARNING castellan.key_manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 05 21:48:52.652489 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Flow 'volume_create_manager' (2e735a96-a6ac-462c-aa2f-6fce0097ac34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:48:52.659092 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a890465-37dd-44a6-8fbf-3aa10e126823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:48:52.667581 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_db.sqlalchemy.engines [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 21:48:52.682806 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a890465-37dd-44a6-8fbf-3aa10e126823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-05T21:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-565208954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5bac931b-1247-4175-9eba-facd71a337a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8fd34db08b648489afd4f749b965e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-05T21:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-05T21:48:53Z,use_quota=True,user_id='47a7c63e175949e1938accdece2a4c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee328ec7-af7d-4a65-bc9b-e206ed8623bd),volume_type_id=ee328ec7-af7d-4a65-bc9b-e206ed8623bd)' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:48:52.688298 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e73c7f-1844-4b9b-9de5-102fea632736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:48:52.692546 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e73c7f-1844-4b9b-9de5-102fea632736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:48:52.698163 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5bb1c34-10e3-45e7-a455-b9c59bb57e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:48:52.777080 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5bb1c34-10e3-45e7-a455-b9c59bb57e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5bac931b-1247-4175-9eba-facd71a337a4', 'volume_name': 'volume-5bac931b-1247-4175-9eba-facd71a337a4', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:48:52.782182 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccaf258-87af-484e-b26c-28da4e670f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:48:52.786309 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccaf258-87af-484e-b26c-28da4e670f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:48:52.791707 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dadd45f-ef76-45dd-9617-bfb1b296852b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:48:52.792856 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Volume 5bac931b-1247-4175-9eba-facd71a337a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5bac931b-1247-4175-9eba-facd71a337a4', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 05 21:48:52.793435 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Cloning 5bac931b-1247-4175-9eba-facd71a337a4 from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 at location (None, None). {{(pid=134747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 05 21:48:52.801654 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:48:52.811032 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 48, 52, 806020)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:48:52.811492 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:48:52.811944 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Found cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 05 21:48:52.815833 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Lock "b'cinder-81837c2f-28ec-46e4-b5d6-afa9c9233d80'" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:48:52.816758 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Attempting to retrieve cache entry for image = 81837c2f-28ec-46e4-b5d6-afa9c9233d80 on host ncdv-master-1@ceph#ceph. {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 05 21:48:52.822521 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Found image-volume cache entry: {'id': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'volume_id': '799c53fd-91d0-4ee8-90fa-05a07a3b1df7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14), 'last_used': datetime.datetime(2022, 3, 5, 21, 48, 52, 820424)}. {{(pid=134747) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 05 21:48:52.822941 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.image.cache [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Image-volume cache entry image_update_at = 2022-03-05 20:40:14+00:00, requested image updated_at = 2022-03-05 20:40:14+00:00. {{(pid=134747) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 05 21:48:52.823333 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Creating from source image-volume 799c53fd-91d0-4ee8-90fa-05a07a3b1df7 {{(pid=134747) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 05 21:48:52.835056 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:48:52.898592 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] creating snapshot='volume-5bac931b-1247-4175-9eba-facd71a337a4.clone_snap' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Mar 05 21:48:53.556100 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] cloning 'volume-799c53fd-91d0-4ee8-90fa-05a07a3b1df7@volume-5bac931b-1247-4175-9eba-facd71a337a4.clone_snap' to 'volume-5bac931b-1247-4175-9eba-facd71a337a4' {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Mar 05 21:48:53.687889 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Volume volume-7fab029c-6104-4f67-a93d-5c93dbea922a.deleted is not a clone. {{(pid=134747) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Mar 05 21:48:53.689260 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Mar 05 21:48:53.689661 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134747) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Mar 05 21:48:53.707306 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] clone created successfully {{(pid=134747) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Mar 05 21:48:53.707952 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.volume_utils [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Marking volume 5bac931b-1247-4175-9eba-facd71a337a4 as bootable. {{(pid=134747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 05 21:48:53.716313 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Copying metadata from image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 to 5bac931b-1247-4175-9eba-facd71a337a4. {{(pid=134747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 05 21:48:53.716741 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Creating volume glance metadata for volume 5bac931b-1247-4175-9eba-facd71a337a4 backed by image 81837c2f-28ec-46e4-b5d6-afa9c9233d80 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 05 21:48:53.766383 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dadd45f-ef76-45dd-9617-bfb1b296852b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bac931b-1247-4175-9eba-facd71a337a4', 'volume_size': 1, 'image_id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15ce06e2f4fa48dc989b51b08a761699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '81837c2f-28ec-46e4-b5d6-afa9c9233d80', 'created_at': datetime.datetime(2022, 3, 5, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 5, 20, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:48:53.774532 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8862ac02-e218-425e-a1e2-83a0fa769be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 05 21:48:53.779654 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.flows.manager.create_volume [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Volume volume-5bac931b-1247-4175-9eba-facd71a337a4 (5bac931b-1247-4175-9eba-facd71a337a4): created successfully Mar 05 21:48:53.783226 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8862ac02-e218-425e-a1e2-83a0fa769be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134747) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 05 21:48:53.789316 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Flow 'volume_create_manager' (2e735a96-a6ac-462c-aa2f-6fce0097ac34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134747) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 05 21:48:53.796920 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [None req-a581015b-41a7-4377-b63e-6f940d007701 tempest-TestShelveInstance-783328256 None] Created volume successfully. Mar 05 21:48:56.575185 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d req-214b7895-e592-4ef7-9495-963cce9f4591 tempest-TestShelveInstance-783328256 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:48:57.288631 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d req-214b7895-e592-4ef7-9495-963cce9f4591 tempest-TestShelveInstance-783328256 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.713s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:48:57.289473 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d req-214b7895-e592-4ef7-9495-963cce9f4591 tempest-TestShelveInstance-783328256 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5bac931b-1247-4175-9eba-facd71a337a4', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '5bac931b-1247-4175-9eba-facd71a337a4', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:48:57.313004 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d req-214b7895-e592-4ef7-9495-963cce9f4591 tempest-TestShelveInstance-783328256 None] Connection info returned from driver {'name': 'volumes/volume-5bac931b-1247-4175-9eba-facd71a337a4', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5bac931b-1247-4175-9eba-facd71a337a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '52c3f323-f4e8-42cb-ba2a-97d4eb7fe9f8'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:48:57.358737 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d req-214b7895-e592-4ef7-9495-963cce9f4591 tempest-TestShelveInstance-783328256 None] attachment_update completed successfully. Mar 05 21:49:45.634454 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:49:45.635504 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:49:45.660096 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:49:45.683034 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:50:45.639156 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:50:45.639879 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:50:45.661452 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:50:45.682834 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:51:27.166316 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-70bf597e-5f7e-45e9-b10e-5e1e34752a21 req-a830b3b4-be6d-4495-8d91-0b0b6bbb83a9 tempest-TestShelveInstance-783328256 None] Terminate volume connection completed successfully. Mar 05 21:51:27.166989 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-70bf597e-5f7e-45e9-b10e-5e1e34752a21 req-a830b3b4-be6d-4495-8d91-0b0b6bbb83a9 tempest-TestShelveInstance-783328256 None] Deleting attachment 52c3f323-f4e8-42cb-ba2a-97d4eb7fe9f8. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:51:29.080591 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-9cd79e6a-4053-4565-a2b1-4131c5d10a28 req-bc5019cc-8a6b-4b29-9059-9bf5f0654f17 tempest-TestShelveInstance-783328256 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 21:51:29.705825 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_concurrency.processutils [req-9cd79e6a-4053-4565-a2b1-4131c5d10a28 req-bc5019cc-8a6b-4b29-9059-9bf5f0654f17 tempest-TestShelveInstance-783328256 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.625s {{(pid=134747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 21:51:29.706576 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-9cd79e6a-4053-4565-a2b1-4131c5d10a28 req-bc5019cc-8a6b-4b29-9059-9bf5f0654f17 tempest-TestShelveInstance-783328256 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5bac931b-1247-4175-9eba-facd71a337a4', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '8d87457b-6332-4760-a8de-c25b9c847a37', 'volume_id': '5bac931b-1247-4175-9eba-facd71a337a4', 'discard': True}} {{(pid=134747) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Mar 05 21:51:29.728617 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-9cd79e6a-4053-4565-a2b1-4131c5d10a28 req-bc5019cc-8a6b-4b29-9059-9bf5f0654f17 tempest-TestShelveInstance-783328256 None] Connection info returned from driver {'name': 'volumes/volume-5bac931b-1247-4175-9eba-facd71a337a4', 'hosts': ['10.222.0.15'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5bac931b-1247-4175-9eba-facd71a337a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cc1ddc6f-180a-416c-909b-e446ef3470a5'} {{(pid=134747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 05 21:51:29.774963 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-9cd79e6a-4053-4565-a2b1-4131c5d10a28 req-bc5019cc-8a6b-4b29-9059-9bf5f0654f17 tempest-TestShelveInstance-783328256 None] attachment_update completed successfully. Mar 05 21:51:45.637576 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:51:45.640732 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:51:45.665162 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:51:45.687967 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:52:45.643339 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:52:45.644110 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:52:45.665769 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:52:45.688726 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:53:05.512512 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-68c609d1-9b02-49e6-bb96-11160d6e1073 req-26849560-ed1e-44e1-a463-b166229cbfd7 tempest-TestShelveInstance-783328256 None] Terminate volume connection completed successfully. Mar 05 21:53:05.513213 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.manager [req-68c609d1-9b02-49e6-bb96-11160d6e1073 req-26849560-ed1e-44e1-a463-b166229cbfd7 tempest-TestShelveInstance-783328256 None] Deleting attachment cc1ddc6f-180a-416c-909b-e446ef3470a5. {{(pid=134747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 05 21:53:05.640467 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-68c609d1-9b02-49e6-bb96-11160d6e1073 req-8bf2d5ca-b06b-4205-97d8-71dced0adc19 tempest-TestShelveInstance-783328256 None] Lock "b'cinder-5bac931b-1247-4175-9eba-facd71a337a4-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 05 21:53:05.674707 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-68c609d1-9b02-49e6-bb96-11160d6e1073 req-8bf2d5ca-b06b-4205-97d8-71dced0adc19 tempest-TestShelveInstance-783328256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:53:05.758447 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-68c609d1-9b02-49e6-bb96-11160d6e1073 req-8bf2d5ca-b06b-4205-97d8-71dced0adc19 tempest-TestShelveInstance-783328256 None] volume has no backup snaps {{(pid=134747) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Mar 05 21:53:05.765345 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-68c609d1-9b02-49e6-bb96-11160d6e1073 req-8bf2d5ca-b06b-4205-97d8-71dced0adc19 tempest-TestShelveInstance-783328256 None] deleting rbd volume volume-5bac931b-1247-4175-9eba-facd71a337a4 {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Mar 05 21:53:06.066137 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-68c609d1-9b02-49e6-bb96-11160d6e1073 req-8bf2d5ca-b06b-4205-97d8-71dced0adc19 tempest-TestShelveInstance-783328256 None] volume is a clone so cleaning references {{(pid=134747) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Mar 05 21:53:06.099537 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-68c609d1-9b02-49e6-bb96-11160d6e1073 req-8bf2d5ca-b06b-4205-97d8-71dced0adc19 tempest-TestShelveInstance-783328256 None] deleting parent snapshot volume-5bac931b-1247-4175-9eba-facd71a337a4.clone_snap {{(pid=134747) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Mar 05 21:53:06.678222 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.quota [req-68c609d1-9b02-49e6-bb96-11160d6e1073 req-8bf2d5ca-b06b-4205-97d8-71dced0adc19 tempest-TestShelveInstance-783328256 None] Created reservations ['31d11ab1-9cb6-4eae-ab9a-97acb47343c8', '408a5e2a-014f-481a-a45c-b0f4b50f8a8d', 'bb7f5639-2f99-48c2-9e00-852aead87f3a', 'c92b943a-de7d-41ee-8611-790482972171'] {{(pid=134747) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 05 21:53:06.720746 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-68c609d1-9b02-49e6-bb96-11160d6e1073 req-8bf2d5ca-b06b-4205-97d8-71dced0adc19 tempest-TestShelveInstance-783328256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:53:06.743844 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [req-68c609d1-9b02-49e6-bb96-11160d6e1073 req-8bf2d5ca-b06b-4205-97d8-71dced0adc19 tempest-TestShelveInstance-783328256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:53:06.767075 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [req-68c609d1-9b02-49e6-bb96-11160d6e1073 req-8bf2d5ca-b06b-4205-97d8-71dced0adc19 tempest-TestShelveInstance-783328256 None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:53:06.771241 ncdv-master-1 cinder-volume[134747]: INFO cinder.volume.manager [req-68c609d1-9b02-49e6-bb96-11160d6e1073 req-8bf2d5ca-b06b-4205-97d8-71dced0adc19 tempest-TestShelveInstance-783328256 None] Deleted volume successfully. Mar 05 21:53:06.782838 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.coordination [req-68c609d1-9b02-49e6-bb96-11160d6e1073 req-8bf2d5ca-b06b-4205-97d8-71dced0adc19 tempest-TestShelveInstance-783328256 None] Lock "b'cinder-5bac931b-1247-4175-9eba-facd71a337a4-delete_volume'" released by "delete_volume" :: held 1.142s {{(pid=134747) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 05 21:53:45.643399 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:53:45.644145 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:53:45.665319 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:53:45.686872 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:54:45.642036 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:54:45.642756 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:54:45.664807 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:54:45.687392 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:55:45.642637 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:55:45.643425 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:55:45.669195 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:55:45.697737 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:56:45.643792 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:56:45.644587 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:56:45.691348 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:56:45.713192 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:57:45.648746 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:57:45.649394 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:57:45.684493 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:57:45.709569 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:58:45.644342 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:58:45.645148 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:58:45.667100 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:58:45.691341 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 21:59:45.646497 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 21:59:45.647209 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:59:45.668800 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 21:59:45.691586 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 22:00:45.646458 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 22:00:45.647183 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 22:00:45.668491 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 22:00:45.690014 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 22:01:45.646435 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 22:01:45.647143 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 22:01:45.668094 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 22:01:45.689155 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 22:02:45.644501 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 22:02:45.645212 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 22:02:45.666907 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 22:02:45.690709 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 22:03:45.647301 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 22:03:45.648055 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 22:03:45.671423 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 22:03:45.694069 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 22:04:45.649757 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 22:04:45.650527 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 22:04:45.672495 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 22:04:45.694294 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 05 22:05:45.650468 ncdv-master-1 cinder-volume[134747]: DEBUG oslo_service.periodic_task [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134747) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 05 22:05:45.651244 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 22:05:45.672678 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.volume.drivers.rbd [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134747) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Mar 05 22:05:45.695058 ncdv-master-1 cinder-volume[134747]: DEBUG cinder.manager [None req-09e8acf7-be1c-4170-a067-2c4b10e907f8 None None] Notifying Schedulers of capabilities ... {{(pid=134747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}