-- Logs begin at Sat 2022-02-19 20:01:15 UTC, end at Sat 2022-02-19 22:17:24 UTC. -- Feb 19 20:41:01.025306 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Feb 19 20:41:04.278385 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=129145) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 19 20:41:04.278971 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=129145) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 19 20:41:04.651567 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_db.sqlalchemy.engines [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:41:04.950446 ncdv-master-1 cinder-volume[129145]: INFO cinder.rpc [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 19 20:41:04.954582 ncdv-master-1 cinder-volume[129145]: INFO cinder.rpc [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 19 20:41:04.961891 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_db.sqlalchemy.engines [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:41:05.030901 ncdv-master-1 cinder-volume[129145]: INFO cinder.volume.manager [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Determined volume DB was empty at startup. Feb 19 20:41:05.031512 ncdv-master-1 cinder-volume[129145]: DEBUG cinder.volume.manager [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=129145) __init__ /opt/stack/cinder/cinder/volume/manager.py:282}} Feb 19 20:41:05.039077 ncdv-master-1 cinder-volume[129145]: INFO cinder.volume.manager [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 19 20:41:05.039838 ncdv-master-1 cinder-volume[129145]: WARNING stevedore.named [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:41:05.040355 ncdv-master-1 cinder-volume[129145]: WARNING castellan.key_manager [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:41:05.041497 ncdv-master-1 cinder-volume[129145]: WARNING cinder.keymgr.conf_key_mgr [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:41:05.056653 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_db.sqlalchemy.engines [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:41:05.061032 ncdv-master-1 cinder-volume[129145]: INFO cinder.rpc [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Feb 19 20:41:05.064987 ncdv-master-1 cinder-volume[129145]: INFO cinder.rpc [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Automatically selected cinder-volume RPC version 3.17 as minimum service version. Feb 19 20:41:05.065637 ncdv-master-1 cinder-volume[129145]: WARNING stevedore.named [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:41:05.066031 ncdv-master-1 cinder-volume[129145]: WARNING castellan.key_manager [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:41:05.067681 ncdv-master-1 cinder-volume[129145]: INFO cinder.volume.manager [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Image-volume cache enabled for host ncdv-master-1@ceph. Feb 19 20:41:05.074124 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_db.sqlalchemy.engines [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:41:05.095581 ncdv-master-1 cinder-volume[129145]: INFO oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Starting 1 workers Feb 19 20:41:05.100955 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Started child 129319 {{(pid=129145) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Feb 19 20:41:05.102532 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Full set of CONF: {{(pid=129145) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Feb 19 20:41:05.103060 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ******************************************************************************** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 19 20:41:05.103512 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] Configuration options gathered from: {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 19 20:41:05.104016 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 19 20:41:05.105579 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 19 20:41:05.106053 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ================================================================================ {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 19 20:41:05.106928 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] allow_availability_zone_fallback = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.107445 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] allow_compression_on_image_upload = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.107673 ncdv-master-1 cinder-volume[129319]: INFO cinder.service [-] Starting cinder-volume node (version 19.1.0) Feb 19 20:41:05.108789 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] allowed_direct_url_schemes = [] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.109356 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] api_rate_limit = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.110290 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] auth_strategy = keystone {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.120782 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] az_cache_duration = 3600 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.121505 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_availability_zone = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.146683 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-dba0619b-f08b-458c-92ff-176255171545 None None] Starting volume driver RBDDriver (1.2.0) Feb 19 20:41:05.146683 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dba0619b-f08b-458c-92ff-176255171545 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:41:05.180182 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_host = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.180921 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_name = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.181548 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_stats_polling_interval = 60 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.182174 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backup_api_class = cinder.backup.api.API {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.184171 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.185273 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backup_name_template = backup-%s {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.185944 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backup_use_same_host = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.186859 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backup_use_temp_snapshot = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.187489 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] chap_password = **** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.188103 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] chap_username = {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.188813 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.189398 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cinder_internal_tenant_project_id = 676e84132178466da2cf0c656f99ebd2 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.191607 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cinder_internal_tenant_user_id = 9398233d060c43048d49d758695153a3 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.191607 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cloned_volume_same_az = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.191607 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cluster = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.193392 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] compression_format = gzip {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.193972 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] compute_api_class = cinder.compute.nova.API {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.194609 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] config_dir = [] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.195403 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.196069 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] config_source = [] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.196698 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.197287 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] control_exchange = openstack {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.197715 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] debug = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.198100 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] default_availability_zone = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.198494 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] default_group_type = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.199054 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.200175 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] default_volume_type = ceph {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.200524 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] driver_client_cert = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.201035 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] driver_client_cert_key = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.201548 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] driver_data_namespace = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.202071 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] driver_ssl_cert_path = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.202454 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] driver_ssl_cert_verify = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.202809 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] driver_use_ssl = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.203167 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] enable_force_upload = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.203496 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] enable_new_services = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.203859 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] enable_unsupported_driver = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.204247 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] enabled_backends = ['ceph'] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.204855 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] enforce_multipath_for_image_xfer = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.205920 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] filter_function = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.207996 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] glance_api_insecure = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.210018 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] glance_api_servers = ['http://10.222.0.30/image'] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.210577 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] glance_api_ssl_compression = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.210962 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] glance_ca_certificates_file = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.211514 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] glance_catalog_info = image:glance:publicURL {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.212042 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] glance_certfile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.212741 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.213151 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] glance_keyfile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.213510 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] glance_num_retries = 3 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.214568 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] glance_request_timeout = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.214984 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] goodness_function = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.215607 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] graceful_shutdown_timeout = 5 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.215978 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] group_api_class = cinder.group.api.API {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.216283 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] host = ncdv-master-1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.216707 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] iet_conf = /etc/iet/ietd.conf {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.217103 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] image_compress_on_upload = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.217471 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] image_conversion_address_space_limit = 1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.217821 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] image_conversion_cpu_limit = 60 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.218334 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.218684 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] image_upload_use_cinder_backend = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.219030 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] image_upload_use_internal_tenant = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.219378 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] image_volume_cache_enabled = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.219728 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] image_volume_cache_max_count = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.220104 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] image_volume_cache_max_size_gb = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.220538 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] init_host_max_objects_retrieval = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.221458 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] instance_format = [instance: %(uuid)s] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.222078 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.222642 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] iscsi_iotype = fileio {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.223466 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] iscsi_secondary_ip_addresses = [] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.224044 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] iscsi_target_flags = {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.224646 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] iscsi_write_cache = on {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.225192 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] iser_helper = tgtadm {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.226178 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] iser_ip_address = 10.222.0.30 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.226308 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dba0619b-f08b-458c-92ff-176255171545 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:41:05.226911 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] iser_port = 3260 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.227462 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.228045 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] log_config_append = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.228677 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.229241 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] log_dir = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.230355 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] log_file = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.230837 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] log_options = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.231386 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] log_rotate_interval = 1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.232006 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] log_rotate_interval_type = days {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.232604 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] log_rotation_type = none {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.233096 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.233580 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.234151 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.234719 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.235194 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.235897 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] max_age = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.236508 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] max_logfile_count = 30 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.237054 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] max_logfile_size_mb = 200 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.237650 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] max_over_subscription_ratio = 20.0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.238213 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] message_reap_interval = 86400 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.238772 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] message_ttl = 2592000 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.239346 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] migration_create_volume_timeout_secs = 300 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.239895 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] monkey_patch = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.240693 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] monkey_patch_modules = [] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.241183 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] my_ip = 10.222.0.30 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.241744 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] no_snapshot_gb_quota = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.242387 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] num_iser_scan_tries = 3 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.242979 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] num_shell_tries = 3 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.243522 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] num_volume_device_scan_tries = 3 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.244167 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] nvmet_ns_id = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.244780 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] nvmet_port_id = 1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.245322 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] osapi_max_limit = 1000 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.245745 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] osapi_volume_ext_list = [] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.246315 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.246707 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] osapi_volume_listen = 0.0.0.0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.247062 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] osapi_volume_listen_port = 8776 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.247526 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] osapi_volume_use_ssl = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.247896 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] osapi_volume_workers = 2 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.248247 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] per_volume_size_limit = -1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.248635 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] periodic_fuzzy_delay = 60 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.249010 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] periodic_interval = 60 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.249381 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] public_endpoint = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.249717 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] publish_errors = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.250399 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] quota_backup_gigabytes = 1000 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.250770 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] quota_backups = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.251122 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] quota_consistencygroups = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.251486 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.251853 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] quota_gigabytes = 1000 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.252194 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] quota_groups = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.252825 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] quota_snapshots = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.253175 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] quota_volumes = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.253557 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] rate_limit_burst = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.253924 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] rate_limit_except_level = CRITICAL {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.254300 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] rate_limit_interval = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.255338 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] reinit_driver_count = 3 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.255860 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] replication_device = **** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.256585 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] report_discard_supported = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.257353 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] report_interval = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.257969 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] reservation_clean_interval = 86400 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.258430 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] reservation_expire = 86400 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.258936 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] reserved_percentage = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.259591 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.260095 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.260721 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] rpc_response_timeout = 120 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.261235 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] run_external_periodic_tasks = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.261822 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.262191 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] scst_target_driver = iscsi {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.262550 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] scst_target_iqn_name = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.262848 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] service_down_time = 60 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.263246 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] snapshot_name_template = snapshot-%s {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.263598 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] snapshot_same_host = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.263948 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] split_loggers = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.264241 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] state_path = /opt/stack/data/cinder {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.264666 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] storage_availability_zone = nova {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.265033 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] storage_protocol = iscsi {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.265417 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] syslog_log_facility = LOG_USER {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.265776 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] target_helper = lioadm {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.266307 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] target_ip_address = 10.222.0.30 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.266650 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] target_port = 3260 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.267012 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.267378 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] target_protocol = iscsi {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.267720 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] trace_flags = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.268117 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] transfer_api_class = cinder.transfer.api.API {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.268745 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] transport_url = **** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.269163 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] until_refresh = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.269491 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] use_chap_auth = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.272684 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] use_default_quota_class = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.273321 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] use_eventlog = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.273694 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] use_journal = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.274057 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] use_json = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.274421 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] use_multipath_for_image_xfer = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.274785 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] use_stderr = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.275200 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] use_syslog = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.275598 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] verify_glance_signatures = enabled {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.275961 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] volume_api_class = cinder.volume.api.API {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.276902 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] volume_backend_name = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.277274 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] volume_clear = zero {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.277626 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] volume_clear_ionice = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.277978 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] volume_clear_size = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.278337 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.278703 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] volume_copy_bps_limit = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.279269 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] volume_dd_blocksize = 1M {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.279436 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.280278 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] volume_name_template = volume-%s {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.281157 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] volume_service_inithost_offload = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.281762 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] volume_usage_audit_period = month {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.282387 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.282911 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] watch_log_file = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.283403 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] zoning_mode = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:41:05.283910 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dba0619b-f08b-458c-92ff-176255171545 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:41:05.284211 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.285227 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.285894 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_policy.enforce_new_defaults = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.286494 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_policy.enforce_scope = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.287112 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_policy.policy_default_rule = default {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.287886 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.288543 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_policy.policy_file = policy.yaml {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.289161 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.289755 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.290327 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.290902 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.291481 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.292731 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_concurrency.disable_process_locking = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.293321 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.293994 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.admin_password = **** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.294828 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.295387 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.admin_token = **** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.295952 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.admin_user = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.296573 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.auth_admin_prefix = {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.297174 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.297773 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.auth_port = 35357 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.298376 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.auth_protocol = https {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.299071 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.auth_section = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.299664 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.auth_type = password {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.300290 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.auth_uri = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.300926 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.auth_version = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.301484 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.cache = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.302066 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.302578 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.certfile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.302959 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.delay_auth_decision = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.303365 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.303721 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.http_connect_timeout = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.304082 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.304469 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.identity_uri = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.304825 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.include_service_catalog = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.305196 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.insecure = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.305579 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.interface = public {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.305931 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.keyfile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.306284 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.306900 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.307045 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.307589 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.307983 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.308363 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.308762 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.309120 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.309550 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.309905 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.region_name = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.310306 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.310677 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.service_token_roles_required = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.311025 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.service_type = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.311396 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.token_cache_time = 300 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.311767 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] keystone_authtoken.www_authenticate_uri = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.312222 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.backend = dogpile.cache.null {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.312644 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.backend_argument = **** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.313007 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.config_prefix = cache.oslo {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.313449 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.dead_timeout = 60.0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.313829 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.debug_cache_backend = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.314196 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.enable_retry_client = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.314542 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.enable_socket_keepalive = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.314915 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.enabled = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.315248 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.expiration_time = 600 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.315593 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.hashclient_retry_attempts = 2 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.315947 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.hashclient_retry_delay = 1.0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.316299 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.memcache_dead_retry = 300 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.317808 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.318399 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.318963 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.memcache_pool_maxsize = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.319528 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.320165 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.320796 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.memcache_socket_timeout = 1.0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.323008 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.proxies = [] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.323702 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.retry_attempts = 2 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.324289 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.retry_delay = 0.0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.324992 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.socket_keepalive_count = 1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.325564 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.socket_keepalive_idle = 1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.326155 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.socket_keepalive_interval = 1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.326754 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.tls_allowed_ciphers = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.327324 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.tls_cafile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.327893 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.tls_certfile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.328502 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.tls_enabled = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.329143 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cache.tls_keyfile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.329757 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] coordination.backend_url = etcd3+http://10.222.0.30:2379 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.330434 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.backend = sqlalchemy {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.330979 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.connection = **** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.333094 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.connection_debug = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.334514 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.connection_parameters = {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.335066 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.connection_recycle_time = 3600 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.335439 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.connection_trace = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.335822 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.db_inc_retry_interval = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.336179 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.db_max_retries = 20 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.336564 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.db_max_retry_interval = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.336919 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.db_retry_interval = 1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.337302 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.max_overflow = 50 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.337656 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.max_pool_size = 5 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.338232 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.max_retries = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.339279 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.mysql_enable_ndb = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.339822 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.340503 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.pool_timeout = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.341102 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.retry_interval = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.341660 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.slave_connection = **** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.342164 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.sqlite_synchronous = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.342671 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] database.use_db_reconnect = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.343219 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.343728 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.driver [None req-dba0619b-f08b-458c-92ff-176255171545 None None] Driver hasn't implemented _init_vendor_properties() Feb 19 20:41:05.343992 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.344554 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.345025 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.driver [None req-dba0619b-f08b-458c-92ff-176255171545 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:392969cf-2ceb-4da2-b64f-9f17646991cb:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129319) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:811}} Feb 19 20:41:05.345315 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.345842 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.346421 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] profiler.connection_string = messaging:// {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.346860 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] profiler.enabled = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.347378 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] profiler.es_doc_type = notification {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.347880 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] profiler.es_scroll_size = 10000 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.348450 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] profiler.es_scroll_time = 2m {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.348971 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] profiler.filter_error_trace = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.349478 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] profiler.hmac_keys = SECRET_KEY {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.349997 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] profiler.sentinel_service_name = mymaster {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.350515 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] profiler.socket_timeout = 0.1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.351008 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] profiler.trace_sqlalchemy = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.351590 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] privsep_osbrick.capabilities = [21] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.352109 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] privsep_osbrick.group = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.353221 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] privsep_osbrick.helper_command = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.353767 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.354275 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.355806 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] privsep_osbrick.user = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.356681 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.357741 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cinder_sys_admin.group = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.358276 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cinder_sys_admin.helper_command = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.359055 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.359606 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.360128 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] cinder_sys_admin.user = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.360897 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] service_user.auth_section = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.363587 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] service_user.auth_type = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.364058 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-dba0619b-f08b-458c-92ff-176255171545 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:41:05.364583 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] service_user.cafile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.365258 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] service_user.certfile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.365840 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] service_user.collect_timing = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.366383 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] service_user.insecure = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.367120 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] service_user.keyfile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.367671 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] service_user.send_service_user_token = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.368221 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] service_user.split_loggers = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.368791 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] service_user.timeout = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.369393 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.backend_availability_zone = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.369948 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.370577 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.371147 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.chap_password = **** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.371705 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.chap_username = {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.372251 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.372860 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.373393 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.373938 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.driver_client_cert = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.374478 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.driver_client_cert_key = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.375013 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.driver_data_namespace = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.375587 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.376126 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.376678 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.driver_use_ssl = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.377842 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.enable_deferred_deletion = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.378387 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.enable_unsupported_driver = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.378940 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.379494 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.extra_capabilities = {} {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.380017 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.filter_function = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.380680 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.goodness_function = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.381237 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.381785 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.382318 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.382845 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.383385 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.383924 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.384492 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.iscsi_iotype = fileio {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.385045 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.386270 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.iscsi_target_flags = {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.387397 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.iscsi_write_cache = on {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.387959 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.iser_helper = tgtadm {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.388716 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.iser_ip_address = 10.222.0.30 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.389280 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.iser_port = 3260 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.389838 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.390395 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.390953 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.391495 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.num_shell_tries = 3 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.392029 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.392586 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.393126 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.nvmet_port_id = 1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.393680 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.rados_connect_timeout = -1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.396109 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.rados_connection_interval = 5 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.396705 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.rados_connection_retries = 3 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.397290 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.rbd_ceph_conf = {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.397856 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.rbd_cluster_name = ceph {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.398407 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.398972 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.399524 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.400078 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.rbd_pool = rbd {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.400642 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.rbd_secret_uuid = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.401199 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.402099 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.rbd_user = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.402464 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.replication_connect_timeout = 5 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.402819 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.replication_device = **** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.403210 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.report_discard_supported = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.403571 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.403930 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.reserved_percentage = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.404295 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.scst_target_driver = iscsi {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.404898 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.scst_target_iqn_name = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.405423 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.storage_protocol = iscsi {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.405782 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.406151 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.target_helper = tgtadm {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.406657 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.target_ip_address = 10.222.0.30 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.407159 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.target_port = 3260 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.407650 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.407814 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.db.sqlalchemy.api [None req-dba0619b-f08b-458c-92ff-176255171545 None None] Building query based on filter {{(pid=129319) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3156}} Feb 19 20:41:05.408310 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.target_protocol = iscsi {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.409040 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.trace_flags = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.409535 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.unique_fqdn_network = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.410030 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.use_chap_auth = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.410516 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.411002 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.volume_backend_name = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.412204 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.volume_clear = zero {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.412746 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.volume_clear_ionice = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.413263 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.volume_clear_size = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.413761 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.414286 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.414653 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.415019 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.415493 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.415899 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_reports.file_event_handler = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.416286 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.416690 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_reports.log_dir = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.417117 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.backend_availability_zone = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.417473 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.backend_host = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.417822 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.backend_native_threads_pool_size = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.418170 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.backup_use_temp_snapshot = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.418539 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.chap_password = **** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.418879 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.chap_username = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.419490 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.chiscsi_conf = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.419838 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.deferred_deletion_delay = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.420188 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.deferred_deletion_purge_interval = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.421141 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.driver_client_cert = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.421639 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.driver_client_cert_key = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.422155 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.driver_data_namespace = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.422512 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.driver_ssl_cert_path = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.422866 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.driver_ssl_cert_verify = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.423216 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.driver_use_ssl = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.423562 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.enable_deferred_deletion = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.423901 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.enable_unsupported_driver = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.424424 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.427524 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.extra_capabilities = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.428078 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.filter_function = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.428642 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.goodness_function = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.429009 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.iet_conf = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.429566 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.image_upload_use_cinder_backend = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.429935 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.image_upload_use_internal_tenant = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.430318 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.image_volume_cache_enabled = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.430674 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.image_volume_cache_max_count = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.431028 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.image_volume_cache_max_size_gb = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.431378 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.iscsi_iotype = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.431727 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.432078 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.iscsi_target_flags = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.432473 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.iscsi_write_cache = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.432862 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.iser_helper = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.433075 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.image_utils [None req-dba0619b-f08b-458c-92ff-176255171545 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=129319) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Feb 19 20:41:05.433203 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.iser_ip_address = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.433708 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.iser_port = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.434203 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.iser_target_prefix = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.434708 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.max_over_subscription_ratio = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.435220 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.num_iser_scan_tries = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.435716 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.num_shell_tries = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.436430 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.num_volume_device_scan_tries = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.436927 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.nvmet_ns_id = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.437437 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.nvmet_port_id = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.437983 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.rados_connect_timeout = -1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.438336 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.rados_connection_interval = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.438686 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.rados_connection_retries = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.439053 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.439409 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.rbd_cluster_name = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.439760 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.440122 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.440519 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.rbd_max_clone_depth = 5 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.440898 ncdv-master-1 cinder-volume[129319]: INFO cinder.keymgr.migration [None req-40e94bf6-b83f-4c77-9c80-7abcc0073e8a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 19 20:41:05.441188 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.rbd_pool = volumes {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.441878 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.rbd_secret_uuid = 167b51cb-458c-4c19-8d8b-544fd33b1dfd {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.442250 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.rbd_store_chunk_size = 4 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.442614 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.rbd_user = cinder {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.442965 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.replication_connect_timeout = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.443317 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.replication_device = **** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.443664 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.report_discard_supported = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.444014 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.report_dynamic_total_capacity = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.445219 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.reserved_percentage = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.445219 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.scst_target_driver = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.445219 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.scst_target_iqn_name = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.445480 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.storage_protocol = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.445720 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.suppress_requests_ssl_warnings = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.446232 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.target_helper = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.446597 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.target_ip_address = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.447130 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.target_port = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.447654 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.target_prefix = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.448006 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.target_protocol = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.448925 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.trace_flags = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.449455 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.unique_fqdn_network = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.449950 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.use_chap_auth = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.450446 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.use_multipath_for_image_xfer = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.451017 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.volume_backend_name = ceph {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.451519 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.volume_clear = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.451792 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dba0619b-f08b-458c-92ff-176255171545 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:41:05.452039 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.volume_clear_ionice = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.452415 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.volume_clear_size = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.452770 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.453120 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.volume_copy_bps_limit = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.453468 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.volume_dd_blocksize = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.453868 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.454214 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ceph.volumes_dir = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.454809 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.455355 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.455748 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.456096 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.456509 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.456855 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.457226 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.457566 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.458084 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.458454 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.458820 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.459181 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.460037 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.460037 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.460276 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.461693 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.462837 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.463534 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.466399 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.467015 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.468668 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.469038 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.470191 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.ssl = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.470583 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.470964 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.471333 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.471694 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_rabbit.ssl_version = {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.472028 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_notifications.driver = [] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.473301 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_notifications.retry = -1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.473725 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.474097 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] oslo_messaging_notifications.transport_url = **** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.475052 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.475568 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] key_manager.fixed_key = **** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.476186 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.477651 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.barbican_api_version = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.478217 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.barbican_endpoint = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.478609 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.barbican_endpoint_type = public {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.478960 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.barbican_region_name = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.479320 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.cafile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.479703 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.certfile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.480067 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.collect_timing = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.481388 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.insecure = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.481912 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.keyfile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.482027 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dba0619b-f08b-458c-92ff-176255171545 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:41:05.483175 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.number_of_retries = 60 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.483704 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.retry_delay = 1 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.484059 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.send_service_user_token = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.484617 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.split_loggers = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.485118 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.timeout = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.485632 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.verify_ssl = True {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.485982 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican.verify_ssl_path = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.486346 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican_service_user.auth_section = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.486704 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican_service_user.auth_type = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.487051 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican_service_user.cafile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.487396 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican_service_user.certfile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.487745 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican_service_user.collect_timing = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.488095 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican_service_user.insecure = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.489350 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican_service_user.keyfile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.489350 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican_service_user.split_loggers = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.489350 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] barbican_service_user.timeout = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.489575 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.approle_role_id = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.489835 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.approle_secret_id = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.490355 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.cafile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.490701 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.certfile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.490701 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.collect_timing = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.490701 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.insecure = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.490701 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.keyfile = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.492168 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.kv_mountpoint = secret {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.492434 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.kv_version = 2 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.492943 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.namespace = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.493292 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.root_token_id = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.493639 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.split_loggers = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.494142 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.ssl_ca_crt_file = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.494482 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.timeout = None {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.494829 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.use_ssl = False {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.495228 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:41:05.495517 ncdv-master-1 cinder-volume[129145]: DEBUG oslo_service.service [None req-17043537-6e31-4a6e-944f-7b9ae3b6243b None None] ******************************************************************************** {{(pid=129145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 19 20:41:05.520375 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-dba0619b-f08b-458c-92ff-176255171545 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:41:05.549796 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-dba0619b-f08b-458c-92ff-176255171545 None None] Driver initialization completed successfully. Feb 19 20:41:05.559808 ncdv-master-1 cinder-volume[129319]: INFO cinder.manager [None req-dba0619b-f08b-458c-92ff-176255171545 None None] Initiating service 3 cleanup Feb 19 20:41:05.566045 ncdv-master-1 cinder-volume[129319]: INFO cinder.manager [None req-dba0619b-f08b-458c-92ff-176255171545 None None] Service 3 cleanup completed. Feb 19 20:41:05.566388 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.service [None req-dba0619b-f08b-458c-92ff-176255171545 None None] Creating RPC server for service cinder-volume {{(pid=129319) start /opt/stack/cinder/cinder/service.py:231}} Feb 19 20:41:05.572460 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.service [None req-dba0619b-f08b-458c-92ff-176255171545 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=129319) start /opt/stack/cinder/cinder/service.py:237}} Feb 19 20:41:05.632134 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-dba0619b-f08b-458c-92ff-176255171545 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Feb 19 20:41:05.633176 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dba0619b-f08b-458c-92ff-176255171545 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:41:05.658395 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dba0619b-f08b-458c-92ff-176255171545 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:41:05.711131 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-dba0619b-f08b-458c-92ff-176255171545 None None] Driver post RPC initialization completed successfully. Feb 19 20:42:21.714166 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:42:21.714946 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:42:21.739714 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:42:21.763175 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:43:21.718627 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:43:21.719287 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:43:21.743607 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:43:21.767005 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:44:21.722750 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:44:21.723432 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:44:21.746749 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:44:21.792164 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:45:21.719121 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:45:21.719767 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:45:21.740962 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:45:21.763401 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:46:21.718337 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:46:21.718991 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:46:21.742516 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:46:21.763317 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:47:21.717946 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:47:21.718585 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:47:21.741667 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:47:21.762554 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:48:21.717038 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:48:21.717690 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:48:21.739166 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:48:21.760462 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:49:21.715009 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:49:21.715643 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:49:21.736300 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:49:21.759278 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:50:21.714154 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:50:21.715656 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:50:21.786849 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:50:21.848915 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:51:21.714799 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:51:21.715446 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:51:21.766218 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:51:21.824060 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:52:21.718085 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:52:21.718774 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:52:21.846961 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:52:21.941891 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:52:35.455916 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 20:52:35.470064 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:52:35.482032 ncdv-master-1 cinder-volume[129319]: INFO cinder.rpc [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Feb 19 20:52:35.493062 ncdv-master-1 cinder-volume[129319]: INFO cinder.rpc [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Feb 19 20:52:35.494564 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:52:35.495370 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:52:35.543561 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Flow 'volume_create_manager' (f8b81d75-339e-481e-b844-9f67173fb5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:52:35.550402 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bf2a88-edc1-4ddb-ad1d-ed26136636fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:52:35.558861 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:52:35.611790 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bf2a88-edc1-4ddb-ad1d-ed26136636fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T20:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1986926884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=03b5535c-cf30-4b6c-9466-5ea912a33e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0981190244846a18036aa20dce2dc60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T20:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T20:52:35Z,use_quota=True,user_id='72ce9a80c4b444259dda1f6a63e6fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:52:35.617828 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e0b04b-4d87-4112-962d-4c62832eceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:52:35.622039 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e0b04b-4d87-4112-962d-4c62832eceb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:52:35.627626 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f93663-b904-4eec-bae8-6f51b888b528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:52:35.791609 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f93663-b904-4eec-bae8-6f51b888b528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '03b5535c-cf30-4b6c-9466-5ea912a33e71', 'volume_name': 'volume-03b5535c-cf30-4b6c-9466-5ea912a33e71', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:52:35.799225 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6996bd3-3a96-490a-baf7-28498d14f267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:52:35.814913 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6996bd3-3a96-490a-baf7-28498d14f267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:52:35.831107 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca1bd6a-5212-4ea5-90a5-916b4534f417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:52:35.832473 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume 03b5535c-cf30-4b6c-9466-5ea912a33e71: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-03b5535c-cf30-4b6c-9466-5ea912a33e71', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 20:52:35.833088 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Cloning 03b5535c-cf30-4b6c-9466-5ea912a33e71 from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 20:52:35.857401 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.021s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:52:35.869337 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Preparing cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Feb 19 20:52:35.870654 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 20:52:49.450517 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 20:52:49.454830 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:52:49.455345 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:52:49.475500 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Flow 'volume_create_manager' (589dea0b-57e9-49ef-aed3-ab243a59fc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:52:49.481986 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5aa27f3-2b59-4c29-bbac-4487ac054e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:52:49.491671 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:52:49.507420 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5aa27f3-2b59-4c29-bbac-4487ac054e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T20:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-2075909756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b9fcd7d0-8aeb-4999-b678-f46415ddf214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76afd67dfef14c3db64ccbd812036427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T20:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T20:52:49Z,use_quota=True,user_id='08781c2dd21c4011b5eebde0436042c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:52:49.512766 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f210d79f-4490-496c-ad1f-c78a54dc0b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:52:49.516854 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f210d79f-4490-496c-ad1f-c78a54dc0b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:52:49.522009 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2278b16-1869-4e37-be5a-444e6764432f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:52:49.526089 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2278b16-1869-4e37-be5a-444e6764432f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9fcd7d0-8aeb-4999-b678-f46415ddf214', 'volume_name': 'volume-b9fcd7d0-8aeb-4999-b678-f46415ddf214', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:52:49.531035 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2146ae7-14b4-4777-9f95-d3aadce3e4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:52:49.535114 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2146ae7-14b4-4777-9f95-d3aadce3e4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:52:49.539838 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b4d341-03c5-4695-9814-f377e21fdc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:52:49.540928 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Volume b9fcd7d0-8aeb-4999-b678-f46415ddf214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9fcd7d0-8aeb-4999-b678-f46415ddf214', 'volume_size': 1} Feb 19 20:52:49.541350 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] creating volume 'volume-b9fcd7d0-8aeb-4999-b678-f46415ddf214' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 20:52:49.542353 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:52:49.707700 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 20:52:49.708135 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 20:52:49.713293 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b4d341-03c5-4695-9814-f377e21fdc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9fcd7d0-8aeb-4999-b678-f46415ddf214', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:52:49.718005 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ce98e6-9681-44e5-ade5-d4238913fb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:52:49.751191 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Volume volume-b9fcd7d0-8aeb-4999-b678-f46415ddf214 (b9fcd7d0-8aeb-4999-b678-f46415ddf214): created successfully Feb 19 20:52:49.756371 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ce98e6-9681-44e5-ade5-d4238913fb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:52:49.769429 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Flow 'volume_create_manager' (589dea0b-57e9-49ef-aed3-ab243a59fc0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:52:49.782141 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-5b5cc842-0c7f-453f-b675-6145caaebcfd tempest-AttachSCSIVolumeTestJSON-1784177744 None] Created volume successfully. Feb 19 20:52:51.714348 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-189c00b1-cce2-4102-bf0d-65e70def25d7 req-0fc5fff3-9d53-47fd-8ede-338034b2234d tempest-AttachSCSIVolumeTestJSON-1784177744 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:52:52.779895 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-189c00b1-cce2-4102-bf0d-65e70def25d7 req-0fc5fff3-9d53-47fd-8ede-338034b2234d tempest-AttachSCSIVolumeTestJSON-1784177744 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.065s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:52:52.780758 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-189c00b1-cce2-4102-bf0d-65e70def25d7 req-0fc5fff3-9d53-47fd-8ede-338034b2234d tempest-AttachSCSIVolumeTestJSON-1784177744 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b9fcd7d0-8aeb-4999-b678-f46415ddf214', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'b9fcd7d0-8aeb-4999-b678-f46415ddf214', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 20:52:52.836600 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-189c00b1-cce2-4102-bf0d-65e70def25d7 req-0fc5fff3-9d53-47fd-8ede-338034b2234d tempest-AttachSCSIVolumeTestJSON-1784177744 None] Connection info returned from driver {'name': 'volumes/volume-b9fcd7d0-8aeb-4999-b678-f46415ddf214', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b9fcd7d0-8aeb-4999-b678-f46415ddf214', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b07a133b-344c-471a-9104-3ef08ac4c6f3'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 20:52:52.929290 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-189c00b1-cce2-4102-bf0d-65e70def25d7 req-0fc5fff3-9d53-47fd-8ede-338034b2234d tempest-AttachSCSIVolumeTestJSON-1784177744 None] attachment_update completed successfully. Feb 19 20:52:53.146593 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.image_utils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph, size 616.00 MB, duration 17.27 sec {{(pid=129319) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Feb 19 20:52:53.147484 ncdv-master-1 cinder-volume[129319]: INFO cinder.image.image_utils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Image download 616.00 MB at 35.67 MB/s Feb 19 20:52:53.194142 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:52:53.393962 ncdv-master-1 sudo[139628]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph Feb 19 20:52:53.394984 ncdv-master-1 sudo[139628]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 19 20:52:54.741200 ncdv-master-1 sudo[139628]: pam_unix(sudo:session): session closed for user root Feb 19 20:52:54.743396 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph" returned: 0 in 1.549s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:52:54.755550 ncdv-master-1 cinder-volume[129319]: WARNING py.warnings [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Feb 19 20:52:54.755550 ncdv-master-1 cinder-volume[129319]: debtcollector.deprecate( Feb 19 20:52:54.755550 ncdv-master-1 cinder-volume[129319]: Feb 19 20:52:54.756753 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.image_utils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Temporary image f75529b9-2911-475e-b974-4af06053c17c is fetched for user 72ce9a80c4b444259dda1f6a63e6fe49. {{(pid=129319) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Feb 19 20:52:54.834273 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:52:54.928199 ncdv-master-1 sudo[139640]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph Feb 19 20:52:54.929270 ncdv-master-1 sudo[139640]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 19 20:52:56.123778 ncdv-master-1 sudo[139640]: pam_unix(sudo:session): session closed for user root Feb 19 20:52:56.125936 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph" returned: 0 in 1.292s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:52:56.126798 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] creating volume 'volume-03b5535c-cf30-4b6c-9466-5ea912a33e71' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 20:52:56.127786 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:52:56.209973 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 20:52:56.210657 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 20:52:56.232973 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Attempting download of f75529b9-2911-475e-b974-4af06053c17c ((None, None)) to volume 03b5535c-cf30-4b6c-9466-5ea912a33e71. {{(pid=129319) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 19 20:52:56.275116 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_f75529b9-2911-475e-b974-4af06053c17c_uv0knwo8 {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:52:56.370852 ncdv-master-1 sudo[139671]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_f75529b9-2911-475e-b974-4af06053c17c_uv0knwo8 Feb 19 20:52:56.371655 ncdv-master-1 sudo[139671]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 19 20:52:57.517326 ncdv-master-1 sudo[139671]: pam_unix(sudo:session): session closed for user root Feb 19 20:52:57.519511 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_f75529b9-2911-475e-b974-4af06053c17c_uv0knwo8" returned: 0 in 1.244s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:52:57.521445 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:52:57.613603 ncdv-master-1 sudo[139678]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph Feb 19 20:52:57.614925 ncdv-master-1 sudo[139678]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 19 20:52:59.007981 ncdv-master-1 sudo[139678]: pam_unix(sudo:session): session closed for user root Feb 19 20:52:59.010173 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph" returned: 0 in 1.489s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:52:59.012116 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.image_utils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] f75529b9-2911-475e-b974-4af06053c17c was vhdx, converting to raw {{(pid=129319) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Feb 19 20:52:59.013029 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmprrrfouvn {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:52:59.035657 ncdv-master-1 sudo[139698]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmprrrfouvn Feb 19 20:52:59.037451 ncdv-master-1 sudo[139698]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 19 20:53:01.953802 ncdv-master-1 sudo[139698]: pam_unix(sudo:session): session closed for user root Feb 19 20:53:01.955921 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmprrrfouvn" returned: 0 in 2.943s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:53:01.958609 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:53:02.181441 ncdv-master-1 sudo[139752]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph Feb 19 20:53:02.182401 ncdv-master-1 sudo[139752]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 19 20:53:03.636492 ncdv-master-1 sudo[139752]: pam_unix(sudo:session): session closed for user root Feb 19 20:53:03.638688 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph" returned: 0 in 1.681s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:53:03.640036 ncdv-master-1 cinder-volume[129319]: WARNING py.warnings [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Feb 19 20:53:03.640036 ncdv-master-1 cinder-volume[129319]: debtcollector.deprecate( Feb 19 20:53:03.640036 ncdv-master-1 cinder-volume[129319]: Feb 19 20:53:03.640700 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.image_utils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f75529b9-2911-475e-b974-4af06053c17c_m0xvx3rbncdv-master-1@ceph, size 700.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/conversion/tmprrrfouvn {{(pid=129319) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Feb 19 20:53:03.641069 ncdv-master-1 cinder-volume[129319]: INFO cinder.image.image_utils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Converted 700.00 MB image at 237.70 MB/s Feb 19 20:53:03.642501 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:53:03.745970 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 20:53:03.751104 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 20:53:03.767933 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] deleting rbd volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 20:53:04.012045 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmprrrfouvn volume-03b5535c-cf30-4b6c-9466-5ea912a33e71 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:53:04.046724 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-2823c641-d0e3-4632-85e6-997f65701adc req-bd8d6bbc-4f77-4300-8d18-21f61ba2889c tempest-AttachSCSIVolumeTestJSON-1784177744 None] Terminate volume connection completed successfully. Feb 19 20:53:04.047330 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-2823c641-d0e3-4632-85e6-997f65701adc req-bd8d6bbc-4f77-4300-8d18-21f61ba2889c tempest-AttachSCSIVolumeTestJSON-1784177744 None] Deleting attachment b07a133b-344c-471a-9104-3ef08ac4c6f3. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 20:53:08.628183 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmprrrfouvn volume-03b5535c-cf30-4b6c-9466-5ea912a33e71 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 4.617s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:53:08.753889 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:53:08.843410 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 20:53:08.843792 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 20:53:08.844255 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Downloaded image f75529b9-2911-475e-b974-4af06053c17c ((None, None)) to volume 03b5535c-cf30-4b6c-9466-5ea912a33e71 successfully. {{(pid=129319) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1218}} Feb 19 20:53:08.929530 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.image_utils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Temporary image f75529b9-2911-475e-b974-4af06053c17c for user 72ce9a80c4b444259dda1f6a63e6fe49 is deleted. {{(pid=129319) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Feb 19 20:53:08.977840 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Feb 19 20:53:08.978836 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Feb 19 20:53:09.049544 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Created reservations ['d57b8c4e-3b86-472a-9dcf-7f727211d1f1', '392b0406-8b6b-43e5-8320-65b85d22068f', '07a81fd6-9c99-40bd-ac7b-a7c2c9c092d2', '628daf27-a92c-4ae7-8f73-6f0c3673d36d'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 20:53:09.059577 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Creating image volume entry: {'volume_admin_metadata': [], 'provider_geometry': None, 'encryption_key_id': None, 'created_at': datetime.datetime(2022, 2, 19, 20, 52, 35, tzinfo=datetime.timezone.utc), 'size': 1, 'terminated_at': None, 'updated_at': datetime.datetime(2022, 2, 19, 20, 52, 35, tzinfo=datetime.timezone.utc), 'deleted': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'replication_driver_data': None, 'deleted_at': None, 'launched_at': None, 'ec2_id': None, 'previous_status': None, 'multiattach': False, 'shared_targets': True, 'display_name': 'image-f75529b9-2911-475e-b974-4af06053c17c', 'cluster_name': None, 'display_description': None, 'project_id': '676e84132178466da2cf0c656f99ebd2', 'availability_zone': 'nova', 'volume_type_id': '6b3959e0-7862-44bf-8d0e-18095bf7c9d3', 'provider_auth': None, 'replication_extended_status': None, 'scheduled_at': datetime.datetime(2022, 2, 19, 20, 52, 35, tzinfo=datetime.timezone.utc), 'volume_metadata': [], 'metadata': {}, 'provider_location': None, 'bootable': False, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'consistencygroup_id': None, 'provider_id': None, 'host': 'ncdv-master-1@ceph#ceph', 'group_id': None, 'service_uuid': None, 'replication_status': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '03b5535c-cf30-4b6c-9466-5ea912a33e71'}. {{(pid=129319) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1616}} Feb 19 20:53:09.119126 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume reschedule parameters: False retry: None {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 20:53:09.122723 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:53:09.123210 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:53:09.143313 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Flow 'volume_create_manager' (888015c0-07fd-405d-b581-3a425ae9c289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:53:09.149929 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1ac907-7245-4dd5-9a17-e71f6c5fee59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:09.156746 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:53:09.172560 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1ac907-7245-4dd5-9a17-e71f6c5fee59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T20:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='image-f75529b9-2911-475e-b974-4af06053c17c',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d609c16c-1e31-4237-8163-d85a8fcc768b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676e84132178466da2cf0c656f99ebd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T20:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=03b5535c-cf30-4b6c-9466-5ea912a33e71,status='creating',terminated_at=None,updated_at=2022-02-19T20:52:35Z,use_quota=True,user_id='72ce9a80c4b444259dda1f6a63e6fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:09.178873 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be5af37-3cc8-4799-90ac-0fa7de540da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:09.183042 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be5af37-3cc8-4799-90ac-0fa7de540da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:09.188193 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1dc38b6-fdd2-4c08-b2e5-351a5eda9f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:09.202826 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1dc38b6-fdd2-4c08-b2e5-351a5eda9f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'volume_name': 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b', 'volume_size': 1, 'source_volid': '03b5535c-cf30-4b6c-9466-5ea912a33e71', 'source_volstatus': 'downloading'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:09.207934 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1528f4-7012-4ba3-830a-16bb284a8c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:09.212005 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1528f4-7012-4ba3-830a-16bb284a8c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:09.216848 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d0b95e-bfd4-4f82-a9bf-371792470823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:09.217869 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume d609c16c-1e31-4237-8163-d85a8fcc768b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b', 'volume_size': 1, 'source_volid': '03b5535c-cf30-4b6c-9466-5ea912a33e71', 'source_volstatus': 'downloading'} Feb 19 20:53:09.229466 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:53:09.268473 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] creating snapshot='volume-d609c16c-1e31-4237-8163-d85a8fcc768b.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 20:53:09.622391 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] cloning 'volume-03b5535c-cf30-4b6c-9466-5ea912a33e71@volume-d609c16c-1e31-4237-8163-d85a8fcc768b.clone_snap' to 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 20:53:09.737420 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 20:53:09.738569 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 20:53:09.738955 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 20:53:09.756906 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 20:53:09.760719 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d0b95e-bfd4-4f82-a9bf-371792470823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b', 'volume_size': 1, 'source_volid': '03b5535c-cf30-4b6c-9466-5ea912a33e71', 'source_volstatus': 'downloading'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:09.765524 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984c1011-0bf3-4429-ac0c-3524a89188c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:09.774408 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume volume-d609c16c-1e31-4237-8163-d85a8fcc768b (d609c16c-1e31-4237-8163-d85a8fcc768b): created successfully Feb 19 20:53:09.778279 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984c1011-0bf3-4429-ac0c-3524a89188c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:09.783689 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Flow 'volume_create_manager' (888015c0-07fd-405d-b581-3a425ae9c289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:53:09.792151 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Created volume successfully. Feb 19 20:53:09.823600 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Creating new image-volume cache entry for image f75529b9-2911-475e-b974-4af06053c17c on ncdv-master-1@ceph#ceph {{(pid=129319) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Feb 19 20:53:09.831025 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] New image-volume cache entry created: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 20, 53, 9, 826223)}. {{(pid=129319) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Feb 19 20:53:09.835816 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 33.981s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 20:53:09.836391 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Marking volume 03b5535c-cf30-4b6c-9466-5ea912a33e71 as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 20:53:09.846016 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to 03b5535c-cf30-4b6c-9466-5ea912a33e71. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 20:53:09.846531 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Creating volume glance metadata for volume 03b5535c-cf30-4b6c-9466-5ea912a33e71 backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 20:53:09.924554 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca1bd6a-5212-4ea5-90a5-916b4534f417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b5535c-cf30-4b6c-9466-5ea912a33e71', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:09.929558 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f905bc00-a170-4a94-93b1-ce5bed1acbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:09.938204 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71 (03b5535c-cf30-4b6c-9466-5ea912a33e71): created successfully Feb 19 20:53:09.941897 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f905bc00-a170-4a94-93b1-ce5bed1acbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:09.948046 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Flow 'volume_create_manager' (f8b81d75-339e-481e-b844-9f67173fb5ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:53:09.955851 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-373ee200-6122-4964-924b-32da75506b1d tempest-TaggedBootDevicesTest_v242-1053603382 None] Created volume successfully. Feb 19 20:53:10.834382 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 20:53:10.838596 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:53:10.839046 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:53:10.859076 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Flow 'volume_create_manager' (ee62ac3b-5f0a-45ef-862e-0d5011f9387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:53:10.866419 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b5aaca-97c9-4b6f-8cfb-8b3a57c3541b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:10.873197 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:53:10.890831 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b5aaca-97c9-4b6f-8cfb-8b3a57c3541b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T20:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1140838218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=91cde230-36d5-44fb-bc24-28cbcdf3779b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0981190244846a18036aa20dce2dc60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T20:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T20:53:11Z,use_quota=True,user_id='72ce9a80c4b444259dda1f6a63e6fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:10.897179 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60dfe114-9a1e-4295-b336-e65347a796c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:10.902351 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60dfe114-9a1e-4295-b336-e65347a796c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:10.908078 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9def8e49-662b-4089-a4be-9f6edbba1513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:10.913038 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9def8e49-662b-4089-a4be-9f6edbba1513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91cde230-36d5-44fb-bc24-28cbcdf3779b', 'volume_name': 'volume-91cde230-36d5-44fb-bc24-28cbcdf3779b', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:10.918183 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75baadb5-babd-465c-9626-4c7d3c616464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:10.922143 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75baadb5-babd-465c-9626-4c7d3c616464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:10.926938 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51f1ed8-4359-4aad-8fd6-b51a9dac7300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:10.928115 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume 91cde230-36d5-44fb-bc24-28cbcdf3779b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91cde230-36d5-44fb-bc24-28cbcdf3779b', 'volume_size': 1} Feb 19 20:53:10.928533 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] creating volume 'volume-91cde230-36d5-44fb-bc24-28cbcdf3779b' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 20:53:10.929876 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:53:11.021302 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 20:53:11.022552 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 20:53:11.026399 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51f1ed8-4359-4aad-8fd6-b51a9dac7300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91cde230-36d5-44fb-bc24-28cbcdf3779b', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:11.031714 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c48fb12-f3e7-40e6-a832-4c6940735c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:11.044474 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume volume-91cde230-36d5-44fb-bc24-28cbcdf3779b (91cde230-36d5-44fb-bc24-28cbcdf3779b): created successfully Feb 19 20:53:11.048873 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c48fb12-f3e7-40e6-a832-4c6940735c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:11.058017 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Flow 'volume_create_manager' (ee62ac3b-5f0a-45ef-862e-0d5011f9387a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:53:11.068799 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-c310f323-d637-40b3-8fe1-611daa18f7ee tempest-TaggedBootDevicesTest_v242-1053603382 None] Created volume successfully. Feb 19 20:53:12.145608 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 20:53:12.149078 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:53:12.149521 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:53:12.169484 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Flow 'volume_create_manager' (f44ed6db-01c2-4046-aa60-7d73bcd846e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:53:12.175817 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef15b04-99a6-4ba6-b446-324a48406f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:12.183282 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:53:12.198306 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef15b04-99a6-4ba6-b446-324a48406f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T20:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-410760069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e724d0d7-1022-4767-910f-d215fc344365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0981190244846a18036aa20dce2dc60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T20:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T20:53:12Z,use_quota=True,user_id='72ce9a80c4b444259dda1f6a63e6fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:12.203648 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca17b4b-c06c-401f-b727-ec58233a4aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:12.207786 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca17b4b-c06c-401f-b727-ec58233a4aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:12.213493 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ae870a-e9aa-4a27-af83-ab158c8772e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:12.217714 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ae870a-e9aa-4a27-af83-ab158c8772e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e724d0d7-1022-4767-910f-d215fc344365', 'volume_name': 'volume-e724d0d7-1022-4767-910f-d215fc344365', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:12.222616 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f70098-70dc-438c-a00d-8211842d5011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:12.227141 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f70098-70dc-438c-a00d-8211842d5011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:12.232062 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ce4058-409a-4ffa-8df3-e2a594ba473b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:12.233191 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume e724d0d7-1022-4767-910f-d215fc344365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e724d0d7-1022-4767-910f-d215fc344365', 'volume_size': 1} Feb 19 20:53:12.233581 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] creating volume 'volume-e724d0d7-1022-4767-910f-d215fc344365' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 20:53:12.234657 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:53:12.315652 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 20:53:12.316034 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 20:53:12.319877 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ce4058-409a-4ffa-8df3-e2a594ba473b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e724d0d7-1022-4767-910f-d215fc344365', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:12.324712 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8b7d54-4299-402c-802f-9182ac7ad0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:12.333674 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume volume-e724d0d7-1022-4767-910f-d215fc344365 (e724d0d7-1022-4767-910f-d215fc344365): created successfully Feb 19 20:53:12.337645 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8b7d54-4299-402c-802f-9182ac7ad0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:12.344418 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Flow 'volume_create_manager' (f44ed6db-01c2-4046-aa60-7d73bcd846e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:53:12.354935 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-050fbc53-83b3-4cdc-8047-67fd20729794 tempest-TaggedBootDevicesTest_v242-1053603382 None] Created volume successfully. Feb 19 20:53:16.500789 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-42ef67f8-8421-403b-9fd5-f538249f3ded tempest-AttachSCSIVolumeTestJSON-1784177744 None] Lock "b'cinder-b9fcd7d0-8aeb-4999-b678-f46415ddf214-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:53:16.602120 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-42ef67f8-8421-403b-9fd5-f538249f3ded tempest-AttachSCSIVolumeTestJSON-1784177744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:53:16.708263 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-42ef67f8-8421-403b-9fd5-f538249f3ded tempest-AttachSCSIVolumeTestJSON-1784177744 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 20:53:16.708917 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-42ef67f8-8421-403b-9fd5-f538249f3ded tempest-AttachSCSIVolumeTestJSON-1784177744 None] Volume volume-b9fcd7d0-8aeb-4999-b678-f46415ddf214 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 20:53:16.737587 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-42ef67f8-8421-403b-9fd5-f538249f3ded tempest-AttachSCSIVolumeTestJSON-1784177744 None] deleting rbd volume volume-b9fcd7d0-8aeb-4999-b678-f46415ddf214 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 20:53:17.481822 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-42ef67f8-8421-403b-9fd5-f538249f3ded tempest-AttachSCSIVolumeTestJSON-1784177744 None] Created reservations ['7d0b193f-d560-467c-ace9-2a32f34ef18a', 'b04a77d2-24cb-4d81-8193-b6160fae48eb', '3b4f02f0-210b-4d84-8857-2928d1005968', 'b2a5b2a8-8c4b-4324-9d59-9b4d42e45281'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 20:53:17.637305 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-42ef67f8-8421-403b-9fd5-f538249f3ded tempest-AttachSCSIVolumeTestJSON-1784177744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:53:17.699098 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-42ef67f8-8421-403b-9fd5-f538249f3ded tempest-AttachSCSIVolumeTestJSON-1784177744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:53:17.770074 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-42ef67f8-8421-403b-9fd5-f538249f3ded tempest-AttachSCSIVolumeTestJSON-1784177744 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:53:17.775462 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-42ef67f8-8421-403b-9fd5-f538249f3ded tempest-AttachSCSIVolumeTestJSON-1784177744 None] Deleted volume successfully. Feb 19 20:53:17.799978 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-42ef67f8-8421-403b-9fd5-f538249f3ded tempest-AttachSCSIVolumeTestJSON-1784177744 None] Lock "b'cinder-b9fcd7d0-8aeb-4999-b678-f46415ddf214-delete_volume'" released by "delete_volume" :: held 1.301s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 20:53:19.587040 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 20:53:19.603992 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:53:19.604481 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:53:19.671988 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Flow 'volume_create_manager' (96fd3610-8db7-448a-b435-34f8edf475ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:53:19.705688 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91e424c-0c00-43a6-a68a-b69368036e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:19.713546 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:53:19.738882 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91e424c-0c00-43a6-a68a-b69368036e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T20:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-662896903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=39ca1219-a5f8-409e-8ab8-06e2e1d77c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f02f88286b49babe665db9d00787a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T20:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T20:53:20Z,use_quota=True,user_id='ec1a2a2db19c41cca4342aa082770a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:19.756664 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bdf402a-dbda-4387-8540-c38ceca111a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:19.763951 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bdf402a-dbda-4387-8540-c38ceca111a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:19.785073 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7edc556-936b-4935-b4d0-c0531ab719fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:19.791093 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7edc556-936b-4935-b4d0-c0531ab719fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39ca1219-a5f8-409e-8ab8-06e2e1d77c8c', 'volume_name': 'volume-39ca1219-a5f8-409e-8ab8-06e2e1d77c8c', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:19.796529 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8331dc5-2bdf-43b8-aa83-191975bc5bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:19.801000 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8331dc5-2bdf-43b8-aa83-191975bc5bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:19.807920 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f7af78-c41e-4f89-8d2d-97626553b0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:19.809316 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Volume 39ca1219-a5f8-409e-8ab8-06e2e1d77c8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39ca1219-a5f8-409e-8ab8-06e2e1d77c8c', 'volume_size': 1} Feb 19 20:53:19.810053 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] creating volume 'volume-39ca1219-a5f8-409e-8ab8-06e2e1d77c8c' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 20:53:19.811300 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:53:19.911936 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 20:53:19.912323 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 20:53:19.918028 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f7af78-c41e-4f89-8d2d-97626553b0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39ca1219-a5f8-409e-8ab8-06e2e1d77c8c', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:19.924904 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f783e75a-0c55-411a-8333-16ad02d05355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:53:19.947064 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Volume volume-39ca1219-a5f8-409e-8ab8-06e2e1d77c8c (39ca1219-a5f8-409e-8ab8-06e2e1d77c8c): created successfully Feb 19 20:53:19.952192 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f783e75a-0c55-411a-8333-16ad02d05355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:53:19.959905 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Flow 'volume_create_manager' (96fd3610-8db7-448a-b435-34f8edf475ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:53:19.977936 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d5b37483-2bf0-4d60-b274-82b9ab6db616 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Created volume successfully. Feb 19 20:53:21.255983 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-916a3ab8-0225-4cb7-86ba-77fde7211240 req-4a16ae50-7905-40fd-93c5-0809647addac tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:53:21.717618 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:53:21.719450 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:53:21.793568 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:53:21.858182 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:53:21.937596 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-916a3ab8-0225-4cb7-86ba-77fde7211240 req-4a16ae50-7905-40fd-93c5-0809647addac tempest-LiveAutoBlockMigrationV225Test-1806086406 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.681s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:53:21.937971 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-916a3ab8-0225-4cb7-86ba-77fde7211240 req-4a16ae50-7905-40fd-93c5-0809647addac tempest-LiveAutoBlockMigrationV225Test-1806086406 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-39ca1219-a5f8-409e-8ab8-06e2e1d77c8c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '39ca1219-a5f8-409e-8ab8-06e2e1d77c8c', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 20:53:21.961294 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-916a3ab8-0225-4cb7-86ba-77fde7211240 req-4a16ae50-7905-40fd-93c5-0809647addac tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Connection info returned from driver {'name': 'volumes/volume-39ca1219-a5f8-409e-8ab8-06e2e1d77c8c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '39ca1219-a5f8-409e-8ab8-06e2e1d77c8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '806cba1e-a151-4fa4-b13a-d9c089efa6fe'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 20:53:22.012669 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-916a3ab8-0225-4cb7-86ba-77fde7211240 req-4a16ae50-7905-40fd-93c5-0809647addac tempest-LiveAutoBlockMigrationV225Test-1806086406 None] attachment_update completed successfully. Feb 19 20:53:30.267889 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-962e1745-2bb2-43c3-8b6f-69adae2ac70a req-77a7556c-7e09-46ff-be9a-45f5e19fc7ca tempest-TaggedBootDevicesTest_v242-1053603382 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:53:30.961146 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-962e1745-2bb2-43c3-8b6f-69adae2ac70a req-77a7556c-7e09-46ff-be9a-45f5e19fc7ca tempest-TaggedBootDevicesTest_v242-1053603382 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.693s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:53:30.961994 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-962e1745-2bb2-43c3-8b6f-69adae2ac70a req-77a7556c-7e09-46ff-be9a-45f5e19fc7ca tempest-TaggedBootDevicesTest_v242-1053603382 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-03b5535c-cf30-4b6c-9466-5ea912a33e71', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '03b5535c-cf30-4b6c-9466-5ea912a33e71', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 20:53:30.985961 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-962e1745-2bb2-43c3-8b6f-69adae2ac70a req-77a7556c-7e09-46ff-be9a-45f5e19fc7ca tempest-TaggedBootDevicesTest_v242-1053603382 None] Connection info returned from driver {'name': 'volumes/volume-03b5535c-cf30-4b6c-9466-5ea912a33e71', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '03b5535c-cf30-4b6c-9466-5ea912a33e71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1a0f5a6d-17f7-4159-9833-d2d8a5084d65'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 20:53:31.039028 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-962e1745-2bb2-43c3-8b6f-69adae2ac70a req-77a7556c-7e09-46ff-be9a-45f5e19fc7ca tempest-TaggedBootDevicesTest_v242-1053603382 None] attachment_update completed successfully. Feb 19 20:53:31.382253 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-962e1745-2bb2-43c3-8b6f-69adae2ac70a req-bbc4c1ce-84f6-4b4b-a0d0-7dbaf17d1aeb tempest-TaggedBootDevicesTest_v242-1053603382 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:53:32.321933 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-962e1745-2bb2-43c3-8b6f-69adae2ac70a req-bbc4c1ce-84f6-4b4b-a0d0-7dbaf17d1aeb tempest-TaggedBootDevicesTest_v242-1053603382 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.941s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:53:32.323102 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-962e1745-2bb2-43c3-8b6f-69adae2ac70a req-bbc4c1ce-84f6-4b4b-a0d0-7dbaf17d1aeb tempest-TaggedBootDevicesTest_v242-1053603382 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-91cde230-36d5-44fb-bc24-28cbcdf3779b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '91cde230-36d5-44fb-bc24-28cbcdf3779b', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 20:53:32.350429 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-962e1745-2bb2-43c3-8b6f-69adae2ac70a req-bbc4c1ce-84f6-4b4b-a0d0-7dbaf17d1aeb tempest-TaggedBootDevicesTest_v242-1053603382 None] Connection info returned from driver {'name': 'volumes/volume-91cde230-36d5-44fb-bc24-28cbcdf3779b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '91cde230-36d5-44fb-bc24-28cbcdf3779b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '53075476-ff47-4a2e-9e8c-022a8397c850'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 20:53:32.431517 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-962e1745-2bb2-43c3-8b6f-69adae2ac70a req-bbc4c1ce-84f6-4b4b-a0d0-7dbaf17d1aeb tempest-TaggedBootDevicesTest_v242-1053603382 None] attachment_update completed successfully. Feb 19 20:53:32.869012 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-962e1745-2bb2-43c3-8b6f-69adae2ac70a req-3fd688cd-5043-4f63-a141-47584d26225d tempest-TaggedBootDevicesTest_v242-1053603382 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:53:33.840643 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-962e1745-2bb2-43c3-8b6f-69adae2ac70a req-3fd688cd-5043-4f63-a141-47584d26225d tempest-TaggedBootDevicesTest_v242-1053603382 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.971s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:53:33.841414 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-962e1745-2bb2-43c3-8b6f-69adae2ac70a req-3fd688cd-5043-4f63-a141-47584d26225d tempest-TaggedBootDevicesTest_v242-1053603382 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e724d0d7-1022-4767-910f-d215fc344365', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'e724d0d7-1022-4767-910f-d215fc344365', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 20:53:33.897957 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-962e1745-2bb2-43c3-8b6f-69adae2ac70a req-3fd688cd-5043-4f63-a141-47584d26225d tempest-TaggedBootDevicesTest_v242-1053603382 None] Connection info returned from driver {'name': 'volumes/volume-e724d0d7-1022-4767-910f-d215fc344365', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e724d0d7-1022-4767-910f-d215fc344365', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '79198d45-186f-479f-ab68-82ac0485c391'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 20:53:33.962115 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-962e1745-2bb2-43c3-8b6f-69adae2ac70a req-3fd688cd-5043-4f63-a141-47584d26225d tempest-TaggedBootDevicesTest_v242-1053603382 None] attachment_update completed successfully. Feb 19 20:53:34.249740 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-ff6ee662-966b-4c10-b860-0cf2b7503897 req-98203471-26e5-4e02-8e97-f2a718ed709b tempest-LiveAutoBlockMigrationV225Test-579170983 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:53:35.015832 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-ff6ee662-966b-4c10-b860-0cf2b7503897 req-98203471-26e5-4e02-8e97-f2a718ed709b tempest-LiveAutoBlockMigrationV225Test-579170983 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.767s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:53:35.016923 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-ff6ee662-966b-4c10-b860-0cf2b7503897 req-98203471-26e5-4e02-8e97-f2a718ed709b tempest-LiveAutoBlockMigrationV225Test-579170983 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-39ca1219-a5f8-409e-8ab8-06e2e1d77c8c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '39ca1219-a5f8-409e-8ab8-06e2e1d77c8c', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 20:53:35.041475 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-ff6ee662-966b-4c10-b860-0cf2b7503897 req-98203471-26e5-4e02-8e97-f2a718ed709b tempest-LiveAutoBlockMigrationV225Test-579170983 None] Connection info returned from driver {'name': 'volumes/volume-39ca1219-a5f8-409e-8ab8-06e2e1d77c8c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '39ca1219-a5f8-409e-8ab8-06e2e1d77c8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ec679066-13af-4656-b022-b77b45eed94b'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 20:53:35.114159 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-ff6ee662-966b-4c10-b860-0cf2b7503897 req-98203471-26e5-4e02-8e97-f2a718ed709b tempest-LiveAutoBlockMigrationV225Test-579170983 None] attachment_update completed successfully. Feb 19 20:53:49.435534 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-ff6ee662-966b-4c10-b860-0cf2b7503897 req-8e229cc4-7b52-42c5-8b41-5fbff6c4ce7b tempest-LiveAutoBlockMigrationV225Test-579170983 None] Terminate volume connection completed successfully. Feb 19 20:53:49.436133 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-ff6ee662-966b-4c10-b860-0cf2b7503897 req-8e229cc4-7b52-42c5-8b41-5fbff6c4ce7b tempest-LiveAutoBlockMigrationV225Test-579170983 None] Deleting attachment 806cba1e-a151-4fa4-b13a-d9c089efa6fe. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 20:54:12.350449 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-c6bf0be2-1426-4611-a0a5-70932420fe48 req-01c55406-1474-4c70-80c8-cde9bc4fb480 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Terminate volume connection completed successfully. Feb 19 20:54:12.351314 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-c6bf0be2-1426-4611-a0a5-70932420fe48 req-01c55406-1474-4c70-80c8-cde9bc4fb480 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Deleting attachment ec679066-13af-4656-b022-b77b45eed94b. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 20:54:13.175087 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 20:54:13.178834 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:54:13.179309 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:54:13.199372 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Flow 'volume_create_manager' (1b934483-a588-4035-95cd-71bb3be515f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:54:13.205982 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902a91cd-965b-4c94-8faa-c075da82d020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:54:13.213126 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:54:13.228753 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902a91cd-965b-4c94-8faa-c075da82d020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T20:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-635466449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=90669fb9-9d09-48c0-b541-6b2f12bb6671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f02f88286b49babe665db9d00787a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T20:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T20:54:13Z,use_quota=True,user_id='ec1a2a2db19c41cca4342aa082770a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:54:13.234453 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151c80f7-0fd5-4597-9c26-06bde019a6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:54:13.238654 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151c80f7-0fd5-4597-9c26-06bde019a6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:54:13.243876 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cf2f9c-4d6d-4af2-9c7f-dea37b179862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:54:13.328679 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cf2f9c-4d6d-4af2-9c7f-dea37b179862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '90669fb9-9d09-48c0-b541-6b2f12bb6671', 'volume_name': 'volume-90669fb9-9d09-48c0-b541-6b2f12bb6671', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:54:13.334543 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c88142-b11f-4e6f-9be1-388a15ff202a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:54:13.338766 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c88142-b11f-4e6f-9be1-388a15ff202a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:54:13.343845 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba98143a-a435-464c-b875-0b6e84750b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:54:13.345270 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Volume 90669fb9-9d09-48c0-b541-6b2f12bb6671: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-90669fb9-9d09-48c0-b541-6b2f12bb6671', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 20:54:13.345919 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Cloning 90669fb9-9d09-48c0-b541-6b2f12bb6671 from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 20:54:13.356918 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:54:13.367254 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 20, 54, 13, 361607)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 20:54:13.367752 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 20:54:13.368155 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Found cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 19 20:54:13.372150 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 20:54:13.373179 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 20:54:13.378609 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 20, 54, 13, 376441)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 20:54:13.379558 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 20:54:13.379949 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Creating from source image-volume d609c16c-1e31-4237-8163-d85a8fcc768b {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 19 20:54:13.393048 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:54:13.465272 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] creating snapshot='volume-90669fb9-9d09-48c0-b541-6b2f12bb6671.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 20:54:13.788515 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] cloning 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b@volume-90669fb9-9d09-48c0-b541-6b2f12bb6671.clone_snap' to 'volume-90669fb9-9d09-48c0-b541-6b2f12bb6671' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 20:54:13.921898 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 20:54:13.923056 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 20:54:13.923450 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 20:54:13.938905 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 20:54:13.939560 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Marking volume 90669fb9-9d09-48c0-b541-6b2f12bb6671 as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 20:54:13.952541 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to 90669fb9-9d09-48c0-b541-6b2f12bb6671. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 20:54:13.952982 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Creating volume glance metadata for volume 90669fb9-9d09-48c0-b541-6b2f12bb6671 backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 20:54:14.005310 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba98143a-a435-464c-b875-0b6e84750b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90669fb9-9d09-48c0-b541-6b2f12bb6671', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:54:14.010614 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ddca69b-a51e-4cef-bc30-151b81cbd44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:54:14.024806 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Volume volume-90669fb9-9d09-48c0-b541-6b2f12bb6671 (90669fb9-9d09-48c0-b541-6b2f12bb6671): created successfully Feb 19 20:54:14.030042 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ddca69b-a51e-4cef-bc30-151b81cbd44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:54:14.036636 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Flow 'volume_create_manager' (1b934483-a588-4035-95cd-71bb3be515f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:54:14.045301 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3edd403e-89e5-4eb3-8698-bcd98a43c802 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Created volume successfully. Feb 19 20:54:19.234460 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-d98a3b82-a777-48d4-904b-c67559eeb8e7 req-f43a7de1-f462-4048-9ae2-c2a04f6c84ff tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:54:20.105633 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-d98a3b82-a777-48d4-904b-c67559eeb8e7 req-f43a7de1-f462-4048-9ae2-c2a04f6c84ff tempest-LiveAutoBlockMigrationV225Test-1806086406 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.870s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:54:20.106903 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-d98a3b82-a777-48d4-904b-c67559eeb8e7 req-f43a7de1-f462-4048-9ae2-c2a04f6c84ff tempest-LiveAutoBlockMigrationV225Test-1806086406 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-90669fb9-9d09-48c0-b541-6b2f12bb6671', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '90669fb9-9d09-48c0-b541-6b2f12bb6671', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 20:54:20.163512 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-d98a3b82-a777-48d4-904b-c67559eeb8e7 req-f43a7de1-f462-4048-9ae2-c2a04f6c84ff tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Connection info returned from driver {'name': 'volumes/volume-90669fb9-9d09-48c0-b541-6b2f12bb6671', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '90669fb9-9d09-48c0-b541-6b2f12bb6671', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '987a8cfa-ba95-40aa-b14e-2857755ab467'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 20:54:20.252703 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-d98a3b82-a777-48d4-904b-c67559eeb8e7 req-f43a7de1-f462-4048-9ae2-c2a04f6c84ff tempest-LiveAutoBlockMigrationV225Test-1806086406 None] attachment_update completed successfully. Feb 19 20:54:21.717804 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:54:21.720307 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:54:21.805895 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:54:21.879514 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:54:46.939747 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-01b81794-5f12-49d3-9455-b56bc7652b60 req-b71e1d82-ca11-4c1a-b2a7-3597290dae01 tempest-LiveAutoBlockMigrationV225Test-579170983 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:54:47.785121 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-01b81794-5f12-49d3-9455-b56bc7652b60 req-b71e1d82-ca11-4c1a-b2a7-3597290dae01 tempest-LiveAutoBlockMigrationV225Test-579170983 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.845s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:54:47.785907 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-01b81794-5f12-49d3-9455-b56bc7652b60 req-b71e1d82-ca11-4c1a-b2a7-3597290dae01 tempest-LiveAutoBlockMigrationV225Test-579170983 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-90669fb9-9d09-48c0-b541-6b2f12bb6671', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '90669fb9-9d09-48c0-b541-6b2f12bb6671', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 20:54:47.817812 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-01b81794-5f12-49d3-9455-b56bc7652b60 req-b71e1d82-ca11-4c1a-b2a7-3597290dae01 tempest-LiveAutoBlockMigrationV225Test-579170983 None] Connection info returned from driver {'name': 'volumes/volume-90669fb9-9d09-48c0-b541-6b2f12bb6671', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '90669fb9-9d09-48c0-b541-6b2f12bb6671', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c77c8dc6-3a32-4dac-ba6c-ba041d0cc189'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 20:54:47.888557 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-01b81794-5f12-49d3-9455-b56bc7652b60 req-b71e1d82-ca11-4c1a-b2a7-3597290dae01 tempest-LiveAutoBlockMigrationV225Test-579170983 None] attachment_update completed successfully. Feb 19 20:55:00.297484 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-01b81794-5f12-49d3-9455-b56bc7652b60 req-d10b890c-6c47-4a9d-a71b-426e646dab93 tempest-LiveAutoBlockMigrationV225Test-579170983 None] Terminate volume connection completed successfully. Feb 19 20:55:00.298123 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-01b81794-5f12-49d3-9455-b56bc7652b60 req-d10b890c-6c47-4a9d-a71b-426e646dab93 tempest-LiveAutoBlockMigrationV225Test-579170983 None] Deleting attachment 987a8cfa-ba95-40aa-b14e-2857755ab467. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 20:55:21.714357 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:55:21.715362 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:55:21.807060 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:55:21.872252 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:55:30.011857 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 req-f9216dcf-6962-4320-a819-c803b8f3a82d tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Terminate volume connection completed successfully. Feb 19 20:55:30.013041 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 req-f9216dcf-6962-4320-a819-c803b8f3a82d tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Deleting attachment c77c8dc6-3a32-4dac-ba6c-ba041d0cc189. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 20:55:30.227338 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 req-0ea2a67b-1947-44cf-9f1a-df012e20712b tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Lock "b'cinder-90669fb9-9d09-48c0-b541-6b2f12bb6671-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:55:30.293695 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 req-0ea2a67b-1947-44cf-9f1a-df012e20712b tempest-LiveAutoBlockMigrationV225Test-1806086406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:55:30.428800 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 req-0ea2a67b-1947-44cf-9f1a-df012e20712b tempest-LiveAutoBlockMigrationV225Test-1806086406 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 20:55:30.453309 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 req-0ea2a67b-1947-44cf-9f1a-df012e20712b tempest-LiveAutoBlockMigrationV225Test-1806086406 None] deleting rbd volume volume-90669fb9-9d09-48c0-b541-6b2f12bb6671 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 20:55:31.177795 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 req-0ea2a67b-1947-44cf-9f1a-df012e20712b tempest-LiveAutoBlockMigrationV225Test-1806086406 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 20:55:31.228218 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 req-0ea2a67b-1947-44cf-9f1a-df012e20712b tempest-LiveAutoBlockMigrationV225Test-1806086406 None] deleting parent snapshot volume-90669fb9-9d09-48c0-b541-6b2f12bb6671.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 20:55:31.967090 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-9ea97d1c-696e-4a08-b5b9-a18f81b98308 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Lock "b'cinder-39ca1219-a5f8-409e-8ab8-06e2e1d77c8c-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:55:32.029232 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9ea97d1c-696e-4a08-b5b9-a18f81b98308 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:55:32.126616 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9ea97d1c-696e-4a08-b5b9-a18f81b98308 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 20:55:32.127233 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9ea97d1c-696e-4a08-b5b9-a18f81b98308 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Volume volume-39ca1219-a5f8-409e-8ab8-06e2e1d77c8c is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 20:55:32.142118 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9ea97d1c-696e-4a08-b5b9-a18f81b98308 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] deleting rbd volume volume-39ca1219-a5f8-409e-8ab8-06e2e1d77c8c {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 20:55:32.172497 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 req-0ea2a67b-1947-44cf-9f1a-df012e20712b tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Created reservations ['79d97ac5-cd44-4761-ad04-1250e77e831a', '708bcbaa-f57b-4e30-a4a4-5d100168a5cd', '12464974-e5ee-405b-ad91-1cc21d9a1fc1', 'c57453d8-fcbd-4428-a3bd-d1b49c87e98c'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 20:55:32.259461 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 req-0ea2a67b-1947-44cf-9f1a-df012e20712b tempest-LiveAutoBlockMigrationV225Test-1806086406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:55:32.328405 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 req-0ea2a67b-1947-44cf-9f1a-df012e20712b tempest-LiveAutoBlockMigrationV225Test-1806086406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:55:32.382534 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 req-0ea2a67b-1947-44cf-9f1a-df012e20712b tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:55:32.388872 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 req-0ea2a67b-1947-44cf-9f1a-df012e20712b tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Deleted volume successfully. Feb 19 20:55:32.407316 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 req-0ea2a67b-1947-44cf-9f1a-df012e20712b tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Lock "b'cinder-90669fb9-9d09-48c0-b541-6b2f12bb6671-delete_volume'" released by "delete_volume" :: held 2.180s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 20:55:32.640835 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-9ea97d1c-696e-4a08-b5b9-a18f81b98308 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Created reservations ['a0215fe8-e08e-4654-9f1a-e28ec0833f01', '0e34bf44-208d-4d2a-a251-9e8c4a27aeab', '2fa80eff-2dda-4b0e-af2e-fad029c9e0d3', '965c9a4c-c88e-48bd-b79e-63a61c940050'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 20:55:32.710105 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9ea97d1c-696e-4a08-b5b9-a18f81b98308 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:55:32.773152 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9ea97d1c-696e-4a08-b5b9-a18f81b98308 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:55:32.837887 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-9ea97d1c-696e-4a08-b5b9-a18f81b98308 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:55:32.842718 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-9ea97d1c-696e-4a08-b5b9-a18f81b98308 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Deleted volume successfully. Feb 19 20:55:32.860008 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-9ea97d1c-696e-4a08-b5b9-a18f81b98308 tempest-LiveAutoBlockMigrationV225Test-1806086406 None] Lock "b'cinder-39ca1219-a5f8-409e-8ab8-06e2e1d77c8c-delete_volume'" released by "delete_volume" :: held 0.893s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 20:56:21.711546 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:56:21.712389 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:56:21.772919 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:56:21.819510 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:57:21.707239 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:57:21.708263 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:57:21.741505 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:57:21.767734 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:57:31.034883 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 20:57:31.038666 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:57:31.039233 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:57:31.061664 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Flow 'volume_create_manager' (c31be61b-3590-4fd5-9466-d4da879089f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:57:31.068991 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e4ed95-c4fe-4883-bae5-ab5ccc4ec94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:31.075761 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:57:31.090993 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e4ed95-c4fe-4883-bae5-ab5ccc4ec94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T20:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-417746988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5e244913-ab5d-4fe3-bb55-4f761d37c8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63acbd462dfc418fab3fbeedccacb9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T20:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T20:57:31Z,use_quota=True,user_id='0d694f3e8da440a9a1cac8ca2de030e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:31.097828 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3f4233-bfef-4909-b25d-e237ab5bb06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:31.102430 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3f4233-bfef-4909-b25d-e237ab5bb06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:31.108262 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77730d8e-7802-449c-b192-439c52bfa08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:31.112316 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77730d8e-7802-449c-b192-439c52bfa08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e244913-ab5d-4fe3-bb55-4f761d37c8e5', 'volume_name': 'volume-5e244913-ab5d-4fe3-bb55-4f761d37c8e5', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:31.117364 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a7bb60-ece8-4d74-9632-a707a7ada169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:31.121431 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a7bb60-ece8-4d74-9632-a707a7ada169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:31.126681 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87745140-c1b0-4ab1-a067-deb02e2dc4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:31.127785 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Volume 5e244913-ab5d-4fe3-bb55-4f761d37c8e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e244913-ab5d-4fe3-bb55-4f761d37c8e5', 'volume_size': 1} Feb 19 20:57:31.128189 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] creating volume 'volume-5e244913-ab5d-4fe3-bb55-4f761d37c8e5' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 20:57:31.129236 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:57:31.225496 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 20:57:31.226078 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 20:57:31.233083 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87745140-c1b0-4ab1-a067-deb02e2dc4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e244913-ab5d-4fe3-bb55-4f761d37c8e5', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:31.240695 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76371ab-e93b-4699-b0ee-b3b2221bf1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:31.252123 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Volume volume-5e244913-ab5d-4fe3-bb55-4f761d37c8e5 (5e244913-ab5d-4fe3-bb55-4f761d37c8e5): created successfully Feb 19 20:57:31.258814 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76371ab-e93b-4699-b0ee-b3b2221bf1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:31.267742 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Flow 'volume_create_manager' (c31be61b-3590-4fd5-9466-d4da879089f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:57:31.286204 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-eca526e1-701b-46e1-b1d0-c149b4381ba5 tempest-LiveMigrationTest-819722215 None] Created volume successfully. Feb 19 20:57:32.551605 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-0f791ecb-5b1f-45f7-bb85-60e2a04fc7cf req-6f3cd075-bf83-45b1-86ab-4a2a17b309f3 tempest-LiveMigrationTest-819722215 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:57:33.284831 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-0f791ecb-5b1f-45f7-bb85-60e2a04fc7cf req-6f3cd075-bf83-45b1-86ab-4a2a17b309f3 tempest-LiveMigrationTest-819722215 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.733s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:57:33.286421 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-0f791ecb-5b1f-45f7-bb85-60e2a04fc7cf req-6f3cd075-bf83-45b1-86ab-4a2a17b309f3 tempest-LiveMigrationTest-819722215 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5e244913-ab5d-4fe3-bb55-4f761d37c8e5', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '5e244913-ab5d-4fe3-bb55-4f761d37c8e5', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 20:57:33.311936 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-0f791ecb-5b1f-45f7-bb85-60e2a04fc7cf req-6f3cd075-bf83-45b1-86ab-4a2a17b309f3 tempest-LiveMigrationTest-819722215 None] Connection info returned from driver {'name': 'volumes/volume-5e244913-ab5d-4fe3-bb55-4f761d37c8e5', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5e244913-ab5d-4fe3-bb55-4f761d37c8e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '12ec9744-9021-4705-a62f-0e88a3c157d6'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 20:57:33.373843 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-0f791ecb-5b1f-45f7-bb85-60e2a04fc7cf req-6f3cd075-bf83-45b1-86ab-4a2a17b309f3 tempest-LiveMigrationTest-819722215 None] attachment_update completed successfully. Feb 19 20:57:39.994016 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-bac8bce6-0483-464d-a27d-e91d64ad5e28 req-2adbc6df-8b8f-4748-9605-1cd6656ce647 tempest-LiveMigrationTest-480741307 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:57:40.857893 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-bac8bce6-0483-464d-a27d-e91d64ad5e28 req-2adbc6df-8b8f-4748-9605-1cd6656ce647 tempest-LiveMigrationTest-480741307 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.864s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:57:40.859171 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-bac8bce6-0483-464d-a27d-e91d64ad5e28 req-2adbc6df-8b8f-4748-9605-1cd6656ce647 tempest-LiveMigrationTest-480741307 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5e244913-ab5d-4fe3-bb55-4f761d37c8e5', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '5e244913-ab5d-4fe3-bb55-4f761d37c8e5', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 20:57:40.883361 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-bac8bce6-0483-464d-a27d-e91d64ad5e28 req-2adbc6df-8b8f-4748-9605-1cd6656ce647 tempest-LiveMigrationTest-480741307 None] Connection info returned from driver {'name': 'volumes/volume-5e244913-ab5d-4fe3-bb55-4f761d37c8e5', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5e244913-ab5d-4fe3-bb55-4f761d37c8e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0f32370f-828d-491b-a30a-5bdc58ad001a'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 20:57:40.950742 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-bac8bce6-0483-464d-a27d-e91d64ad5e28 req-2adbc6df-8b8f-4748-9605-1cd6656ce647 tempest-LiveMigrationTest-480741307 None] attachment_update completed successfully. Feb 19 20:57:52.085828 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-bac8bce6-0483-464d-a27d-e91d64ad5e28 req-27548949-a551-481d-89d5-567b9fa8f8ac tempest-LiveMigrationTest-480741307 None] Terminate volume connection completed successfully. Feb 19 20:57:52.088481 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-bac8bce6-0483-464d-a27d-e91d64ad5e28 req-27548949-a551-481d-89d5-567b9fa8f8ac tempest-LiveMigrationTest-480741307 None] Deleting attachment 12ec9744-9021-4705-a62f-0e88a3c157d6. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 20:57:55.289602 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 20:57:55.294932 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:57:55.295659 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:57:55.326290 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Flow 'volume_create_manager' (7706a119-344d-42a3-b248-fa2cf2b4e578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:57:55.336836 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e583557-af16-4deb-83f6-899b8ff86f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:55.350601 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:57:55.370018 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e583557-af16-4deb-83f6-899b8ff86f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T20:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1901279553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d30cf863-c403-45ae-9e3c-2a8d5f047f3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fbbbcdc1b76467abd0d49ef006fb692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T20:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T20:57:55Z,use_quota=True,user_id='e7c2cbc8cc8b4685bc1847cc6b8413a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:55.377368 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef56e052-ab70-44f5-a6ca-80edfb79c657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:55.381637 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef56e052-ab70-44f5-a6ca-80edfb79c657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:55.387294 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90c2877-4ba1-4e10-a65b-5d8ac14a498d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:55.392102 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90c2877-4ba1-4e10-a65b-5d8ac14a498d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd30cf863-c403-45ae-9e3c-2a8d5f047f3e', 'volume_name': 'volume-d30cf863-c403-45ae-9e3c-2a8d5f047f3e', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:55.397820 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69431bf9-6799-425c-a860-ef3401cc9b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:55.405395 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69431bf9-6799-425c-a860-ef3401cc9b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:55.411119 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e07b7c7-a604-4763-9f63-f31e3a9d2972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:55.412509 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Volume d30cf863-c403-45ae-9e3c-2a8d5f047f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d30cf863-c403-45ae-9e3c-2a8d5f047f3e', 'volume_size': 1} Feb 19 20:57:55.413084 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] creating volume 'volume-d30cf863-c403-45ae-9e3c-2a8d5f047f3e' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 20:57:55.414446 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:57:55.530202 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 20:57:55.530842 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 20:57:55.537384 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e07b7c7-a604-4763-9f63-f31e3a9d2972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d30cf863-c403-45ae-9e3c-2a8d5f047f3e', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:55.542922 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33144903-6a6e-4907-a86b-31ce098b74b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:55.559301 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Volume volume-d30cf863-c403-45ae-9e3c-2a8d5f047f3e (d30cf863-c403-45ae-9e3c-2a8d5f047f3e): created successfully Feb 19 20:57:55.586609 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33144903-6a6e-4907-a86b-31ce098b74b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:55.629976 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Flow 'volume_create_manager' (7706a119-344d-42a3-b248-fa2cf2b4e578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:57:55.650327 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-1dc3b734-c3d6-4baf-ae2f-8d1418db41ca tempest-VolumesTestJSON-608083348 None] Created volume successfully. Feb 19 20:57:57.344874 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 20:57:57.352060 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:57:57.354967 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:57:57.375594 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Flow 'volume_create_manager' (e3bae2cd-849e-4dc0-8a29-5f9e012d46bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:57:57.383150 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0174f3df-cf55-458f-92d3-38cb3be77194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:57.390741 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:57:57.407632 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0174f3df-cf55-458f-92d3-38cb3be77194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T20:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1128632516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d8cfc405-a83b-4ee5-a231-8389d006f7e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fbbbcdc1b76467abd0d49ef006fb692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T20:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T20:57:57Z,use_quota=True,user_id='e7c2cbc8cc8b4685bc1847cc6b8413a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:57.414023 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de35d98-369a-4a14-94d2-aef2f44a88e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:57.419078 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de35d98-369a-4a14-94d2-aef2f44a88e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:57.425593 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d113f6a-f28e-4096-a1b8-ae2b5ff3eb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:57.430572 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d113f6a-f28e-4096-a1b8-ae2b5ff3eb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8cfc405-a83b-4ee5-a231-8389d006f7e0', 'volume_name': 'volume-d8cfc405-a83b-4ee5-a231-8389d006f7e0', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:57.437124 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b526d5-bcff-4b8f-a6ba-72c7e645effa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:57.441701 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b526d5-bcff-4b8f-a6ba-72c7e645effa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:57.447149 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8073f0ed-9412-4ecc-a53a-83dff43fca20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:57.448490 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Volume d8cfc405-a83b-4ee5-a231-8389d006f7e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8cfc405-a83b-4ee5-a231-8389d006f7e0', 'volume_size': 1} Feb 19 20:57:57.449196 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] creating volume 'volume-d8cfc405-a83b-4ee5-a231-8389d006f7e0' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 20:57:57.450385 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:57:57.533215 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 20:57:57.533608 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 20:57:57.538496 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8073f0ed-9412-4ecc-a53a-83dff43fca20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8cfc405-a83b-4ee5-a231-8389d006f7e0', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:57.545975 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8e7f2e-a587-4ee5-bdaf-e5941dc91a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:57:57.558816 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Volume volume-d8cfc405-a83b-4ee5-a231-8389d006f7e0 (d8cfc405-a83b-4ee5-a231-8389d006f7e0): created successfully Feb 19 20:57:57.574931 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8e7f2e-a587-4ee5-bdaf-e5941dc91a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:57:57.591304 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Flow 'volume_create_manager' (e3bae2cd-849e-4dc0-8a29-5f9e012d46bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:57:57.605599 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-836a176c-1c09-43bb-a5a5-d33ead6495af tempest-VolumesTestJSON-608083348 None] Created volume successfully. Feb 19 20:58:00.849052 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 20:58:00.855941 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:58:00.856956 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:58:00.924967 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Flow 'volume_create_manager' (aafcef95-4b6a-402a-8281-8e1f0440a29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:58:00.942213 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6809120-7bd0-47c3-bf8a-6311e1699f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:00.955410 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:58:00.994785 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6809120-7bd0-47c3-bf8a-6311e1699f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T20:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1776417192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a5793f45-246c-4580-a003-58b0ad7ff099,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fbbbcdc1b76467abd0d49ef006fb692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T20:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T20:58:01Z,use_quota=True,user_id='e7c2cbc8cc8b4685bc1847cc6b8413a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:01.016685 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ea1cf6-cea9-44f9-89ce-938f6e5db9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:01.032151 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ea1cf6-cea9-44f9-89ce-938f6e5db9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:01.070538 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9d09e4-1c7a-408c-8059-4785f2dd37f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:01.082461 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9d09e4-1c7a-408c-8059-4785f2dd37f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5793f45-246c-4580-a003-58b0ad7ff099', 'volume_name': 'volume-a5793f45-246c-4580-a003-58b0ad7ff099', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:01.087783 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023b99aa-c94a-45cb-9130-f4b714cb3d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:01.105776 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023b99aa-c94a-45cb-9130-f4b714cb3d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:01.134428 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6291865b-de55-474a-afe1-1479db3c2cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:01.143774 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Volume a5793f45-246c-4580-a003-58b0ad7ff099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5793f45-246c-4580-a003-58b0ad7ff099', 'volume_size': 1} Feb 19 20:58:01.144466 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] creating volume 'volume-a5793f45-246c-4580-a003-58b0ad7ff099' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 20:58:01.146010 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:01.242551 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 20:58:01.243027 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 20:58:01.248084 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6291865b-de55-474a-afe1-1479db3c2cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5793f45-246c-4580-a003-58b0ad7ff099', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:01.253973 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c99956d-fec5-4222-953d-230390855b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:01.276277 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Volume volume-a5793f45-246c-4580-a003-58b0ad7ff099 (a5793f45-246c-4580-a003-58b0ad7ff099): created successfully Feb 19 20:58:01.285935 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c99956d-fec5-4222-953d-230390855b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:01.295003 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Flow 'volume_create_manager' (aafcef95-4b6a-402a-8281-8e1f0440a29c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:58:01.308046 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-11f9b689-34e0-44e2-ac47-c53d2ad34625 tempest-VolumesTestJSON-608083348 None] Created volume successfully. Feb 19 20:58:01.686944 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-109f2540-589f-413c-81fb-94ae05d54634 req-67c7336b-a0c4-479b-a95e-7ced4813e0c9 tempest-LiveMigrationTest-819722215 None] Terminate volume connection completed successfully. Feb 19 20:58:01.688305 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-109f2540-589f-413c-81fb-94ae05d54634 req-67c7336b-a0c4-479b-a95e-7ced4813e0c9 tempest-LiveMigrationTest-819722215 None] Deleting attachment 0f32370f-828d-491b-a30a-5bdc58ad001a. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 20:58:03.661897 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 20:58:03.669806 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:58:03.673437 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:58:03.701392 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Flow 'volume_create_manager' (e27ff01e-66b1-441f-8046-3a112c1529e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:58:03.711997 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f712d9-8b1d-4189-b711-f58171200e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:03.720671 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:58:03.741333 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f712d9-8b1d-4189-b711-f58171200e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T20:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-617442092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cb0e31e2-5606-43d5-8308-b5499393d5fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63acbd462dfc418fab3fbeedccacb9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T20:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T20:58:04Z,use_quota=True,user_id='0d694f3e8da440a9a1cac8ca2de030e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:03.749897 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa1a5ec-c373-44da-83ab-5b6ac4b2a9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:03.759708 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa1a5ec-c373-44da-83ab-5b6ac4b2a9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:03.785455 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ce213a-2b7a-4e65-a85c-58e7e42fd8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:03.889506 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ce213a-2b7a-4e65-a85c-58e7e42fd8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb0e31e2-5606-43d5-8308-b5499393d5fb', 'volume_name': 'volume-cb0e31e2-5606-43d5-8308-b5499393d5fb', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:03.896557 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1f27be-9b54-48b9-b7b7-f19116862f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:03.901135 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1f27be-9b54-48b9-b7b7-f19116862f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:03.907845 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39182106-6804-48e7-961d-16e9135316d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:03.909263 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Volume cb0e31e2-5606-43d5-8308-b5499393d5fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb0e31e2-5606-43d5-8308-b5499393d5fb', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 20:58:03.910223 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Cloning cb0e31e2-5606-43d5-8308-b5499393d5fb from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 20:58:03.920263 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:58:03.937668 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 20, 58, 3, 924944)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 20:58:03.938582 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 20:58:03.939024 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Found cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 19 20:58:03.947966 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 0.028s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 20:58:03.949095 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 20:58:03.956576 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 20, 58, 3, 952781)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 20:58:03.957223 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 20:58:03.957619 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Creating from source image-volume d609c16c-1e31-4237-8163-d85a8fcc768b {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 19 20:58:03.988038 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:04.074792 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] creating snapshot='volume-cb0e31e2-5606-43d5-8308-b5499393d5fb.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 20:58:05.067322 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] cloning 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b@volume-cb0e31e2-5606-43d5-8308-b5499393d5fb.clone_snap' to 'volume-cb0e31e2-5606-43d5-8308-b5499393d5fb' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 20:58:05.225554 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 20:58:05.226681 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 20:58:05.227058 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 20:58:05.246725 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 20:58:05.247530 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Marking volume cb0e31e2-5606-43d5-8308-b5499393d5fb as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 20:58:05.255462 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to cb0e31e2-5606-43d5-8308-b5499393d5fb. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 20:58:05.256712 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Creating volume glance metadata for volume cb0e31e2-5606-43d5-8308-b5499393d5fb backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 20:58:05.344632 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39182106-6804-48e7-961d-16e9135316d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb0e31e2-5606-43d5-8308-b5499393d5fb', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:05.351086 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9dd9f2-9b3a-40d9-a9f6-e20d791f7bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:05.363255 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Volume volume-cb0e31e2-5606-43d5-8308-b5499393d5fb (cb0e31e2-5606-43d5-8308-b5499393d5fb): created successfully Feb 19 20:58:05.367059 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9dd9f2-9b3a-40d9-a9f6-e20d791f7bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:05.374101 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Flow 'volume_create_manager' (e27ff01e-66b1-441f-8046-3a112c1529e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:58:05.385596 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-bf28a649-e05c-4a5c-b181-e45c53cd5333 tempest-LiveMigrationTest-819722215 None] Created volume successfully. Feb 19 20:58:05.483051 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-4fa9676e-77c9-496b-bf15-b105001d7de5 tempest-VolumesTestJSON-608083348 None] Lock "b'cinder-a5793f45-246c-4580-a003-58b0ad7ff099-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:58:05.537748 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4fa9676e-77c9-496b-bf15-b105001d7de5 tempest-VolumesTestJSON-608083348 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:05.593187 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4fa9676e-77c9-496b-bf15-b105001d7de5 tempest-VolumesTestJSON-608083348 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 20:58:05.593614 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4fa9676e-77c9-496b-bf15-b105001d7de5 tempest-VolumesTestJSON-608083348 None] Volume volume-a5793f45-246c-4580-a003-58b0ad7ff099 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 20:58:05.604893 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4fa9676e-77c9-496b-bf15-b105001d7de5 tempest-VolumesTestJSON-608083348 None] deleting rbd volume volume-a5793f45-246c-4580-a003-58b0ad7ff099 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 20:58:05.877872 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-4fa9676e-77c9-496b-bf15-b105001d7de5 tempest-VolumesTestJSON-608083348 None] Created reservations ['d6be8850-95fd-4d59-b649-f169eec95b6c', 'ccd0b178-942f-497e-a778-86dca727cf9f', '93115a6b-25d3-4e78-a61a-d5a2be1973fa', '8a515c6f-3c34-4b43-9c4a-09a793dcf651'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 20:58:05.948564 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4fa9676e-77c9-496b-bf15-b105001d7de5 tempest-VolumesTestJSON-608083348 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:06.008993 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4fa9676e-77c9-496b-bf15-b105001d7de5 tempest-VolumesTestJSON-608083348 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:06.105901 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-4fa9676e-77c9-496b-bf15-b105001d7de5 tempest-VolumesTestJSON-608083348 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:58:06.112855 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-4fa9676e-77c9-496b-bf15-b105001d7de5 tempest-VolumesTestJSON-608083348 None] Deleted volume successfully. Feb 19 20:58:06.142137 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-4fa9676e-77c9-496b-bf15-b105001d7de5 tempest-VolumesTestJSON-608083348 None] Lock "b'cinder-a5793f45-246c-4580-a003-58b0ad7ff099-delete_volume'" released by "delete_volume" :: held 0.659s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 20:58:06.639885 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-4980fd69-bb54-46b0-af54-d245da42c167 tempest-VolumesTestJSON-608083348 None] Lock "b'cinder-d8cfc405-a83b-4ee5-a231-8389d006f7e0-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:58:06.739758 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4980fd69-bb54-46b0-af54-d245da42c167 tempest-VolumesTestJSON-608083348 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:06.808073 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4980fd69-bb54-46b0-af54-d245da42c167 tempest-VolumesTestJSON-608083348 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 20:58:06.808766 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4980fd69-bb54-46b0-af54-d245da42c167 tempest-VolumesTestJSON-608083348 None] Volume volume-d8cfc405-a83b-4ee5-a231-8389d006f7e0 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 20:58:06.821757 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4980fd69-bb54-46b0-af54-d245da42c167 tempest-VolumesTestJSON-608083348 None] deleting rbd volume volume-d8cfc405-a83b-4ee5-a231-8389d006f7e0 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 20:58:07.246472 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-4980fd69-bb54-46b0-af54-d245da42c167 tempest-VolumesTestJSON-608083348 None] Created reservations ['d195eed5-d6bf-4865-8f15-54964d45045e', 'a20be387-6608-4d8c-b78e-606c5745d74c', 'ac199697-1020-4090-9e3e-68bb9c095e8a', '14a4c724-d61d-487d-951c-e1491c1a95a6'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 20:58:07.311978 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4980fd69-bb54-46b0-af54-d245da42c167 tempest-VolumesTestJSON-608083348 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:07.363904 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4980fd69-bb54-46b0-af54-d245da42c167 tempest-VolumesTestJSON-608083348 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:07.443526 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-4980fd69-bb54-46b0-af54-d245da42c167 tempest-VolumesTestJSON-608083348 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:58:07.458656 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-4980fd69-bb54-46b0-af54-d245da42c167 tempest-VolumesTestJSON-608083348 None] Deleted volume successfully. Feb 19 20:58:07.495150 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-4980fd69-bb54-46b0-af54-d245da42c167 tempest-VolumesTestJSON-608083348 None] Lock "b'cinder-d8cfc405-a83b-4ee5-a231-8389d006f7e0-delete_volume'" released by "delete_volume" :: held 0.856s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 20:58:07.848877 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-ddfe62e3-7bbb-49ae-b778-7cd339765c6e tempest-VolumesTestJSON-608083348 None] Lock "b'cinder-d30cf863-c403-45ae-9e3c-2a8d5f047f3e-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:58:07.918899 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ddfe62e3-7bbb-49ae-b778-7cd339765c6e tempest-VolumesTestJSON-608083348 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:08.018356 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ddfe62e3-7bbb-49ae-b778-7cd339765c6e tempest-VolumesTestJSON-608083348 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 20:58:08.018798 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ddfe62e3-7bbb-49ae-b778-7cd339765c6e tempest-VolumesTestJSON-608083348 None] Volume volume-d30cf863-c403-45ae-9e3c-2a8d5f047f3e is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 20:58:08.047245 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ddfe62e3-7bbb-49ae-b778-7cd339765c6e tempest-VolumesTestJSON-608083348 None] deleting rbd volume volume-d30cf863-c403-45ae-9e3c-2a8d5f047f3e {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 20:58:08.643851 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-ddfe62e3-7bbb-49ae-b778-7cd339765c6e tempest-VolumesTestJSON-608083348 None] Created reservations ['97b65ad5-6205-4420-b968-bb522d33fe9e', 'cad0a470-3525-4923-a1e8-0700ca68b2b0', '7e80e841-f0ff-4610-830b-07a9aab2f1b6', 'c9beece1-ea60-42c7-b8af-24d4ccbe6209'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 20:58:08.763888 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ddfe62e3-7bbb-49ae-b778-7cd339765c6e tempest-VolumesTestJSON-608083348 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:08.870784 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ddfe62e3-7bbb-49ae-b778-7cd339765c6e tempest-VolumesTestJSON-608083348 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:08.931459 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-ddfe62e3-7bbb-49ae-b778-7cd339765c6e tempest-VolumesTestJSON-608083348 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:58:08.951494 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ddfe62e3-7bbb-49ae-b778-7cd339765c6e tempest-VolumesTestJSON-608083348 None] Deleted volume successfully. Feb 19 20:58:08.985155 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-ddfe62e3-7bbb-49ae-b778-7cd339765c6e tempest-VolumesTestJSON-608083348 None] Lock "b'cinder-d30cf863-c403-45ae-9e3c-2a8d5f047f3e-delete_volume'" released by "delete_volume" :: held 1.134s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 20:58:10.388487 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-e38cfb79-3a69-4819-a817-c80997798d0b req-331906ea-5bcb-4cf2-8fd2-c31b77de3601 tempest-LiveMigrationTest-819722215 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:58:11.382605 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-e38cfb79-3a69-4819-a817-c80997798d0b req-331906ea-5bcb-4cf2-8fd2-c31b77de3601 tempest-LiveMigrationTest-819722215 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.994s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:58:11.383404 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-e38cfb79-3a69-4819-a817-c80997798d0b req-331906ea-5bcb-4cf2-8fd2-c31b77de3601 tempest-LiveMigrationTest-819722215 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cb0e31e2-5606-43d5-8308-b5499393d5fb', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'cb0e31e2-5606-43d5-8308-b5499393d5fb', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 20:58:11.430231 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-e38cfb79-3a69-4819-a817-c80997798d0b req-331906ea-5bcb-4cf2-8fd2-c31b77de3601 tempest-LiveMigrationTest-819722215 None] Connection info returned from driver {'name': 'volumes/volume-cb0e31e2-5606-43d5-8308-b5499393d5fb', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cb0e31e2-5606-43d5-8308-b5499393d5fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'adf0b119-4000-4435-a315-669d63cb7a32'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 20:58:11.550782 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-e38cfb79-3a69-4819-a817-c80997798d0b req-331906ea-5bcb-4cf2-8fd2-c31b77de3601 tempest-LiveMigrationTest-819722215 None] attachment_update completed successfully. Feb 19 20:58:13.347133 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 20:58:13.361501 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:58:13.362209 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:58:13.417346 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Flow 'volume_create_manager' (3f22b507-2f31-4859-93ee-343c8c0caa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:58:13.437919 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600e46b2-becb-4bc0-bfe5-6c11886b439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:13.490050 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:58:13.540543 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600e46b2-becb-4bc0-bfe5-6c11886b439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T20:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1286669202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eaac4cd79ca4f808d452057a3216fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T20:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T20:58:13Z,use_quota=True,user_id='927e2fa8122b464a8046bdc5a2c94544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:13.555537 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846ce002-ae2d-47cd-ac37-6ef543441a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:13.565780 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846ce002-ae2d-47cd-ac37-6ef543441a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:13.582986 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20dd3058-214d-4447-b72f-20ec2b929915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:13.596782 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20dd3058-214d-4447-b72f-20ec2b929915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50', 'volume_name': 'volume-c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:13.603254 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2196bf1f-6968-4565-b25b-8744cb37b7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:13.611464 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2196bf1f-6968-4565-b25b-8744cb37b7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:13.616905 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0648afe1-3c8c-4376-bd76-c65d9a9065bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:13.618336 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Volume c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50', 'volume_size': 1} Feb 19 20:58:13.618848 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] creating volume 'volume-c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 20:58:13.620351 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:13.794264 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 20:58:13.794644 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 20:58:13.799097 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0648afe1-3c8c-4376-bd76-c65d9a9065bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:13.810455 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baffea76-4e6a-4a88-80d9-fb328fe8d64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:13.838846 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Volume volume-c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50 (c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50): created successfully Feb 19 20:58:13.843069 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baffea76-4e6a-4a88-80d9-fb328fe8d64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:13.856416 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Flow 'volume_create_manager' (3f22b507-2f31-4859-93ee-343c8c0caa40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:58:13.882896 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-94071a74-535f-43ef-ba44-718d6fae77f8 tempest-VolumesAdminNegativeTest-637257177 None] Created volume successfully. Feb 19 20:58:15.660892 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-304d19b4-8146-4a67-af1e-e035b2cdd2ed req-3ba40c59-dff9-4408-acfc-6be615f66ba5 tempest-VolumesAdminNegativeTest-637257177 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:58:16.753158 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-304d19b4-8146-4a67-af1e-e035b2cdd2ed req-3ba40c59-dff9-4408-acfc-6be615f66ba5 tempest-VolumesAdminNegativeTest-637257177 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.102s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:58:16.755471 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-304d19b4-8146-4a67-af1e-e035b2cdd2ed req-3ba40c59-dff9-4408-acfc-6be615f66ba5 tempest-VolumesAdminNegativeTest-637257177 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 20:58:16.791891 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-304d19b4-8146-4a67-af1e-e035b2cdd2ed req-3ba40c59-dff9-4408-acfc-6be615f66ba5 tempest-VolumesAdminNegativeTest-637257177 None] Connection info returned from driver {'name': 'volumes/volume-c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0c2c604b-5941-4b5e-8ef9-14d00a3925c8'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 20:58:16.920041 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-304d19b4-8146-4a67-af1e-e035b2cdd2ed req-3ba40c59-dff9-4408-acfc-6be615f66ba5 tempest-VolumesAdminNegativeTest-637257177 None] attachment_update completed successfully. Feb 19 20:58:21.710240 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 20:58:21.711217 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:21.810908 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:21.912677 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:58:23.327627 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-5040b29a-2fee-463a-8281-5173e06d5802 req-53b25743-2dcb-4c5a-bba0-d56e1470dfcd tempest-VolumesAdminNegativeTest-637257177 None] Terminate volume connection completed successfully. Feb 19 20:58:23.332392 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-5040b29a-2fee-463a-8281-5173e06d5802 req-53b25743-2dcb-4c5a-bba0-d56e1470dfcd tempest-VolumesAdminNegativeTest-637257177 None] Deleting attachment 0c2c604b-5941-4b5e-8ef9-14d00a3925c8. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 20:58:24.770263 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-08f277bb-b28a-45d1-b99f-e6cdbe51b3bd req-dad52a72-ec0b-48fb-bf8e-3411a5924658 tempest-TaggedBootDevicesTest_v242-1053603382 None] Terminate volume connection completed successfully. Feb 19 20:58:24.770929 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-08f277bb-b28a-45d1-b99f-e6cdbe51b3bd req-dad52a72-ec0b-48fb-bf8e-3411a5924658 tempest-TaggedBootDevicesTest_v242-1053603382 None] Deleting attachment 1a0f5a6d-17f7-4159-9833-d2d8a5084d65. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 20:58:25.076863 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-08f277bb-b28a-45d1-b99f-e6cdbe51b3bd req-9bd58767-1a50-433d-821a-2e2c55205340 tempest-TaggedBootDevicesTest_v242-1053603382 None] Terminate volume connection completed successfully. Feb 19 20:58:25.077989 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-08f277bb-b28a-45d1-b99f-e6cdbe51b3bd req-9bd58767-1a50-433d-821a-2e2c55205340 tempest-TaggedBootDevicesTest_v242-1053603382 None] Deleting attachment 53075476-ff47-4a2e-9e8c-022a8397c850. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 20:58:25.310085 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-08f277bb-b28a-45d1-b99f-e6cdbe51b3bd req-4557398b-7872-4e8d-8416-a8538448a3da tempest-TaggedBootDevicesTest_v242-1053603382 None] Terminate volume connection completed successfully. Feb 19 20:58:25.312748 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-08f277bb-b28a-45d1-b99f-e6cdbe51b3bd req-4557398b-7872-4e8d-8416-a8538448a3da tempest-TaggedBootDevicesTest_v242-1053603382 None] Deleting attachment 79198d45-186f-479f-ab68-82ac0485c391. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 20:58:25.855400 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 20:58:25.861125 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 20:58:25.862343 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 20:58:25.918378 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Flow 'volume_create_manager' (065f9286-3bbd-4ebc-adcb-42312b488313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:58:25.952920 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72048a9e-0f17-4eb6-9ead-e7c010838e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:25.979606 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-71373de5-a44d-4384-852a-7556db798ca6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:58:26.033808 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72048a9e-0f17-4eb6-9ead-e7c010838e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T20:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1144471160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4c7a6346-294a-4626-b313-c9f8c65e9105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eaac4cd79ca4f808d452057a3216fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T20:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T20:58:26Z,use_quota=True,user_id='927e2fa8122b464a8046bdc5a2c94544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:26.055434 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287fab82-47db-46a9-8b93-87f4fcff68ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:26.068367 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287fab82-47db-46a9-8b93-87f4fcff68ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:26.075873 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8920ce-afa7-4bcd-be2d-1e017f0c3b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:26.081033 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8920ce-afa7-4bcd-be2d-1e017f0c3b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c7a6346-294a-4626-b313-c9f8c65e9105', 'volume_name': 'volume-4c7a6346-294a-4626-b313-c9f8c65e9105', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:26.089269 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a13a6a-affa-494b-9f7d-2f19ebfe6421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:26.097263 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a13a6a-affa-494b-9f7d-2f19ebfe6421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:26.103651 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc099924-4376-419a-8a0c-d656ff6a278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:26.105886 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Volume 4c7a6346-294a-4626-b313-c9f8c65e9105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c7a6346-294a-4626-b313-c9f8c65e9105', 'volume_size': 1} Feb 19 20:58:26.106705 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] creating volume 'volume-4c7a6346-294a-4626-b313-c9f8c65e9105' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 20:58:26.108435 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:26.285411 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 20:58:26.286057 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 20:58:26.290251 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc099924-4376-419a-8a0c-d656ff6a278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c7a6346-294a-4626-b313-c9f8c65e9105', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:26.300134 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdb960f-3142-4490-8e5f-e0de706a0bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 20:58:26.326029 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Volume volume-4c7a6346-294a-4626-b313-c9f8c65e9105 (4c7a6346-294a-4626-b313-c9f8c65e9105): created successfully Feb 19 20:58:26.330762 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdb960f-3142-4490-8e5f-e0de706a0bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 20:58:26.337651 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Flow 'volume_create_manager' (065f9286-3bbd-4ebc-adcb-42312b488313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 20:58:26.367330 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-909041e6-6e03-4dfe-b928-081e80aa205c tempest-VolumesAdminNegativeTest-637257177 None] Created volume successfully. Feb 19 20:58:27.376626 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-521c4015-75af-4ebb-9433-a188a65ef1c9 tempest-VolumesAdminNegativeTest-637257177 None] Lock "b'cinder-4c7a6346-294a-4626-b313-c9f8c65e9105-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:58:27.482882 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-521c4015-75af-4ebb-9433-a188a65ef1c9 tempest-VolumesAdminNegativeTest-637257177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:27.610871 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-521c4015-75af-4ebb-9433-a188a65ef1c9 tempest-VolumesAdminNegativeTest-637257177 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 20:58:27.611552 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-521c4015-75af-4ebb-9433-a188a65ef1c9 tempest-VolumesAdminNegativeTest-637257177 None] Volume volume-4c7a6346-294a-4626-b313-c9f8c65e9105 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 20:58:27.631527 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-521c4015-75af-4ebb-9433-a188a65ef1c9 tempest-VolumesAdminNegativeTest-637257177 None] deleting rbd volume volume-4c7a6346-294a-4626-b313-c9f8c65e9105 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 20:58:28.177184 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-521c4015-75af-4ebb-9433-a188a65ef1c9 tempest-VolumesAdminNegativeTest-637257177 None] Created reservations ['fa7391af-dde7-4f74-846d-2c76d3ecd7f1', 'e5f00c27-71e6-496b-8b57-4d026bd87dc0', 'ff91275f-520f-4deb-9a31-6bfab2a6d9e6', 'a2e84837-352f-4d08-9011-77cff03cd7a2'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 20:58:28.270281 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-521c4015-75af-4ebb-9433-a188a65ef1c9 tempest-VolumesAdminNegativeTest-637257177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:28.361753 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-521c4015-75af-4ebb-9433-a188a65ef1c9 tempest-VolumesAdminNegativeTest-637257177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:28.436951 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-521c4015-75af-4ebb-9433-a188a65ef1c9 tempest-VolumesAdminNegativeTest-637257177 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:58:28.442366 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-521c4015-75af-4ebb-9433-a188a65ef1c9 tempest-VolumesAdminNegativeTest-637257177 None] Deleted volume successfully. Feb 19 20:58:28.475877 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-521c4015-75af-4ebb-9433-a188a65ef1c9 tempest-VolumesAdminNegativeTest-637257177 None] Lock "b'cinder-4c7a6346-294a-4626-b313-c9f8c65e9105-delete_volume'" released by "delete_volume" :: held 1.117s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 20:58:28.566068 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-19410c22-8496-4801-86f5-7004a6445c1d tempest-VolumesAdminNegativeTest-637257177 None] Lock "b'cinder-c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:58:28.650027 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19410c22-8496-4801-86f5-7004a6445c1d tempest-VolumesAdminNegativeTest-637257177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:28.760301 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19410c22-8496-4801-86f5-7004a6445c1d tempest-VolumesAdminNegativeTest-637257177 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 20:58:28.760960 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19410c22-8496-4801-86f5-7004a6445c1d tempest-VolumesAdminNegativeTest-637257177 None] Volume volume-c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 20:58:28.794248 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19410c22-8496-4801-86f5-7004a6445c1d tempest-VolumesAdminNegativeTest-637257177 None] deleting rbd volume volume-c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 20:58:29.368905 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-19410c22-8496-4801-86f5-7004a6445c1d tempest-VolumesAdminNegativeTest-637257177 None] Created reservations ['1b672879-d184-4e72-bb87-028a62cc5d78', '49110e59-594a-4611-871d-093eff9a6346', '0b3ba9ed-58d9-4c76-becc-71bada1da40c', '79c53763-b7e0-4de5-a15c-f5637cb331d2'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 20:58:29.486491 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19410c22-8496-4801-86f5-7004a6445c1d tempest-VolumesAdminNegativeTest-637257177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:29.560388 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19410c22-8496-4801-86f5-7004a6445c1d tempest-VolumesAdminNegativeTest-637257177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:29.668539 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-19410c22-8496-4801-86f5-7004a6445c1d tempest-VolumesAdminNegativeTest-637257177 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:58:29.673998 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-19410c22-8496-4801-86f5-7004a6445c1d tempest-VolumesAdminNegativeTest-637257177 None] Deleted volume successfully. Feb 19 20:58:29.709295 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-19410c22-8496-4801-86f5-7004a6445c1d tempest-VolumesAdminNegativeTest-637257177 None] Lock "b'cinder-c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50-delete_volume'" released by "delete_volume" :: held 1.142s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 20:58:37.123707 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-dac8f205-df4d-47f8-b142-29db10bdf9d5 tempest-TaggedBootDevicesTest_v242-1053603382 None] Lock "b'cinder-e724d0d7-1022-4767-910f-d215fc344365-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:58:37.256575 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dac8f205-df4d-47f8-b142-29db10bdf9d5 tempest-TaggedBootDevicesTest_v242-1053603382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:37.359580 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dac8f205-df4d-47f8-b142-29db10bdf9d5 tempest-TaggedBootDevicesTest_v242-1053603382 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 20:58:37.359999 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dac8f205-df4d-47f8-b142-29db10bdf9d5 tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume volume-e724d0d7-1022-4767-910f-d215fc344365 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 20:58:37.392490 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dac8f205-df4d-47f8-b142-29db10bdf9d5 tempest-TaggedBootDevicesTest_v242-1053603382 None] deleting rbd volume volume-e724d0d7-1022-4767-910f-d215fc344365 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 20:58:38.079367 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-dac8f205-df4d-47f8-b142-29db10bdf9d5 tempest-TaggedBootDevicesTest_v242-1053603382 None] Created reservations ['c7c5fd89-0eb1-427c-a8ef-349dd9d95195', 'fa334b1d-385f-47cb-a528-02f84809056d', '93c21b4f-d788-4c62-bda2-f3fe9ecee215', 'fd848799-7f56-4775-a1d8-896c0a3d4a43'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 20:58:38.205834 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dac8f205-df4d-47f8-b142-29db10bdf9d5 tempest-TaggedBootDevicesTest_v242-1053603382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:38.295799 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dac8f205-df4d-47f8-b142-29db10bdf9d5 tempest-TaggedBootDevicesTest_v242-1053603382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:38.425613 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-dac8f205-df4d-47f8-b142-29db10bdf9d5 tempest-TaggedBootDevicesTest_v242-1053603382 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:58:38.429725 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-dac8f205-df4d-47f8-b142-29db10bdf9d5 tempest-TaggedBootDevicesTest_v242-1053603382 None] Deleted volume successfully. Feb 19 20:58:38.458367 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-dac8f205-df4d-47f8-b142-29db10bdf9d5 tempest-TaggedBootDevicesTest_v242-1053603382 None] Lock "b'cinder-e724d0d7-1022-4767-910f-d215fc344365-delete_volume'" released by "delete_volume" :: held 1.335s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 20:58:38.551997 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-80c6ded8-7dc3-405d-bb55-b1eb75ba293a tempest-TaggedBootDevicesTest_v242-1053603382 None] Lock "b'cinder-91cde230-36d5-44fb-bc24-28cbcdf3779b-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:58:38.616230 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80c6ded8-7dc3-405d-bb55-b1eb75ba293a tempest-TaggedBootDevicesTest_v242-1053603382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:38.762893 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80c6ded8-7dc3-405d-bb55-b1eb75ba293a tempest-TaggedBootDevicesTest_v242-1053603382 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 20:58:38.764509 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80c6ded8-7dc3-405d-bb55-b1eb75ba293a tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume volume-91cde230-36d5-44fb-bc24-28cbcdf3779b is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 20:58:38.783583 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80c6ded8-7dc3-405d-bb55-b1eb75ba293a tempest-TaggedBootDevicesTest_v242-1053603382 None] deleting rbd volume volume-91cde230-36d5-44fb-bc24-28cbcdf3779b {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 20:58:39.300029 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-80c6ded8-7dc3-405d-bb55-b1eb75ba293a tempest-TaggedBootDevicesTest_v242-1053603382 None] Created reservations ['87acf781-12bd-4e3e-8d9f-cc297bdeba0f', 'bb197c71-5615-4552-869f-20e8946449f8', 'd7916023-840a-4b0c-81aa-57892d0248c4', '9de672ca-bb3c-4178-a0ad-a53385a49cf0'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 20:58:39.411322 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80c6ded8-7dc3-405d-bb55-b1eb75ba293a tempest-TaggedBootDevicesTest_v242-1053603382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:39.511865 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80c6ded8-7dc3-405d-bb55-b1eb75ba293a tempest-TaggedBootDevicesTest_v242-1053603382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:39.621364 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-80c6ded8-7dc3-405d-bb55-b1eb75ba293a tempest-TaggedBootDevicesTest_v242-1053603382 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:58:39.627830 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-80c6ded8-7dc3-405d-bb55-b1eb75ba293a tempest-TaggedBootDevicesTest_v242-1053603382 None] Deleted volume successfully. Feb 19 20:58:39.675629 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-80c6ded8-7dc3-405d-bb55-b1eb75ba293a tempest-TaggedBootDevicesTest_v242-1053603382 None] Lock "b'cinder-91cde230-36d5-44fb-bc24-28cbcdf3779b-delete_volume'" released by "delete_volume" :: held 1.124s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 20:58:39.844451 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3f1cc3c5-8d25-4211-95d9-0230690d3df0 tempest-TaggedBootDevicesTest_v242-1053603382 None] Lock "b'cinder-03b5535c-cf30-4b6c-9466-5ea912a33e71-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:58:39.973176 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3f1cc3c5-8d25-4211-95d9-0230690d3df0 tempest-TaggedBootDevicesTest_v242-1053603382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:40.134002 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3f1cc3c5-8d25-4211-95d9-0230690d3df0 tempest-TaggedBootDevicesTest_v242-1053603382 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 20:58:40.134645 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3f1cc3c5-8d25-4211-95d9-0230690d3df0 tempest-TaggedBootDevicesTest_v242-1053603382 None] volume has clone snapshot(s) {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1208}} Feb 19 20:58:40.136391 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3f1cc3c5-8d25-4211-95d9-0230690d3df0 tempest-TaggedBootDevicesTest_v242-1053603382 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 20:58:40.400094 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-3f1cc3c5-8d25-4211-95d9-0230690d3df0 tempest-TaggedBootDevicesTest_v242-1053603382 None] Created reservations ['ac448d94-d3f0-4731-8fec-15fe65d918b1', '455346de-3913-453e-81fe-eab4ec70e534', 'cfac1d76-9608-4d1c-b92f-0f47a96db2db', '4e1cf07f-a17d-402d-83e0-d3b262e60589'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 20:58:40.531776 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3f1cc3c5-8d25-4211-95d9-0230690d3df0 tempest-TaggedBootDevicesTest_v242-1053603382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:40.643583 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3f1cc3c5-8d25-4211-95d9-0230690d3df0 tempest-TaggedBootDevicesTest_v242-1053603382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:58:40.741601 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3f1cc3c5-8d25-4211-95d9-0230690d3df0 tempest-TaggedBootDevicesTest_v242-1053603382 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:58:40.746124 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3f1cc3c5-8d25-4211-95d9-0230690d3df0 tempest-TaggedBootDevicesTest_v242-1053603382 None] Deleted volume successfully. Feb 19 20:58:40.771758 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3f1cc3c5-8d25-4211-95d9-0230690d3df0 tempest-TaggedBootDevicesTest_v242-1053603382 None] Lock "b'cinder-03b5535c-cf30-4b6c-9466-5ea912a33e71-delete_volume'" released by "delete_volume" :: held 0.927s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 20:58:48.215133 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-de670661-40b9-4cc6-8a2b-b7c16a728115 req-975b2cfb-14ce-4bae-b064-94600a097310 tempest-LiveMigrationTest-480741307 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 20:58:49.358815 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-de670661-40b9-4cc6-8a2b-b7c16a728115 req-975b2cfb-14ce-4bae-b064-94600a097310 tempest-LiveMigrationTest-480741307 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.143s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 20:58:49.360165 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-de670661-40b9-4cc6-8a2b-b7c16a728115 req-975b2cfb-14ce-4bae-b064-94600a097310 tempest-LiveMigrationTest-480741307 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cb0e31e2-5606-43d5-8308-b5499393d5fb', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'cb0e31e2-5606-43d5-8308-b5499393d5fb', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 20:58:49.401451 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-de670661-40b9-4cc6-8a2b-b7c16a728115 req-975b2cfb-14ce-4bae-b064-94600a097310 tempest-LiveMigrationTest-480741307 None] Connection info returned from driver {'name': 'volumes/volume-cb0e31e2-5606-43d5-8308-b5499393d5fb', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cb0e31e2-5606-43d5-8308-b5499393d5fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '369e7f14-b2a6-43f8-88d6-2dab4849cfa6'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 20:58:49.497947 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-de670661-40b9-4cc6-8a2b-b7c16a728115 req-975b2cfb-14ce-4bae-b064-94600a097310 tempest-LiveMigrationTest-480741307 None] attachment_update completed successfully. Feb 19 20:58:59.177406 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-de670661-40b9-4cc6-8a2b-b7c16a728115 req-b9fdc729-868a-4ec0-be43-6c5b804580fe tempest-LiveMigrationTest-480741307 None] Terminate volume connection completed successfully. Feb 19 20:58:59.177979 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-de670661-40b9-4cc6-8a2b-b7c16a728115 req-b9fdc729-868a-4ec0-be43-6c5b804580fe tempest-LiveMigrationTest-480741307 None] Deleting attachment adf0b119-4000-4435-a315-669d63cb7a32. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 20:59:13.665089 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-dc57fcfd-4eaa-4afa-a252-53795f33f962 req-73ea61af-38e9-4171-abc8-a48748fe93b6 tempest-LiveMigrationTest-819722215 None] Terminate volume connection completed successfully. Feb 19 20:59:13.666218 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dc57fcfd-4eaa-4afa-a252-53795f33f962 req-73ea61af-38e9-4171-abc8-a48748fe93b6 tempest-LiveMigrationTest-819722215 None] Deleting attachment 369e7f14-b2a6-43f8-88d6-2dab4849cfa6. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 20:59:13.933346 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-dc57fcfd-4eaa-4afa-a252-53795f33f962 req-742b9a41-10a1-4bf7-bea4-c5c353b3c404 tempest-LiveMigrationTest-819722215 None] Lock "b'cinder-cb0e31e2-5606-43d5-8308-b5499393d5fb-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:59:14.065351 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-dc57fcfd-4eaa-4afa-a252-53795f33f962 req-742b9a41-10a1-4bf7-bea4-c5c353b3c404 tempest-LiveMigrationTest-819722215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:59:14.203791 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-dc57fcfd-4eaa-4afa-a252-53795f33f962 req-742b9a41-10a1-4bf7-bea4-c5c353b3c404 tempest-LiveMigrationTest-819722215 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 20:59:14.224014 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-dc57fcfd-4eaa-4afa-a252-53795f33f962 req-742b9a41-10a1-4bf7-bea4-c5c353b3c404 tempest-LiveMigrationTest-819722215 None] deleting rbd volume volume-cb0e31e2-5606-43d5-8308-b5499393d5fb {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 20:59:14.870199 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-dc57fcfd-4eaa-4afa-a252-53795f33f962 req-742b9a41-10a1-4bf7-bea4-c5c353b3c404 tempest-LiveMigrationTest-819722215 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 20:59:14.951301 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-dc57fcfd-4eaa-4afa-a252-53795f33f962 req-742b9a41-10a1-4bf7-bea4-c5c353b3c404 tempest-LiveMigrationTest-819722215 None] deleting parent snapshot volume-cb0e31e2-5606-43d5-8308-b5499393d5fb.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 20:59:16.111700 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-2c0fcacb-9c7b-4e43-9de1-2bb8162b833e tempest-LiveMigrationTest-819722215 None] Lock "b'cinder-5e244913-ab5d-4fe3-bb55-4f761d37c8e5-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 20:59:16.164459 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2c0fcacb-9c7b-4e43-9de1-2bb8162b833e tempest-LiveMigrationTest-819722215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:59:16.212996 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2c0fcacb-9c7b-4e43-9de1-2bb8162b833e tempest-LiveMigrationTest-819722215 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 20:59:16.213495 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2c0fcacb-9c7b-4e43-9de1-2bb8162b833e tempest-LiveMigrationTest-819722215 None] Volume volume-5e244913-ab5d-4fe3-bb55-4f761d37c8e5 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 20:59:16.218369 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2c0fcacb-9c7b-4e43-9de1-2bb8162b833e tempest-LiveMigrationTest-819722215 None] deleting rbd volume volume-5e244913-ab5d-4fe3-bb55-4f761d37c8e5 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 20:59:16.219349 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [req-dc57fcfd-4eaa-4afa-a252-53795f33f962 req-742b9a41-10a1-4bf7-bea4-c5c353b3c404 tempest-LiveMigrationTest-819722215 None] Created reservations ['107d6600-06f5-43fa-bddf-68b2492ffe57', 'dba5cb5f-45e4-4b12-b762-940a0c1b976d', '16e77422-8ce6-4028-8748-11d4e3ac850b', 'd23e3dbe-185a-4b38-8162-fe2cd2a6a6e0'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 20:59:16.276137 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-dc57fcfd-4eaa-4afa-a252-53795f33f962 req-742b9a41-10a1-4bf7-bea4-c5c353b3c404 tempest-LiveMigrationTest-819722215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:59:16.336528 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-dc57fcfd-4eaa-4afa-a252-53795f33f962 req-742b9a41-10a1-4bf7-bea4-c5c353b3c404 tempest-LiveMigrationTest-819722215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:59:16.405875 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [req-dc57fcfd-4eaa-4afa-a252-53795f33f962 req-742b9a41-10a1-4bf7-bea4-c5c353b3c404 tempest-LiveMigrationTest-819722215 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:59:16.414518 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-dc57fcfd-4eaa-4afa-a252-53795f33f962 req-742b9a41-10a1-4bf7-bea4-c5c353b3c404 tempest-LiveMigrationTest-819722215 None] Deleted volume successfully. Feb 19 20:59:16.456375 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-dc57fcfd-4eaa-4afa-a252-53795f33f962 req-742b9a41-10a1-4bf7-bea4-c5c353b3c404 tempest-LiveMigrationTest-819722215 None] Lock "b'cinder-cb0e31e2-5606-43d5-8308-b5499393d5fb-delete_volume'" released by "delete_volume" :: held 2.524s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 20:59:16.618337 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-2c0fcacb-9c7b-4e43-9de1-2bb8162b833e tempest-LiveMigrationTest-819722215 None] Created reservations ['3d9a5d11-9be9-4039-af82-aec4061a7286', 'f70f2637-983e-48d7-af4b-2bd6794ade51', 'fbf1123b-edaf-4662-8d74-0aa08e23860c', '6780c4bb-d5fe-4b73-a32d-d70707f567b7'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 20:59:16.688639 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2c0fcacb-9c7b-4e43-9de1-2bb8162b833e tempest-LiveMigrationTest-819722215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:59:16.743021 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2c0fcacb-9c7b-4e43-9de1-2bb8162b833e tempest-LiveMigrationTest-819722215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 20:59:16.809282 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-2c0fcacb-9c7b-4e43-9de1-2bb8162b833e tempest-LiveMigrationTest-819722215 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 20:59:16.820258 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-2c0fcacb-9c7b-4e43-9de1-2bb8162b833e tempest-LiveMigrationTest-819722215 None] Deleted volume successfully. Feb 19 20:59:16.834961 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-2c0fcacb-9c7b-4e43-9de1-2bb8162b833e tempest-LiveMigrationTest-819722215 None] Lock "b'cinder-5e244913-ab5d-4fe3-bb55-4f761d37c8e5-delete_volume'" released by "delete_volume" :: held 0.723s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:00:01.841634 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:00:01.859824 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:00:01.859824 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:00:01.881825 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Flow 'volume_create_manager' (dc887f24-9092-47fa-ba32-27136772026a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:00:01.894571 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa15a5a3-e7d3-47f2-8564-16b02f7c3885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:00:01.902610 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:00:01.918372 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa15a5a3-e7d3-47f2-8564-16b02f7c3885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1132907813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f1132d59-f94e-4586-93d5-288ce89a4497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271b093ea9944990883cd9383817983e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:00:02Z,use_quota=True,user_id='fc3544bbe8564a81910a988d85ddc169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:00:01.925397 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd963d2-1733-4f65-be73-424ba838e1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:00:01.929979 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd963d2-1733-4f65-be73-424ba838e1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:00:01.936406 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0921067-fa23-41dd-8b27-fdbf85f2de59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:00:01.941305 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0921067-fa23-41dd-8b27-fdbf85f2de59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1132d59-f94e-4586-93d5-288ce89a4497', 'volume_name': 'volume-f1132d59-f94e-4586-93d5-288ce89a4497', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:00:01.947664 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118cc9ff-d30e-4dde-af57-208dd1a02d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:00:01.952515 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118cc9ff-d30e-4dde-af57-208dd1a02d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:00:01.957552 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a4f2c7-34ed-4d49-9d58-377dec7054e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:00:01.958850 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Volume f1132d59-f94e-4586-93d5-288ce89a4497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1132d59-f94e-4586-93d5-288ce89a4497', 'volume_size': 1} Feb 19 21:00:01.959419 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] creating volume 'volume-f1132d59-f94e-4586-93d5-288ce89a4497' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:00:01.960646 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:00:02.161071 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:00:02.161634 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:00:02.165727 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a4f2c7-34ed-4d49-9d58-377dec7054e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1132d59-f94e-4586-93d5-288ce89a4497', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:00:02.171398 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2659546d-8be3-43fa-8e0c-f84fffdfce75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:00:02.206996 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Volume volume-f1132d59-f94e-4586-93d5-288ce89a4497 (f1132d59-f94e-4586-93d5-288ce89a4497): created successfully Feb 19 21:00:02.211236 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2659546d-8be3-43fa-8e0c-f84fffdfce75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:00:02.220557 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Flow 'volume_create_manager' (dc887f24-9092-47fa-ba32-27136772026a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:00:02.242214 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-dc643645-84f7-4111-9920-2ef0128f724b req-6d890e96-3fd7-4f35-bcd2-e12c1501e28b tempest-VolumesSnapshotsTestJSON-376452767 None] Created volume successfully. Feb 19 21:00:03.413990 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-dd6ae480-0711-4861-9646-9ff82511b077 req-08d175a4-82a7-421e-a93c-ddb8912325a5 tempest-VolumesSnapshotsTestJSON-376452767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:00:04.367292 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-dd6ae480-0711-4861-9646-9ff82511b077 req-08d175a4-82a7-421e-a93c-ddb8912325a5 tempest-VolumesSnapshotsTestJSON-376452767 None] Create snapshot completed successfully Feb 19 21:00:04.961168 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-a091f0ae-0a9a-4764-a995-15fcfe029e24 req-03f6144a-3786-4f23-b8df-1f6e55a7fc0d tempest-VolumesSnapshotsTestJSON-376452767 None] Lock "b'cinder-07399a84-ac61-4690-9afe-73ac81b18aa2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:00:04.963251 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-a091f0ae-0a9a-4764-a995-15fcfe029e24 req-03f6144a-3786-4f23-b8df-1f6e55a7fc0d tempest-VolumesSnapshotsTestJSON-376452767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:00:06.385509 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [req-a091f0ae-0a9a-4764-a995-15fcfe029e24 req-03f6144a-3786-4f23-b8df-1f6e55a7fc0d tempest-VolumesSnapshotsTestJSON-376452767 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:00:06.409163 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [req-a091f0ae-0a9a-4764-a995-15fcfe029e24 req-03f6144a-3786-4f23-b8df-1f6e55a7fc0d tempest-VolumesSnapshotsTestJSON-376452767 None] Created reservations ['53c453b2-4e5a-408b-9bb0-6fa09d052ae4', '2396927d-7b93-4942-9b14-a8a83f4bd16b', 'e3eb504e-7381-4012-8d68-56b6ef5f0d04', '2c13c63e-f31f-4700-a298-566128e50c43'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:00:06.504253 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-a091f0ae-0a9a-4764-a995-15fcfe029e24 req-03f6144a-3786-4f23-b8df-1f6e55a7fc0d tempest-VolumesSnapshotsTestJSON-376452767 None] Delete snapshot completed successfully. Feb 19 21:00:06.509730 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-a091f0ae-0a9a-4764-a995-15fcfe029e24 req-03f6144a-3786-4f23-b8df-1f6e55a7fc0d tempest-VolumesSnapshotsTestJSON-376452767 None] Lock "b'cinder-07399a84-ac61-4690-9afe-73ac81b18aa2-delete_snapshot'" released by "delete_snapshot" :: held 1.549s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:00:08.369955 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-5d86dbf9-3be9-4ea4-aa23-b32a018dca52 req-e975f4a3-111d-4785-8de5-ed74ef45419a tempest-VolumesSnapshotsTestJSON-376452767 None] Lock "b'cinder-f1132d59-f94e-4586-93d5-288ce89a4497-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:00:08.487949 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-5d86dbf9-3be9-4ea4-aa23-b32a018dca52 req-e975f4a3-111d-4785-8de5-ed74ef45419a tempest-VolumesSnapshotsTestJSON-376452767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:00:08.644584 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-5d86dbf9-3be9-4ea4-aa23-b32a018dca52 req-e975f4a3-111d-4785-8de5-ed74ef45419a tempest-VolumesSnapshotsTestJSON-376452767 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:00:08.645438 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-5d86dbf9-3be9-4ea4-aa23-b32a018dca52 req-e975f4a3-111d-4785-8de5-ed74ef45419a tempest-VolumesSnapshotsTestJSON-376452767 None] Volume volume-f1132d59-f94e-4586-93d5-288ce89a4497 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:00:08.667624 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-5d86dbf9-3be9-4ea4-aa23-b32a018dca52 req-e975f4a3-111d-4785-8de5-ed74ef45419a tempest-VolumesSnapshotsTestJSON-376452767 None] deleting rbd volume volume-f1132d59-f94e-4586-93d5-288ce89a4497 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:00:09.504386 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [req-5d86dbf9-3be9-4ea4-aa23-b32a018dca52 req-e975f4a3-111d-4785-8de5-ed74ef45419a tempest-VolumesSnapshotsTestJSON-376452767 None] Created reservations ['14701cf5-ac2a-4df1-90c7-65d0cda2d0da', 'fd5b90ee-9c0a-4016-b933-79b2a5b1d1a9', '8b84d4d2-a1d2-449a-ab49-9aad3bb21ab3', '87d2fd5d-f226-4f60-ac82-180cb1ec5bf2'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:00:09.617145 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-5d86dbf9-3be9-4ea4-aa23-b32a018dca52 req-e975f4a3-111d-4785-8de5-ed74ef45419a tempest-VolumesSnapshotsTestJSON-376452767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:00:09.690416 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-5d86dbf9-3be9-4ea4-aa23-b32a018dca52 req-e975f4a3-111d-4785-8de5-ed74ef45419a tempest-VolumesSnapshotsTestJSON-376452767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:00:09.767954 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [req-5d86dbf9-3be9-4ea4-aa23-b32a018dca52 req-e975f4a3-111d-4785-8de5-ed74ef45419a tempest-VolumesSnapshotsTestJSON-376452767 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:00:09.772684 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-5d86dbf9-3be9-4ea4-aa23-b32a018dca52 req-e975f4a3-111d-4785-8de5-ed74ef45419a tempest-VolumesSnapshotsTestJSON-376452767 None] Deleted volume successfully. Feb 19 21:00:09.814942 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-5d86dbf9-3be9-4ea4-aa23-b32a018dca52 req-e975f4a3-111d-4785-8de5-ed74ef45419a tempest-VolumesSnapshotsTestJSON-376452767 None] Lock "b'cinder-f1132d59-f94e-4586-93d5-288ce89a4497-delete_volume'" released by "delete_volume" :: held 1.445s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:00:21.716080 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:00:21.717487 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:00:21.801585 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:00:21.878239 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:01:19.271527 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:01:19.292302 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:01:19.293077 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:01:19.381373 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Flow 'volume_create_manager' (a4c2ceae-aef4-4512-9e5c-e40006dfdd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:01:19.398552 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dcf0823-a7b0-4fcc-9830-4b59a7e42675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:19.407246 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:01:19.444714 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dcf0823-a7b0-4fcc-9830-4b59a7e42675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-64289613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1a51d125-779d-4161-9229-3d61c08f7a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c91d99923e44a9b49c306044837e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:01:19Z,use_quota=True,user_id='e6e829f8edf3477dbc070d33ae8a6613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:19.466086 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1775763d-0a5c-4487-b5b8-df00acec2617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:19.489076 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1775763d-0a5c-4487-b5b8-df00acec2617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:19.505191 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6efc6e4-7e89-47d4-a2ec-00e472ab9141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:19.522474 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6efc6e4-7e89-47d4-a2ec-00e472ab9141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a51d125-779d-4161-9229-3d61c08f7a7d', 'volume_name': 'volume-1a51d125-779d-4161-9229-3d61c08f7a7d', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:19.527854 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819535cc-f88e-4f70-87b0-d90b2536bebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:19.532037 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819535cc-f88e-4f70-87b0-d90b2536bebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:19.556901 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad8035e-f11f-4445-b07d-fade7e818afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:19.558796 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Volume 1a51d125-779d-4161-9229-3d61c08f7a7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a51d125-779d-4161-9229-3d61c08f7a7d', 'volume_size': 1} Feb 19 21:01:19.559368 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] creating volume 'volume-1a51d125-779d-4161-9229-3d61c08f7a7d' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:01:19.569942 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:19.756542 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:01:19.758409 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:01:19.764545 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad8035e-f11f-4445-b07d-fade7e818afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a51d125-779d-4161-9229-3d61c08f7a7d', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:19.802814 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fdf5db-92e8-43c8-9827-527adbbdbb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:19.846421 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Volume volume-1a51d125-779d-4161-9229-3d61c08f7a7d (1a51d125-779d-4161-9229-3d61c08f7a7d): created successfully Feb 19 21:01:19.855640 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fdf5db-92e8-43c8-9827-527adbbdbb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:19.879994 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Flow 'volume_create_manager' (a4c2ceae-aef4-4512-9e5c-e40006dfdd91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:01:19.911647 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8d52b4d8-ba20-45e6-8c31-836f81745842 tempest-ServerRescueNegativeTestJSON-301100829 None] Created volume successfully. Feb 19 21:01:20.966902 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:01:20.971241 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:01:20.971962 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:01:21.003116 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Flow 'volume_create_manager' (ccd826bf-54d1-430e-8935-15b9ae2ed9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:01:21.011072 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba7a3b4-04f8-4d09-90a6-2ce76ce1d9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:21.019272 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:01:21.063589 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba7a3b4-04f8-4d09-90a6-2ce76ce1d9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-293634045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5aa1fdcb-18e6-4c5b-b6cb-6766c637168b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aca9e397c334bb997f450e919088286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:01:21Z,use_quota=True,user_id='a36b20fc4b8b4b71aea23626d52cefa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:21.074376 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05368646-75fa-49fc-b341-073e18894126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:21.113497 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05368646-75fa-49fc-b341-073e18894126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:21.125780 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87111fc0-25a4-4b4d-8b96-1b3181dd80ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:21.378946 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87111fc0-25a4-4b4d-8b96-1b3181dd80ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5aa1fdcb-18e6-4c5b-b6cb-6766c637168b', 'volume_name': 'volume-5aa1fdcb-18e6-4c5b-b6cb-6766c637168b', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:21.387182 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d294c74d-98b2-44b4-84b1-ebacd7f5b85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:21.393863 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d294c74d-98b2-44b4-84b1-ebacd7f5b85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:21.401035 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600c4c7a-6d84-45f6-818d-9c07d2127d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:21.402640 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Volume 5aa1fdcb-18e6-4c5b-b6cb-6766c637168b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5aa1fdcb-18e6-4c5b-b6cb-6766c637168b', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 21:01:21.403375 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Cloning 5aa1fdcb-18e6-4c5b-b6cb-6766c637168b from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 21:01:21.413765 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:01:21.451286 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 1, 21, 420662)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:01:21.452122 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:01:21.452649 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Found cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 19 21:01:21.458006 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 0.044s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:01:21.459173 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 21:01:21.465914 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 1, 21, 463227)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:01:21.466626 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:01:21.467196 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Creating from source image-volume d609c16c-1e31-4237-8163-d85a8fcc768b {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 19 21:01:21.480702 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:21.597172 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] creating snapshot='volume-5aa1fdcb-18e6-4c5b-b6cb-6766c637168b.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:01:22.158988 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] cloning 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b@volume-5aa1fdcb-18e6-4c5b-b6cb-6766c637168b.clone_snap' to 'volume-5aa1fdcb-18e6-4c5b-b6cb-6766c637168b' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:01:22.162039 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:01:22.162921 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:22.236462 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:22.315546 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:01:22.483807 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71.deleted is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:01:22.485342 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:01:22.485943 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:01:22.550811 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:01:22.552839 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Marking volume 5aa1fdcb-18e6-4c5b-b6cb-6766c637168b as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:01:22.570380 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to 5aa1fdcb-18e6-4c5b-b6cb-6766c637168b. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 21:01:22.572653 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Creating volume glance metadata for volume 5aa1fdcb-18e6-4c5b-b6cb-6766c637168b backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 21:01:22.728794 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600c4c7a-6d84-45f6-818d-9c07d2127d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aa1fdcb-18e6-4c5b-b6cb-6766c637168b', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:22.738657 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabfea26-ae7b-46f5-be00-d3dbf8bd54ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:22.758015 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Volume volume-5aa1fdcb-18e6-4c5b-b6cb-6766c637168b (5aa1fdcb-18e6-4c5b-b6cb-6766c637168b): created successfully Feb 19 21:01:22.766876 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabfea26-ae7b-46f5-be00-d3dbf8bd54ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:22.780546 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Flow 'volume_create_manager' (ccd826bf-54d1-430e-8935-15b9ae2ed9b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:01:22.809375 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-e4677e05-bbfe-4664-ae2e-8ce9829c4f06 tempest-ServersTestBootFromVolume-953145761 None] Created volume successfully. Feb 19 21:01:30.088312 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3885d940-02d8-4e3f-aaf1-b6871a1c59b8 tempest-GroupsTest-1284250332 None] Group tempest-Group1-707383307: creating Feb 19 21:01:30.198974 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3885d940-02d8-4e3f-aaf1-b6871a1c59b8 tempest-GroupsTest-1284250332 None] Group tempest-Group1-707383307: created successfully Feb 19 21:01:30.222219 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3885d940-02d8-4e3f-aaf1-b6871a1c59b8 tempest-GroupsTest-1284250332 None] Create group completed successfully. Feb 19 21:01:30.295762 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 req-c3896572-b280-442d-aea5-397f41bb04c4 tempest-ServersTestBootFromVolume-953145761 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:01:31.516747 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-5b841d04-5781-4825-be98-d6590fbec1d0 tempest-GroupsTest-1284250332 None] Group tempest-Group2-204978573: creating Feb 19 21:01:31.560522 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 req-c3896572-b280-442d-aea5-397f41bb04c4 tempest-ServersTestBootFromVolume-953145761 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.264s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:01:31.573066 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 req-c3896572-b280-442d-aea5-397f41bb04c4 tempest-ServersTestBootFromVolume-953145761 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5aa1fdcb-18e6-4c5b-b6cb-6766c637168b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '5aa1fdcb-18e6-4c5b-b6cb-6766c637168b', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:01:31.607111 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-5b841d04-5781-4825-be98-d6590fbec1d0 tempest-GroupsTest-1284250332 None] Group tempest-Group2-204978573: created successfully Feb 19 21:01:31.624578 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 req-c3896572-b280-442d-aea5-397f41bb04c4 tempest-ServersTestBootFromVolume-953145761 None] Connection info returned from driver {'name': 'volumes/volume-5aa1fdcb-18e6-4c5b-b6cb-6766c637168b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5aa1fdcb-18e6-4c5b-b6cb-6766c637168b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ba44bed4-3ab1-4f84-b213-0812020b87a3'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:01:31.654417 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-5b841d04-5781-4825-be98-d6590fbec1d0 tempest-GroupsTest-1284250332 None] Create group completed successfully. Feb 19 21:01:31.747706 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 req-c3896572-b280-442d-aea5-397f41bb04c4 tempest-ServersTestBootFromVolume-953145761 None] attachment_update completed successfully. Feb 19 21:01:33.579213 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:01:33.588987 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:01:33.592768 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:01:33.656419 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Flow 'volume_create_manager' (887c1be8-0412-45dc-a6e1-7a299bdd8043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:01:33.669312 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98d7356-41f0-474e-a3f4-119d2ba06802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:33.693493 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:01:33.747156 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98d7356-41f0-474e-a3f4-119d2ba06802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-431715352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42f65c66-d4a1-4edb-b3da-43f54201bab2,host='ncdv-master-1@ceph#ceph',id=d4f6a1da-5d07-46ec-9b11-268869cdf84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdfeb34bdf0400096db0350a674adfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:01:33Z,use_quota=True,user_id='0660e4c1032c4ecaa6b12a41260818b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f1899cd-3361-4f2b-9c1f-1bd667ea1e1f),volume_type_id=3f1899cd-3361-4f2b-9c1f-1bd667ea1e1f)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:33.766109 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898945e1-6109-431c-94b3-d6825c695079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:33.780899 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898945e1-6109-431c-94b3-d6825c695079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:33.800678 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeae41e5-2407-4292-bcfe-f068120dfba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:33.805114 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeae41e5-2407-4292-bcfe-f068120dfba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f6a1da-5d07-46ec-9b11-268869cdf84d', 'volume_name': 'volume-d4f6a1da-5d07-46ec-9b11-268869cdf84d', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:33.814913 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862b08cd-00e8-450f-82f3-7aeb907a7d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:33.819621 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862b08cd-00e8-450f-82f3-7aeb907a7d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:33.833140 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54fb96c-d140-40b0-91ba-935afa9cf9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:33.838431 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Volume d4f6a1da-5d07-46ec-9b11-268869cdf84d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f6a1da-5d07-46ec-9b11-268869cdf84d', 'volume_size': 1} Feb 19 21:01:33.840090 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] creating volume 'volume-d4f6a1da-5d07-46ec-9b11-268869cdf84d' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:01:33.843323 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:34.009456 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] extra_specs: {} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:01:34.010309 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] extra_specs: {} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:01:34.015140 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54fb96c-d140-40b0-91ba-935afa9cf9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f6a1da-5d07-46ec-9b11-268869cdf84d', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:34.030497 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81419fde-6cbd-49de-9b78-5eb50844f202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:34.061491 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Volume volume-d4f6a1da-5d07-46ec-9b11-268869cdf84d (d4f6a1da-5d07-46ec-9b11-268869cdf84d): created successfully Feb 19 21:01:34.065735 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81419fde-6cbd-49de-9b78-5eb50844f202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:34.072312 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Flow 'volume_create_manager' (887c1be8-0412-45dc-a6e1-7a299bdd8043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:01:34.092856 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-2978eb5b-c9bb-4636-80f3-6cb2e0e6d667 tempest-GroupsTest-1284250332 None] Created volume successfully. Feb 19 21:01:35.697446 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7831bf50-af53-4a1b-904c-faf8941df303 tempest-GroupsTest-1284250332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:35.853308 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7831bf50-af53-4a1b-904c-faf8941df303 tempest-GroupsTest-1284250332 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:01:35.853797 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7831bf50-af53-4a1b-904c-faf8941df303 tempest-GroupsTest-1284250332 None] Volume volume-d4f6a1da-5d07-46ec-9b11-268869cdf84d is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:01:35.906233 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7831bf50-af53-4a1b-904c-faf8941df303 tempest-GroupsTest-1284250332 None] deleting rbd volume volume-d4f6a1da-5d07-46ec-9b11-268869cdf84d {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:01:37.083902 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-7831bf50-af53-4a1b-904c-faf8941df303 tempest-GroupsTest-1284250332 None] Created reservations ['76a0d642-774c-4bac-a801-150ae36d664d'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:01:37.130223 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-7831bf50-af53-4a1b-904c-faf8941df303 tempest-GroupsTest-1284250332 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-50101998 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-50101998, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:01:37.131392 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-7831bf50-af53-4a1b-904c-faf8941df303 tempest-GroupsTest-1284250332 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-50101998 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-50101998, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:01:37.175640 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-7831bf50-af53-4a1b-904c-faf8941df303 tempest-GroupsTest-1284250332 None] Created reservations ['c36024fb-1860-4f7f-b3f5-0515c1730602', 'e33dd247-cbfe-4daf-bee8-f49a03935adc', 'cfd385fb-feb2-4f4b-9dd5-5edd10901046', '93669203-2139-4bdf-bd6d-e72183e302ce'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:01:37.369925 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7831bf50-af53-4a1b-904c-faf8941df303 tempest-GroupsTest-1284250332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:37.461879 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7831bf50-af53-4a1b-904c-faf8941df303 tempest-GroupsTest-1284250332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:37.572975 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-7831bf50-af53-4a1b-904c-faf8941df303 tempest-GroupsTest-1284250332 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:01:37.587487 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-7831bf50-af53-4a1b-904c-faf8941df303 tempest-GroupsTest-1284250332 None] Delete group completed successfully. Feb 19 21:01:38.264945 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-3e96810d-22b6-4888-b4d2-9b0b90807f21 tempest-GroupsTest-1284250332 None] Created reservations ['39bb9767-dfa9-4a29-bdd9-e663f7baec83'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:01:38.351835 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3e96810d-22b6-4888-b4d2-9b0b90807f21 tempest-GroupsTest-1284250332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:38.429784 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3e96810d-22b6-4888-b4d2-9b0b90807f21 tempest-GroupsTest-1284250332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:38.493553 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3e96810d-22b6-4888-b4d2-9b0b90807f21 tempest-GroupsTest-1284250332 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:01:38.497984 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3e96810d-22b6-4888-b4d2-9b0b90807f21 tempest-GroupsTest-1284250332 None] Delete group completed successfully. Feb 19 21:01:40.135359 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-822535e2-0e04-49d1-b6c9-fe338a7e2ebf tempest-GroupsTest-1284250332 None] Group tempest-GroupsTest-Group-67570687: creating Feb 19 21:01:40.163121 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-822535e2-0e04-49d1-b6c9-fe338a7e2ebf tempest-GroupsTest-1284250332 None] Group tempest-GroupsTest-Group-67570687: created successfully Feb 19 21:01:40.181676 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-822535e2-0e04-49d1-b6c9-fe338a7e2ebf tempest-GroupsTest-1284250332 None] Create group completed successfully. Feb 19 21:01:42.319599 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:01:42.323929 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:01:42.324407 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:01:42.387100 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Flow 'volume_create_manager' (84abe543-b162-4193-9ca6-11a5f1be35c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:01:42.396894 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b556371-3baa-4680-b073-1519bac5ca26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:42.417358 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:01:42.457895 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b556371-3baa-4680-b073-1519bac5ca26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-554819216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e850f0a-08c5-4fcd-9874-43a87f0f85eb,host='ncdv-master-1@ceph#ceph',id=f5d3f407-3f6f-4070-8913-9072cf1aafe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdfeb34bdf0400096db0350a674adfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:01:42Z,use_quota=True,user_id='0660e4c1032c4ecaa6b12a41260818b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e8cfc60-c582-4024-802a-abec4af8de95),volume_type_id=8e8cfc60-c582-4024-802a-abec4af8de95)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:42.477361 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f987a49-e21e-432f-8e27-19dbcec0736d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:42.492115 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f987a49-e21e-432f-8e27-19dbcec0736d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:42.504963 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74db170-6132-49a2-b472-7b6ff4c95b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:42.519044 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74db170-6132-49a2-b472-7b6ff4c95b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d3f407-3f6f-4070-8913-9072cf1aafe0', 'volume_name': 'volume-f5d3f407-3f6f-4070-8913-9072cf1aafe0', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:42.535988 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abcc5f8-dabb-4e3a-b603-420e366f4a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:42.577104 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abcc5f8-dabb-4e3a-b603-420e366f4a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:42.587321 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7872efbc-1224-4719-994e-cd3191c32bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:42.589892 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Volume f5d3f407-3f6f-4070-8913-9072cf1aafe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d3f407-3f6f-4070-8913-9072cf1aafe0', 'volume_size': 1} Feb 19 21:01:42.590927 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] creating volume 'volume-f5d3f407-3f6f-4070-8913-9072cf1aafe0' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:01:42.591857 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:42.758476 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] extra_specs: {} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:01:42.759790 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] extra_specs: {} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:01:42.765230 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7872efbc-1224-4719-994e-cd3191c32bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d3f407-3f6f-4070-8913-9072cf1aafe0', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:42.771468 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d544a7-08c2-4ed7-b116-77691df4180c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:42.792491 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Volume volume-f5d3f407-3f6f-4070-8913-9072cf1aafe0 (f5d3f407-3f6f-4070-8913-9072cf1aafe0): created successfully Feb 19 21:01:42.799812 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d544a7-08c2-4ed7-b116-77691df4180c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:42.807698 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Flow 'volume_create_manager' (84abe543-b162-4193-9ca6-11a5f1be35c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:01:42.823741 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-81b2556d-45a9-4780-ab24-6a5e9e017d8d tempest-GroupsTest-1284250332 None] Created volume successfully. Feb 19 21:01:44.226063 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:01:44.234408 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:01:44.249216 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:01:44.355023 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Flow 'volume_create_manager' (79eb91ad-88b7-435f-9b6e-d8da7d359666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:01:44.399906 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88faf517-c71f-4c9d-9da8-1d3b49bc0237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:44.416236 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:01:44.456360 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88faf517-c71f-4c9d-9da8-1d3b49bc0237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-872828650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e850f0a-08c5-4fcd-9874-43a87f0f85eb,host='ncdv-master-1@ceph#ceph',id=0556e735-9dbd-4098-91aa-f77da7fe098a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdfeb34bdf0400096db0350a674adfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:01:44Z,use_quota=True,user_id='0660e4c1032c4ecaa6b12a41260818b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e8cfc60-c582-4024-802a-abec4af8de95),volume_type_id=8e8cfc60-c582-4024-802a-abec4af8de95)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:44.477659 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e0f8d7-9a7e-41a8-af4b-a06c753242c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:44.490895 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e0f8d7-9a7e-41a8-af4b-a06c753242c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:44.504820 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177bec1e-9a0c-467c-ba30-c52253c35184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:44.515458 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177bec1e-9a0c-467c-ba30-c52253c35184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0556e735-9dbd-4098-91aa-f77da7fe098a', 'volume_name': 'volume-0556e735-9dbd-4098-91aa-f77da7fe098a', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:44.521693 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5770a9c0-dfcd-41b0-86a9-017698874a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:44.527251 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5770a9c0-dfcd-41b0-86a9-017698874a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:44.559882 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30ecfce-9cc0-497a-aa83-adbce0fa27db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:44.562271 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Volume 0556e735-9dbd-4098-91aa-f77da7fe098a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0556e735-9dbd-4098-91aa-f77da7fe098a', 'volume_size': 1} Feb 19 21:01:44.566834 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] creating volume 'volume-0556e735-9dbd-4098-91aa-f77da7fe098a' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:01:44.569936 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:44.695428 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:01:44.700905 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:01:44.701614 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:01:44.725412 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Flow 'volume_create_manager' (3cb3172a-120a-489e-a8e4-4585a0dfa805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:01:44.734488 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf4e155-41e6-4b4e-9313-6301c13b435f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:44.747842 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] extra_specs: {} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:01:44.748526 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] extra_specs: {} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:01:44.753165 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30ecfce-9cc0-497a-aa83-adbce0fa27db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0556e735-9dbd-4098-91aa-f77da7fe098a', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:44.759602 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af79d58e-4087-47d9-9aac-59cc06064b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:44.771029 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:01:44.817132 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf4e155-41e6-4b4e-9313-6301c13b435f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1984553649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aed146c7-103d-4b73-ba02-11fcb7868c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c91d99923e44a9b49c306044837e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:01:45Z,use_quota=True,user_id='e6e829f8edf3477dbc070d33ae8a6613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:44.827337 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28aded6a-2128-4016-a5fe-0085a5b6238f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:44.837332 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28aded6a-2128-4016-a5fe-0085a5b6238f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:44.847148 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b656f6-c4a8-4b85-8291-71b9700dfed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:44.852875 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b656f6-c4a8-4b85-8291-71b9700dfed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed146c7-103d-4b73-ba02-11fcb7868c65', 'volume_name': 'volume-aed146c7-103d-4b73-ba02-11fcb7868c65', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:44.867260 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ad8706-b55d-4e90-a1b7-70b52e9e0ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:44.879095 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ad8706-b55d-4e90-a1b7-70b52e9e0ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:44.891675 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4aa18d3-55c0-47b2-98ad-96f47fbc8d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:44.896722 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Volume aed146c7-103d-4b73-ba02-11fcb7868c65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed146c7-103d-4b73-ba02-11fcb7868c65', 'volume_size': 1} Feb 19 21:01:44.897194 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] creating volume 'volume-aed146c7-103d-4b73-ba02-11fcb7868c65' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:01:44.898186 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:44.945300 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Volume volume-0556e735-9dbd-4098-91aa-f77da7fe098a (0556e735-9dbd-4098-91aa-f77da7fe098a): created successfully Feb 19 21:01:44.950001 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af79d58e-4087-47d9-9aac-59cc06064b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:44.955456 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Flow 'volume_create_manager' (79eb91ad-88b7-435f-9b6e-d8da7d359666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:01:44.974516 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-14ec9667-1e8a-47c5-a9e0-2af62ed923de tempest-GroupsTest-1284250332 None] Created volume successfully. Feb 19 21:01:45.028842 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:01:45.030136 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:01:45.034746 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4aa18d3-55c0-47b2-98ad-96f47fbc8d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed146c7-103d-4b73-ba02-11fcb7868c65', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:45.047059 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858c6155-ab21-4273-ab1e-c0097b21e5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:45.072267 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Volume volume-aed146c7-103d-4b73-ba02-11fcb7868c65 (aed146c7-103d-4b73-ba02-11fcb7868c65): created successfully Feb 19 21:01:45.080977 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858c6155-ab21-4273-ab1e-c0097b21e5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:45.091290 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Flow 'volume_create_manager' (3cb3172a-120a-489e-a8e4-4585a0dfa805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:01:45.111464 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-81fddf35-6fe9-40a0-85b5-2c5acc1e8507 tempest-ServerRescueNegativeTestJSON-301100829 None] Created volume successfully. Feb 19 21:01:45.673574 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3b432e9e-5da9-4319-af78-048101e0743f tempest-GroupsTest-1284250332 None] Update group completed successfully. Feb 19 21:01:46.878823 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-ee27c5f5-280b-4af1-95a9-65aafe1ec861 req-a61700be-f7cf-4381-80c8-3551abe26c17 tempest-ServerRescueNegativeTestJSON-301100829 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:01:47.113490 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-6663b7bd-1fc2-42f7-a669-a822abe9e51f tempest-GroupsTest-1284250332 None] Update group completed successfully. Feb 19 21:01:47.678864 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-ee27c5f5-280b-4af1-95a9-65aafe1ec861 req-a61700be-f7cf-4381-80c8-3551abe26c17 tempest-ServerRescueNegativeTestJSON-301100829 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.800s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:01:47.679684 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-ee27c5f5-280b-4af1-95a9-65aafe1ec861 req-a61700be-f7cf-4381-80c8-3551abe26c17 tempest-ServerRescueNegativeTestJSON-301100829 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aed146c7-103d-4b73-ba02-11fcb7868c65', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'aed146c7-103d-4b73-ba02-11fcb7868c65', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:01:47.755643 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-ee27c5f5-280b-4af1-95a9-65aafe1ec861 req-a61700be-f7cf-4381-80c8-3551abe26c17 tempest-ServerRescueNegativeTestJSON-301100829 None] Connection info returned from driver {'name': 'volumes/volume-aed146c7-103d-4b73-ba02-11fcb7868c65', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'aed146c7-103d-4b73-ba02-11fcb7868c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b08cc688-a7e4-40d5-ab60-4ab1d9eeffcc'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:01:47.834191 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-ee27c5f5-280b-4af1-95a9-65aafe1ec861 req-a61700be-f7cf-4381-80c8-3551abe26c17 tempest-ServerRescueNegativeTestJSON-301100829 None] attachment_update completed successfully. Feb 19 21:01:48.603287 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:48.686138 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:01:48.686583 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] Volume volume-0556e735-9dbd-4098-91aa-f77da7fe098a is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:01:48.702741 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] deleting rbd volume volume-0556e735-9dbd-4098-91aa-f77da7fe098a {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:01:48.997459 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:49.071443 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:01:49.071985 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] Volume volume-f5d3f407-3f6f-4070-8913-9072cf1aafe0 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:01:49.077279 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] deleting rbd volume volume-f5d3f407-3f6f-4070-8913-9072cf1aafe0 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:01:49.305755 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] Created reservations ['da19c555-fc0c-409f-87df-251efc0235b7'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:01:49.323046 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-718034196 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-718034196, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:01:49.323850 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-718034196 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-718034196, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:01:49.336237 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] Created reservations ['be71c8a5-b0c1-4ffb-9308-eed64fd9248c', 'afafcc8d-12be-4a1e-93f0-bd5dc6fb821a', 'b9e0cb76-2a32-4c89-bfa6-f6d3772c2d70', '19bcf532-e83a-426c-86e9-42bfaf947300'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:01:49.407030 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] Created reservations ['c3e2b0d2-fdf0-4532-b563-8425651eeab2', '3f4be1ec-f617-4754-96eb-06d8c9ac584b', 'a6790133-fc78-4787-b9b9-1e99daf25e2c', '5d028b92-5c0d-4237-94e4-2b8138eef503'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:01:49.501615 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:49.544669 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:49.615547 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:01:49.634610 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-cc2efed7-2e00-4d0a-a8ec-241bc0de79f4 tempest-GroupsTest-1284250332 None] Delete group completed successfully. Feb 19 21:01:59.452698 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:01:59.475574 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:01:59.479706 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:01:59.573240 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Flow 'volume_create_manager' (bdea475f-282d-4fb5-b87b-b4c2ee603987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:01:59.600068 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3404a99-42a6-4c14-acdb-06f36af4146c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:59.634987 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:01:59.663600 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3404a99-42a6-4c14-acdb-06f36af4146c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-237374184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e2bd0a55e44ee2802a7b95678c9d60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:01:59Z,use_quota=True,user_id='bb812b1b093045b1aaa3ce9e3334ff4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:59.673124 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96375716-d605-491a-9777-e4f01a6207dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:59.679142 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96375716-d605-491a-9777-e4f01a6207dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:59.687124 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a0bf06-3356-4712-b230-d231a5276496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:59.697703 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a0bf06-3356-4712-b230-d231a5276496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e', 'volume_name': 'volume-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:59.713018 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce2a046-411f-4376-ac8c-76526323f127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:59.722883 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce2a046-411f-4376-ac8c-76526323f127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:59.733994 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506a641b-c3e0-4c97-a0bb-98ba0ee5ea68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:01:59.738390 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Volume dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e', 'volume_size': 1} Feb 19 21:01:59.740934 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] creating volume 'volume-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:01:59.743832 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:01:59.964516 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:01:59.964893 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:01:59.969822 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506a641b-c3e0-4c97-a0bb-98ba0ee5ea68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:01:59.983337 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae640e1-79bb-4c59-9114-18a1e7b2dea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:02:00.001338 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Volume volume-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e (dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e): created successfully Feb 19 21:02:00.007855 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae640e1-79bb-4c59-9114-18a1e7b2dea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:02:00.016631 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Flow 'volume_create_manager' (bdea475f-282d-4fb5-b87b-b4c2ee603987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:02:00.033924 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-47e0caee-ce75-4911-9a91-5bd791b89714 tempest-VolumesActionsTest-2105468990 None] Created volume successfully. Feb 19 21:02:22.160793 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:02:22.163254 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:02:22.276076 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:02:22.334918 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:02:23.759366 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-9a1ee696-0cc6-43b0-81db-6cc602052cd7 tempest-VolumesActionsTest-2105468990 None] Lock "b'cinder-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e'" acquired by "attach_volume" :: waited 0.022s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:02:23.865712 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-9a1ee696-0cc6-43b0-81db-6cc602052cd7 tempest-VolumesActionsTest-2105468990 None] Attaching volume dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e to instance 9768e057-90fb-4013-8fe7-fb1a08cb3838 at mountpoint /dev/sdb on host None. Feb 19 21:02:23.905338 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-9a1ee696-0cc6-43b0-81db-6cc602052cd7 tempest-VolumesActionsTest-2105468990 None] Attach volume completed successfully. Feb 19 21:02:23.917038 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-9a1ee696-0cc6-43b0-81db-6cc602052cd7 tempest-VolumesActionsTest-2105468990 None] Lock "b'cinder-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e'" released by "attach_volume" :: held 0.158s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:02:24.123214 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-909424bc-1241-4db3-b40c-1ab43957a270 tempest-VolumesActionsTest-2105468990 None] Lock "b'cinder-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e-detach_volume'" acquired by "detach_volume" :: waited 0.018s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:02:24.123817 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-909424bc-1241-4db3-b40c-1ab43957a270 tempest-VolumesActionsTest-2105468990 None] Detaching volume dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e from instance 9768e057-90fb-4013-8fe7-fb1a08cb3838. Feb 19 21:02:24.203000 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-909424bc-1241-4db3-b40c-1ab43957a270 tempest-VolumesActionsTest-2105468990 None] Detach volume completed successfully. Feb 19 21:02:24.210625 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-909424bc-1241-4db3-b40c-1ab43957a270 tempest-VolumesActionsTest-2105468990 None] Lock "b'cinder-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e-detach_volume'" released by "detach_volume" :: held 0.087s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:02:26.657100 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-ee04e3d1-5592-4411-80e9-dd8bdd40e36b req-395df03b-d8ce-4db8-ba8c-90f803f6e183 tempest-ServerRescueNegativeTestJSON-301100829 None] Terminate volume connection completed successfully. Feb 19 21:02:26.657737 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-ee04e3d1-5592-4411-80e9-dd8bdd40e36b req-395df03b-d8ce-4db8-ba8c-90f803f6e183 tempest-ServerRescueNegativeTestJSON-301100829 None] Deleting attachment b08cc688-a7e4-40d5-ab60-4ab1d9eeffcc. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:02:27.538417 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-e8ab2a01-103e-46e6-9b51-b05f9cbcd35f tempest-ServerRescueNegativeTestJSON-301100829 None] Lock "b'cinder-aed146c7-103d-4b73-ba02-11fcb7868c65-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:02:27.633622 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e8ab2a01-103e-46e6-9b51-b05f9cbcd35f tempest-ServerRescueNegativeTestJSON-301100829 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:02:27.771382 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e8ab2a01-103e-46e6-9b51-b05f9cbcd35f tempest-ServerRescueNegativeTestJSON-301100829 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:02:27.772034 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e8ab2a01-103e-46e6-9b51-b05f9cbcd35f tempest-ServerRescueNegativeTestJSON-301100829 None] Volume volume-aed146c7-103d-4b73-ba02-11fcb7868c65 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:02:27.826532 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e8ab2a01-103e-46e6-9b51-b05f9cbcd35f tempest-ServerRescueNegativeTestJSON-301100829 None] deleting rbd volume volume-aed146c7-103d-4b73-ba02-11fcb7868c65 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:02:28.686933 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-e8ab2a01-103e-46e6-9b51-b05f9cbcd35f tempest-ServerRescueNegativeTestJSON-301100829 None] Created reservations ['68573652-66b9-4c8c-848c-5ad8f51dd4c5', '33b7530b-70bc-49ac-b509-afc78c1ccb90', '427b9f23-4a6e-4a8a-b04b-4249f3e623d2', '4e7b78da-e69e-48fc-aa66-824d4257fec8'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:02:28.776302 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e8ab2a01-103e-46e6-9b51-b05f9cbcd35f tempest-ServerRescueNegativeTestJSON-301100829 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:02:28.853887 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e8ab2a01-103e-46e6-9b51-b05f9cbcd35f tempest-ServerRescueNegativeTestJSON-301100829 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:02:28.893523 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-e8ab2a01-103e-46e6-9b51-b05f9cbcd35f tempest-ServerRescueNegativeTestJSON-301100829 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:02:28.908947 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-e8ab2a01-103e-46e6-9b51-b05f9cbcd35f tempest-ServerRescueNegativeTestJSON-301100829 None] Deleted volume successfully. Feb 19 21:02:28.973876 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-e8ab2a01-103e-46e6-9b51-b05f9cbcd35f tempest-ServerRescueNegativeTestJSON-301100829 None] Lock "b'cinder-aed146c7-103d-4b73-ba02-11fcb7868c65-delete_volume'" released by "delete_volume" :: held 1.436s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:02:29.129256 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a54ab36b-514a-4230-9c29-b2067323d647 tempest-ServerRescueNegativeTestJSON-301100829 None] Lock "b'cinder-1a51d125-779d-4161-9229-3d61c08f7a7d-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:02:29.273421 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a54ab36b-514a-4230-9c29-b2067323d647 tempest-ServerRescueNegativeTestJSON-301100829 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:02:29.487909 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a54ab36b-514a-4230-9c29-b2067323d647 tempest-ServerRescueNegativeTestJSON-301100829 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:02:29.488906 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a54ab36b-514a-4230-9c29-b2067323d647 tempest-ServerRescueNegativeTestJSON-301100829 None] Volume volume-1a51d125-779d-4161-9229-3d61c08f7a7d is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:02:29.517993 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a54ab36b-514a-4230-9c29-b2067323d647 tempest-ServerRescueNegativeTestJSON-301100829 None] deleting rbd volume volume-1a51d125-779d-4161-9229-3d61c08f7a7d {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:02:30.711295 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-a54ab36b-514a-4230-9c29-b2067323d647 tempest-ServerRescueNegativeTestJSON-301100829 None] Created reservations ['68ac7353-3f8c-44c1-bb3c-7adf1df6a2c6', '31386364-e7ba-4d03-b9da-465491cd71c8', '92dacaa7-0b5d-4c33-b95d-c5e0165c00e3', '99afd65b-d2fd-48cd-9bd8-d6d0861479e5'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:02:30.891456 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a54ab36b-514a-4230-9c29-b2067323d647 tempest-ServerRescueNegativeTestJSON-301100829 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:02:30.976055 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a54ab36b-514a-4230-9c29-b2067323d647 tempest-ServerRescueNegativeTestJSON-301100829 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:02:31.080221 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-a54ab36b-514a-4230-9c29-b2067323d647 tempest-ServerRescueNegativeTestJSON-301100829 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:02:31.085932 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a54ab36b-514a-4230-9c29-b2067323d647 tempest-ServerRescueNegativeTestJSON-301100829 None] Deleted volume successfully. Feb 19 21:02:31.131639 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a54ab36b-514a-4230-9c29-b2067323d647 tempest-ServerRescueNegativeTestJSON-301100829 None] Lock "b'cinder-1a51d125-779d-4161-9229-3d61c08f7a7d-delete_volume'" released by "delete_volume" :: held 1.999s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:02:50.272533 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-8c15844f-f119-4d93-abb0-55555556288a tempest-VolumesActionsTest-2105468990 None] Lock "b'cinder-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e'" acquired by "attach_volume" :: waited 0.035s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:02:50.417084 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8c15844f-f119-4d93-abb0-55555556288a tempest-VolumesActionsTest-2105468990 None] Attaching volume dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e to instance e61315ad-086f-4a49-b685-c13202a03d98 at mountpoint /dev/sdb on host None. Feb 19 21:02:50.477170 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8c15844f-f119-4d93-abb0-55555556288a tempest-VolumesActionsTest-2105468990 None] Attach volume completed successfully. Feb 19 21:02:50.497025 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-8c15844f-f119-4d93-abb0-55555556288a tempest-VolumesActionsTest-2105468990 None] Lock "b'cinder-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e'" released by "attach_volume" :: held 0.222s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:02:51.032706 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-63f51699-957e-4d43-9c13-e41ae618c089 tempest-VolumesActionsTest-2105468990 None] Lock "b'cinder-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e-detach_volume'" acquired by "detach_volume" :: waited 0.012s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:02:51.033504 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-63f51699-957e-4d43-9c13-e41ae618c089 tempest-VolumesActionsTest-2105468990 None] Detaching volume dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e from instance e61315ad-086f-4a49-b685-c13202a03d98. Feb 19 21:02:51.096514 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-63f51699-957e-4d43-9c13-e41ae618c089 tempest-VolumesActionsTest-2105468990 None] Detach volume completed successfully. Feb 19 21:02:51.101543 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-63f51699-957e-4d43-9c13-e41ae618c089 tempest-VolumesActionsTest-2105468990 None] Lock "b'cinder-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e-detach_volume'" released by "detach_volume" :: held 0.069s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:02:59.365245 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-c678268d-df0a-4273-a211-4f812d320fb8 tempest-VolumesActionsTest-2105468990 None] Running cmd (subprocess): rbd export --pool volumes volume-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e /opt/stack/data/cinder/conversion/volume-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e-73adaf0f-138e-4fb0-a62c-5ab002c187d7 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:03:00.238222 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-c678268d-df0a-4273-a211-4f812d320fb8 tempest-VolumesActionsTest-2105468990 None] CMD "rbd export --pool volumes volume-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e /opt/stack/data/cinder/conversion/volume-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e-73adaf0f-138e-4fb0-a62c-5ab002c187d7 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.873s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:03:00.251571 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.image_utils [None req-c678268d-df0a-4273-a211-4f812d320fb8 tempest-VolumesActionsTest-2105468990 None] 73adaf0f-138e-4fb0-a62c-5ab002c187d7 was raw, no need to convert to raw {{(pid=129319) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Feb 19 21:03:22.166277 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:03:22.167239 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:03:22.247315 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:03:22.343435 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:03:29.577479 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-bda221a8-b659-4c5f-b036-b49e569ea268 req-f70c23d6-dbfe-4328-bca3-eeb01103cb9e tempest-ServersTestBootFromVolume-953145761 None] Terminate volume connection completed successfully. Feb 19 21:03:29.578239 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-bda221a8-b659-4c5f-b036-b49e569ea268 req-f70c23d6-dbfe-4328-bca3-eeb01103cb9e tempest-ServersTestBootFromVolume-953145761 None] Deleting attachment ba44bed4-3ab1-4f84-b213-0812020b87a3. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:03:29.898471 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-bda221a8-b659-4c5f-b036-b49e569ea268 req-c242f41f-b58a-4cdd-a7ab-1265bcaab5fc tempest-ServersTestBootFromVolume-953145761 None] Lock "b'cinder-5aa1fdcb-18e6-4c5b-b6cb-6766c637168b-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:03:29.989990 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-bda221a8-b659-4c5f-b036-b49e569ea268 req-c242f41f-b58a-4cdd-a7ab-1265bcaab5fc tempest-ServersTestBootFromVolume-953145761 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:03:30.162320 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-bda221a8-b659-4c5f-b036-b49e569ea268 req-c242f41f-b58a-4cdd-a7ab-1265bcaab5fc tempest-ServersTestBootFromVolume-953145761 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:03:30.186619 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-bda221a8-b659-4c5f-b036-b49e569ea268 req-c242f41f-b58a-4cdd-a7ab-1265bcaab5fc tempest-ServersTestBootFromVolume-953145761 None] deleting rbd volume volume-5aa1fdcb-18e6-4c5b-b6cb-6766c637168b {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:03:31.008086 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-bda221a8-b659-4c5f-b036-b49e569ea268 req-c242f41f-b58a-4cdd-a7ab-1265bcaab5fc tempest-ServersTestBootFromVolume-953145761 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:03:31.076520 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-bda221a8-b659-4c5f-b036-b49e569ea268 req-c242f41f-b58a-4cdd-a7ab-1265bcaab5fc tempest-ServersTestBootFromVolume-953145761 None] deleting parent snapshot volume-5aa1fdcb-18e6-4c5b-b6cb-6766c637168b.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:03:32.258633 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [req-bda221a8-b659-4c5f-b036-b49e569ea268 req-c242f41f-b58a-4cdd-a7ab-1265bcaab5fc tempest-ServersTestBootFromVolume-953145761 None] Created reservations ['734bd47d-7278-49e3-b353-555811472582', 'f5233caa-d5d7-415f-8a13-b33e94bd8e0b', '75253174-a35f-4ef2-9e40-53605ebdba05', '437d29eb-a545-48e6-a2a6-92f90677b716'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:03:32.388981 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-bda221a8-b659-4c5f-b036-b49e569ea268 req-c242f41f-b58a-4cdd-a7ab-1265bcaab5fc tempest-ServersTestBootFromVolume-953145761 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:03:32.463077 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-bda221a8-b659-4c5f-b036-b49e569ea268 req-c242f41f-b58a-4cdd-a7ab-1265bcaab5fc tempest-ServersTestBootFromVolume-953145761 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:03:32.522615 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [req-bda221a8-b659-4c5f-b036-b49e569ea268 req-c242f41f-b58a-4cdd-a7ab-1265bcaab5fc tempest-ServersTestBootFromVolume-953145761 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:03:32.537933 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-bda221a8-b659-4c5f-b036-b49e569ea268 req-c242f41f-b58a-4cdd-a7ab-1265bcaab5fc tempest-ServersTestBootFromVolume-953145761 None] Deleted volume successfully. Feb 19 21:03:32.581052 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-bda221a8-b659-4c5f-b036-b49e569ea268 req-c242f41f-b58a-4cdd-a7ab-1265bcaab5fc tempest-ServersTestBootFromVolume-953145761 None] Lock "b'cinder-5aa1fdcb-18e6-4c5b-b6cb-6766c637168b-delete_volume'" released by "delete_volume" :: held 2.682s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:03:44.996149 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c678268d-df0a-4273-a211-4f812d320fb8 tempest-VolumesActionsTest-2105468990 None] Uploaded volume to glance image-id: 73adaf0f-138e-4fb0-a62c-5ab002c187d7. {{(pid=129319) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1747}} Feb 19 21:03:45.019116 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-c678268d-df0a-4273-a211-4f812d320fb8 tempest-VolumesActionsTest-2105468990 None] Copy volume to image completed successfully. Feb 19 21:03:46.434799 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-2fd7dab7-072c-48c9-b1f6-f27d63068e38 tempest-VolumesActionsTest-2105468990 None] Lock "b'cinder-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:03:46.505185 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2fd7dab7-072c-48c9-b1f6-f27d63068e38 tempest-VolumesActionsTest-2105468990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:03:46.621651 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2fd7dab7-072c-48c9-b1f6-f27d63068e38 tempest-VolumesActionsTest-2105468990 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:03:46.622127 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2fd7dab7-072c-48c9-b1f6-f27d63068e38 tempest-VolumesActionsTest-2105468990 None] Volume volume-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:03:46.633506 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2fd7dab7-072c-48c9-b1f6-f27d63068e38 tempest-VolumesActionsTest-2105468990 None] deleting rbd volume volume-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:03:47.177052 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-2fd7dab7-072c-48c9-b1f6-f27d63068e38 tempest-VolumesActionsTest-2105468990 None] Created reservations ['6b9b8628-3113-4e4f-83ec-f3157eb00e37', '8ffbe55a-790d-471b-9bf1-ecc125ae995d', '7e284e1e-1f69-4f38-8c2b-34905dd25ada', '1e394221-3e29-47b9-aecf-66345e008bba'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:03:47.255885 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2fd7dab7-072c-48c9-b1f6-f27d63068e38 tempest-VolumesActionsTest-2105468990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:03:47.335989 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2fd7dab7-072c-48c9-b1f6-f27d63068e38 tempest-VolumesActionsTest-2105468990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:03:47.418800 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-2fd7dab7-072c-48c9-b1f6-f27d63068e38 tempest-VolumesActionsTest-2105468990 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:03:47.431979 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-2fd7dab7-072c-48c9-b1f6-f27d63068e38 tempest-VolumesActionsTest-2105468990 None] Deleted volume successfully. Feb 19 21:03:47.456550 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-2fd7dab7-072c-48c9-b1f6-f27d63068e38 tempest-VolumesActionsTest-2105468990 None] Lock "b'cinder-dd69c7d0-2e69-4b6e-8cc7-3f4424f6cd7e-delete_volume'" released by "delete_volume" :: held 1.021s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:03:57.303901 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:03:57.324800 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:03:57.325967 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:03:57.379922 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Flow 'volume_create_manager' (7cc8d4d9-d22d-4c51-8631-f814a397a54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:03:57.388442 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7d1080-1e61-44b4-8fa0-935924470237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:03:57.419234 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:03:57.442821 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7d1080-1e61-44b4-8fa0-935924470237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1598422372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3c4659bd-63a9-4ccf-8885-d4725562e8a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9b396737a34280bdc448a2b0df5a7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:03:57Z,use_quota=True,user_id='0edf621841d44514b6082172d15af2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:03:57.449147 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c828d9-c04b-4724-a698-d145cb323030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:03:57.457551 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c828d9-c04b-4724-a698-d145cb323030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:03:57.465175 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b495d905-6986-4964-bb56-4d8c25533390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:03:57.471111 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b495d905-6986-4964-bb56-4d8c25533390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c4659bd-63a9-4ccf-8885-d4725562e8a0', 'volume_name': 'volume-3c4659bd-63a9-4ccf-8885-d4725562e8a0', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:03:57.476893 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59dff68-8dd6-49a7-a542-dc67c618bee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:03:57.484010 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59dff68-8dd6-49a7-a542-dc67c618bee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:03:57.489456 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4483280c-28ba-4172-b08c-e01c5aa5643b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:03:57.491517 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Volume 3c4659bd-63a9-4ccf-8885-d4725562e8a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c4659bd-63a9-4ccf-8885-d4725562e8a0', 'volume_size': 1} Feb 19 21:03:57.492086 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] creating volume 'volume-3c4659bd-63a9-4ccf-8885-d4725562e8a0' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:03:57.493620 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:03:57.639335 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:03:57.639844 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:03:57.644275 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4483280c-28ba-4172-b08c-e01c5aa5643b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c4659bd-63a9-4ccf-8885-d4725562e8a0', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:03:57.653243 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af91f688-dd5f-4e82-85b2-e10bfd6e5806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:03:57.670468 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Volume volume-3c4659bd-63a9-4ccf-8885-d4725562e8a0 (3c4659bd-63a9-4ccf-8885-d4725562e8a0): created successfully Feb 19 21:03:57.681231 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af91f688-dd5f-4e82-85b2-e10bfd6e5806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:03:57.702383 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Flow 'volume_create_manager' (7cc8d4d9-d22d-4c51-8631-f814a397a54e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:03:57.716311 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-2ccbf48c-3703-4c25-911a-af26cebaab62 tempest-VolumesSnapshotTestJSON-2140298196 None] Created volume successfully. Feb 19 21:03:58.565713 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ed43b15d-4669-4cda-88d1-3e1c0791c6d2 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:03:59.315044 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ed43b15d-4669-4cda-88d1-3e1c0791c6d2 tempest-VolumesSnapshotTestJSON-2140298196 None] Create snapshot completed successfully Feb 19 21:04:00.250076 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.driver [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] Creating a new backup for volume volume-3c4659bd-63a9-4ccf-8885-d4725562e8a0. {{(pid=129319) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1212}} Feb 19 21:04:00.289001 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] cloning volumes/volume-3c4659bd-63a9-4ccf-8885-d4725562e8a0@snapshot-1a3ea589-1e1c-4cc0-ad9c-0f18a0026976 to volume-66378b9d-c00b-4108-96c5-6e98f5196713 {{(pid=129319) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 19 21:04:00.289780 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:04:00.383405 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:04:00.615592 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:04:00.616006 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:04:00.622239 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:04:00.721558 ncdv-master-1 cinder-volume[129319]: WARNING cinder.volume.drivers.rbd [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues Feb 19 21:04:00.785506 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-19T21:03:59Z,data_timestamp=2022-02-19T21:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-314568189',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=e1c58687-1994-4d46-9f9b-29fc0aee6533,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='ba9b396737a34280bdc448a2b0df5a7e',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='1a3ea589-1e1c-4cc0-ad9c-0f18a0026976',status='creating',temp_snapshot_id=None,temp_volume_id='66378b9d-c00b-4108-96c5-6e98f5196713',updated_at=None,user_id='0edf621841d44514b6082172d15af2a7',volume_id=3c4659bd-63a9-4ccf-8885-d4725562e8a0) Feb 19 21:04:00.793327 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.backup.rpcapi [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] continue_backup in rpcapi backup_id e1c58687-1994-4d46-9f9b-29fc0aee6533 {{(pid=129319) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 19 21:04:04.049522 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:04:04.053600 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:04:04.054160 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:04:04.075987 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Flow 'volume_create_manager' (cfc44516-a01a-473e-8c1d-7a91217bff85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:04:04.083156 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef65759-66b4-461d-ab25-dd25cefe6852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:04.093239 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:04:04.112761 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef65759-66b4-461d-ab25-dd25cefe6852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-519586949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=91b63972-f419-40a4-8d4f-37469baee526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ad9ca9c0944ba68443aaa71a10eb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:04:04Z,use_quota=True,user_id='a388edbf88ba4749b3abb2a42b750757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:04.120539 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f379c599-3430-4ec3-bd77-146592943d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:04.126163 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f379c599-3430-4ec3-bd77-146592943d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:04.134768 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bce8245-8b4b-4fda-98e8-fac66f4ec155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:04.142485 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bce8245-8b4b-4fda-98e8-fac66f4ec155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b63972-f419-40a4-8d4f-37469baee526', 'volume_name': 'volume-91b63972-f419-40a4-8d4f-37469baee526', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:04.148777 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c37a6b-f319-4fdc-922e-ed6cdae28899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:04.155125 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c37a6b-f319-4fdc-922e-ed6cdae28899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:04.160998 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666a9c68-f719-4c8e-b816-7dbbe15226d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:04.162870 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Volume 91b63972-f419-40a4-8d4f-37469baee526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b63972-f419-40a4-8d4f-37469baee526', 'volume_size': 1} Feb 19 21:04:04.163447 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] creating volume 'volume-91b63972-f419-40a4-8d4f-37469baee526' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:04:04.164718 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:04:04.295315 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:04:04.295808 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:04:04.300241 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666a9c68-f719-4c8e-b816-7dbbe15226d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b63972-f419-40a4-8d4f-37469baee526', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:04.309017 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c2d114-7e08-4d58-987a-b22fc77ed5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:04.335427 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Volume volume-91b63972-f419-40a4-8d4f-37469baee526 (91b63972-f419-40a4-8d4f-37469baee526): created successfully Feb 19 21:04:04.340258 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c2d114-7e08-4d58-987a-b22fc77ed5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:04.347452 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Flow 'volume_create_manager' (cfc44516-a01a-473e-8c1d-7a91217bff85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:04:04.368116 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-35d32971-e24c-457d-96ea-9ec2b31e5b8f tempest-AttachVolumeShelveTestJSON-322283970 None] Created volume successfully. Feb 19 21:04:07.720000 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:04:08.928646 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.207s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:04:08.931494 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-66378b9d-c00b-4108-96c5-6e98f5196713', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '66378b9d-c00b-4108-96c5-6e98f5196713', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:04:08.964898 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] Initialize volume connection completed successfully. Feb 19 21:04:22.168801 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:04:22.170841 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:04:22.271848 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:04:22.361184 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:04:23.706130 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] Terminate volume connection completed successfully. Feb 19 21:04:23.740423 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] Remove volume export completed successfully. Feb 19 21:04:23.800939 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-66378b9d-c00b-4108-96c5-6e98f5196713-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:04:23.849477 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:04:23.944382 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:04:23.963750 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] deleting rbd volume volume-66378b9d-c00b-4108-96c5-6e98f5196713 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:04:24.359218 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] Deleted volume successfully. Feb 19 21:04:24.375074 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-628316d9-3cff-4536-880c-663a36eb7d87 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-66378b9d-c00b-4108-96c5-6e98f5196713-delete_volume'" released by "delete_volume" :: held 0.574s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:04:49.904598 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:04:49.912236 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:04:49.913039 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:04:49.970970 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Flow 'volume_create_manager' (fa47e374-2de3-4921-b86c-0a58805419ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:04:49.986406 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1745059-505d-4a77-87f4-6e9ca0655e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:50.001014 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:04:50.024959 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1745059-505d-4a77-87f4-6e9ca0655e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-635887314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f9a0d149-5bcf-434f-90cb-ef3429b93f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee065d1c70940cd8caadd525737c593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:04:50Z,use_quota=True,user_id='e36bd5d716db4dba866a1bcd880accb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:50.038163 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e76b983-95a6-434d-9c62-a6368c9427e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:50.043354 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e76b983-95a6-434d-9c62-a6368c9427e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:50.049559 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ce6939-40af-4bfb-8d44-f2d18b3e40da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:50.073808 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ce6939-40af-4bfb-8d44-f2d18b3e40da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a0d149-5bcf-434f-90cb-ef3429b93f95', 'volume_name': 'volume-f9a0d149-5bcf-434f-90cb-ef3429b93f95', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:50.084118 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2c4365-e7ed-4bc7-b1ab-45eba2e7893b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:50.092400 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2c4365-e7ed-4bc7-b1ab-45eba2e7893b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:50.097800 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6fa729-c817-479e-9c1a-3d88745adf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:50.098924 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Volume f9a0d149-5bcf-434f-90cb-ef3429b93f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a0d149-5bcf-434f-90cb-ef3429b93f95', 'volume_size': 1} Feb 19 21:04:50.099325 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] creating volume 'volume-f9a0d149-5bcf-434f-90cb-ef3429b93f95' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:04:50.100522 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:04:50.203656 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:04:50.204179 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:04:50.208377 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6fa729-c817-479e-9c1a-3d88745adf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a0d149-5bcf-434f-90cb-ef3429b93f95', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:50.217167 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933e38c7-afb7-4d24-abd1-b4cc92fa2833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:50.230802 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Volume volume-f9a0d149-5bcf-434f-90cb-ef3429b93f95 (f9a0d149-5bcf-434f-90cb-ef3429b93f95): created successfully Feb 19 21:04:50.234968 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933e38c7-afb7-4d24-abd1-b4cc92fa2833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:50.242049 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Flow 'volume_create_manager' (fa47e374-2de3-4921-b86c-0a58805419ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:04:50.257830 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ef1c252d-560d-46c7-b570-764afa83b03a tempest-ServersNegativeTestJSON-36785744 None] Created volume successfully. Feb 19 21:04:51.716934 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:04:51.720625 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:04:51.721286 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:04:51.794200 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Flow 'volume_create_manager' (e6a101fc-064c-46c5-a401-0537e4336e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:04:51.814051 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeeef9e6-a518-4ac1-b965-a977a4b90c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:51.820592 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:04:51.842500 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeeef9e6-a518-4ac1-b965-a977a4b90c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1987566922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=493c2856-8fb5-4b6f-bc89-58eb61177127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9b396737a34280bdc448a2b0df5a7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:04:52Z,use_quota=True,user_id='0edf621841d44514b6082172d15af2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:51.867845 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1212acae-0cce-4f07-b5e8-c96db31ef276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:51.873236 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1212acae-0cce-4f07-b5e8-c96db31ef276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:51.878944 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc98b4d0-de1b-47e4-a125-444f612ae229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:52.058906 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc98b4d0-de1b-47e4-a125-444f612ae229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '493c2856-8fb5-4b6f-bc89-58eb61177127', 'volume_name': 'volume-493c2856-8fb5-4b6f-bc89-58eb61177127', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:52.064517 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca7c9b9-5b85-4542-a4e1-49f91128baee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:52.076191 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca7c9b9-5b85-4542-a4e1-49f91128baee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:52.092179 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7f4964-dc0f-4401-8015-ec363c3bfabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:52.093592 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Volume 493c2856-8fb5-4b6f-bc89-58eb61177127: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-493c2856-8fb5-4b6f-bc89-58eb61177127', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 21:04:52.094256 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Cloning 493c2856-8fb5-4b6f-bc89-58eb61177127 from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 21:04:52.112736 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.018s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:04:52.133222 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 4, 52, 120529)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:04:52.135743 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:04:52.136431 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Found cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 19 21:04:52.148292 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 0.036s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:04:52.149271 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 21:04:52.162790 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 4, 52, 155757)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:04:52.163209 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:04:52.163788 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Creating from source image-volume d609c16c-1e31-4237-8163-d85a8fcc768b {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 19 21:04:52.185843 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:04:52.296959 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] creating snapshot='volume-493c2856-8fb5-4b6f-bc89-58eb61177127.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:04:53.237518 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] cloning 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b@volume-493c2856-8fb5-4b6f-bc89-58eb61177127.clone_snap' to 'volume-493c2856-8fb5-4b6f-bc89-58eb61177127' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:04:53.471291 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71.deleted is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:04:53.473726 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:04:53.474460 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:04:53.517615 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:04:53.518299 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Marking volume 493c2856-8fb5-4b6f-bc89-58eb61177127 as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:04:53.537586 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to 493c2856-8fb5-4b6f-bc89-58eb61177127. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 21:04:53.538018 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Creating volume glance metadata for volume 493c2856-8fb5-4b6f-bc89-58eb61177127 backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 21:04:53.672102 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7f4964-dc0f-4401-8015-ec363c3bfabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-493c2856-8fb5-4b6f-bc89-58eb61177127', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:53.685260 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552df2a8-760e-447e-bfd6-ea9b7204842b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:53.719808 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Volume volume-493c2856-8fb5-4b6f-bc89-58eb61177127 (493c2856-8fb5-4b6f-bc89-58eb61177127): created successfully Feb 19 21:04:53.723877 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552df2a8-760e-447e-bfd6-ea9b7204842b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:53.741872 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Flow 'volume_create_manager' (e6a101fc-064c-46c5-a401-0537e4336e33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:04:53.771583 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a0e990a6-a590-4fc2-904e-4bbfcc40acde tempest-VolumesSnapshotTestJSON-2140298196 None] Created volume successfully. Feb 19 21:04:54.350004 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:04:54.359990 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:04:54.362638 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:04:54.411468 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Flow 'volume_create_manager' (89f5b652-8b4b-48c5-adb3-cd14a5083acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:04:54.445024 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2e0bd4-d964-487f-a2dd-4219ee247948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:54.457618 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:04:54.488093 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2e0bd4-d964-487f-a2dd-4219ee247948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1400736585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2af565df-bf28-4e7b-b3c5-f62ffab1dd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee065d1c70940cd8caadd525737c593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:04:54Z,use_quota=True,user_id='e36bd5d716db4dba866a1bcd880accb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:54.508712 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afb7e93-71d4-4a09-9540-9cce82453b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:54.514921 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afb7e93-71d4-4a09-9540-9cce82453b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:54.521475 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ef3b19-1b49-4f4f-989a-def5cc713f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:54.528262 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ef3b19-1b49-4f4f-989a-def5cc713f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2af565df-bf28-4e7b-b3c5-f62ffab1dd66', 'volume_name': 'volume-2af565df-bf28-4e7b-b3c5-f62ffab1dd66', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:54.534703 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfe872f-0402-468d-a5dc-cd05e6b1c29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:54.539728 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfe872f-0402-468d-a5dc-cd05e6b1c29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:54.546125 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0be3e30-3c3e-473d-bd6d-13e73b7a6319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:54.547510 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Volume 2af565df-bf28-4e7b-b3c5-f62ffab1dd66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2af565df-bf28-4e7b-b3c5-f62ffab1dd66', 'volume_size': 1} Feb 19 21:04:54.548109 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] creating volume 'volume-2af565df-bf28-4e7b-b3c5-f62ffab1dd66' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:04:54.549358 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:04:54.647889 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:04:54.648415 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:04:54.652939 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0be3e30-3c3e-473d-bd6d-13e73b7a6319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2af565df-bf28-4e7b-b3c5-f62ffab1dd66', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:54.657582 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37478c9c-11d8-4182-89c4-a3dcb99fb5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:04:54.698861 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Volume volume-2af565df-bf28-4e7b-b3c5-f62ffab1dd66 (2af565df-bf28-4e7b-b3c5-f62ffab1dd66): created successfully Feb 19 21:04:54.712070 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37478c9c-11d8-4182-89c4-a3dcb99fb5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:04:54.750609 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Flow 'volume_create_manager' (89f5b652-8b4b-48c5-adb3-cd14a5083acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:04:54.771500 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-06313149-6ac6-46e7-9816-50ed7748a229 tempest-ServersNegativeTestJSON-36785744 None] Created volume successfully. Feb 19 21:04:56.007064 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-aff44e88-1b57-4437-b440-5e4e21ec372a req-46c75283-ddc0-4c35-9c31-540b547f0713 tempest-VolumesSnapshotTestJSON-2140298196 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:04:57.117197 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-aff44e88-1b57-4437-b440-5e4e21ec372a req-46c75283-ddc0-4c35-9c31-540b547f0713 tempest-VolumesSnapshotTestJSON-2140298196 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.110s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:04:57.118030 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-aff44e88-1b57-4437-b440-5e4e21ec372a req-46c75283-ddc0-4c35-9c31-540b547f0713 tempest-VolumesSnapshotTestJSON-2140298196 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-493c2856-8fb5-4b6f-bc89-58eb61177127', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '493c2856-8fb5-4b6f-bc89-58eb61177127', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:04:57.166612 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-aff44e88-1b57-4437-b440-5e4e21ec372a req-46c75283-ddc0-4c35-9c31-540b547f0713 tempest-VolumesSnapshotTestJSON-2140298196 None] Connection info returned from driver {'name': 'volumes/volume-493c2856-8fb5-4b6f-bc89-58eb61177127', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '493c2856-8fb5-4b6f-bc89-58eb61177127', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8d663760-320d-41fd-ae7f-139ea99f1964'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:04:57.294325 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-aff44e88-1b57-4437-b440-5e4e21ec372a req-46c75283-ddc0-4c35-9c31-540b547f0713 tempest-VolumesSnapshotTestJSON-2140298196 None] attachment_update completed successfully. Feb 19 21:04:59.647505 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cc041cdf-3670-4bca-8e74-f36bb73967a3 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:05:00.525871 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-cc041cdf-3670-4bca-8e74-f36bb73967a3 tempest-VolumesSnapshotTestJSON-2140298196 None] Create snapshot completed successfully Feb 19 21:05:01.251149 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-88e23f1e-5913-4ac8-bfa8-2c6658ddf345 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:05:02.551654 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-88e23f1e-5913-4ac8-bfa8-2c6658ddf345 tempest-VolumesSnapshotTestJSON-2140298196 None] Create snapshot completed successfully Feb 19 21:05:03.655516 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-913dd944-8e84-4677-99f3-8f9ee3985921 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:05:04.677716 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-913dd944-8e84-4677-99f3-8f9ee3985921 tempest-VolumesSnapshotTestJSON-2140298196 None] Create snapshot completed successfully Feb 19 21:05:05.803288 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-f95b89b2-756d-4fda-8f56-2bcbcf524abb tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-84953b66-7b55-4a22-a311-5d8902272295-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:05:05.807214 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f95b89b2-756d-4fda-8f56-2bcbcf524abb tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:05:21.448685 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-30ff26b4-139f-4f83-948e-ff18fe14280c req-009a0481-e953-4fc7-89a8-38d53898b648 tempest-AttachVolumeShelveTestJSON-322283970 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:05:22.171131 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:05:22.175674 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:05:22.268992 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:05:22.372078 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:05:22.920695 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-30ff26b4-139f-4f83-948e-ff18fe14280c req-009a0481-e953-4fc7-89a8-38d53898b648 tempest-AttachVolumeShelveTestJSON-322283970 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.472s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:05:22.921350 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-30ff26b4-139f-4f83-948e-ff18fe14280c req-009a0481-e953-4fc7-89a8-38d53898b648 tempest-AttachVolumeShelveTestJSON-322283970 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-91b63972-f419-40a4-8d4f-37469baee526', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '91b63972-f419-40a4-8d4f-37469baee526', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:05:22.978251 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-30ff26b4-139f-4f83-948e-ff18fe14280c req-009a0481-e953-4fc7-89a8-38d53898b648 tempest-AttachVolumeShelveTestJSON-322283970 None] Connection info returned from driver {'name': 'volumes/volume-91b63972-f419-40a4-8d4f-37469baee526', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '91b63972-f419-40a4-8d4f-37469baee526', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '46c5c1e6-c569-451d-a6ab-cd639bea279f'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:05:23.066430 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-30ff26b4-139f-4f83-948e-ff18fe14280c req-009a0481-e953-4fc7-89a8-38d53898b648 tempest-AttachVolumeShelveTestJSON-322283970 None] attachment_update completed successfully. Feb 19 21:05:36.245970 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-f95b89b2-756d-4fda-8f56-2bcbcf524abb tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['e8e14a9e-af01-48fa-9b6a-452e72f6d677', 'a5fb5e94-32e2-424a-b60d-56351029ffe4', '8b8f8a9d-f649-47c1-81cf-307c33e1fe77', 'b7113272-c131-4ac4-88ca-b567e922cc0a'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:05:36.357666 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-f95b89b2-756d-4fda-8f56-2bcbcf524abb tempest-VolumesSnapshotTestJSON-2140298196 None] Delete snapshot completed successfully. Feb 19 21:05:36.366335 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-f95b89b2-756d-4fda-8f56-2bcbcf524abb tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-84953b66-7b55-4a22-a311-5d8902272295-delete_snapshot'" released by "delete_snapshot" :: held 30.563s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:05:36.542031 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-1149684d-8fac-4e89-a13a-b051ef6e7061 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-c75caa5e-cca5-48a5-a3e5-1195d9f631fe-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.024s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:05:36.552963 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1149684d-8fac-4e89-a13a-b051ef6e7061 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:06:06.890116 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-1149684d-8fac-4e89-a13a-b051ef6e7061 tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['5a659773-8572-460c-8246-b6b152932034', '0b89f824-253c-4bd6-a7d1-1c4e41aa15c5', '1e29b826-9257-44e7-b4b1-5c341d581f9d', '48ed0eae-bb92-42d6-b300-9a73c6771083'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:06:06.950436 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-1149684d-8fac-4e89-a13a-b051ef6e7061 tempest-VolumesSnapshotTestJSON-2140298196 None] Delete snapshot completed successfully. Feb 19 21:06:06.965202 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-1149684d-8fac-4e89-a13a-b051ef6e7061 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-c75caa5e-cca5-48a5-a3e5-1195d9f631fe-delete_snapshot'" released by "delete_snapshot" :: held 30.422s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:06:07.964982 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-8c7f4c06-6ca2-4c7e-9491-76b10e1eb516 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-8273ea27-8246-4709-8bd9-349740a6bc66-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:06:07.967188 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8c7f4c06-6ca2-4c7e-9491-76b10e1eb516 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:06:22.168312 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:06:22.170351 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:06:22.248636 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:06:22.335700 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:06:38.371458 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-8c7f4c06-6ca2-4c7e-9491-76b10e1eb516 tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['0a0d4611-ebe0-499f-9ef6-f68119f1640c', 'b86ee03d-24d9-4647-8bad-c063cc82fc4d', '85ed59e0-242d-4e54-91cb-ef4c202df09e', 'aaf25dfc-7970-4edc-aefe-0b9ff6347016'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:06:38.480725 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8c7f4c06-6ca2-4c7e-9491-76b10e1eb516 tempest-VolumesSnapshotTestJSON-2140298196 None] Delete snapshot completed successfully. Feb 19 21:06:38.485799 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-8c7f4c06-6ca2-4c7e-9491-76b10e1eb516 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-8273ea27-8246-4709-8bd9-349740a6bc66-delete_snapshot'" released by "delete_snapshot" :: held 30.521s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:06:40.207598 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-b273be1f-56f0-4a7a-b274-d8d26ee4a1de req-705adbf9-76c1-49ed-a1ff-8572b2bfe95f tempest-VolumesSnapshotTestJSON-2140298196 None] Terminate volume connection completed successfully. Feb 19 21:06:40.208374 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-b273be1f-56f0-4a7a-b274-d8d26ee4a1de req-705adbf9-76c1-49ed-a1ff-8572b2bfe95f tempest-VolumesSnapshotTestJSON-2140298196 None] Deleting attachment 8d663760-320d-41fd-ae7f-139ea99f1964. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:06:45.701587 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a3e6be90-a9eb-4144-aab9-46200cc92085 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:06:46.537289 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a3e6be90-a9eb-4144-aab9-46200cc92085 tempest-VolumesSnapshotTestJSON-2140298196 None] Create snapshot completed successfully Feb 19 21:06:46.996593 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-e5aabd74-8fc2-4818-9f8b-cc4f560db033 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-ce982c2d-b4e5-4540-b9ec-233803502b5b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.027s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:06:47.001878 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e5aabd74-8fc2-4818-9f8b-cc4f560db033 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:06:47.538152 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-e5aabd74-8fc2-4818-9f8b-cc4f560db033 tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['b265833e-5c30-429b-82a9-5af35cac630b', '65c974e5-89fb-4caf-9ac7-47f14c123c65', 'bc847cf1-687f-4c22-9ceb-f89c5b8e6bb7', '7e8e90f2-cee4-4824-b884-f17ac2c94649'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:06:47.608069 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-e5aabd74-8fc2-4818-9f8b-cc4f560db033 tempest-VolumesSnapshotTestJSON-2140298196 None] Delete snapshot completed successfully. Feb 19 21:06:47.616712 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-e5aabd74-8fc2-4818-9f8b-cc4f560db033 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-ce982c2d-b4e5-4540-b9ec-233803502b5b-delete_snapshot'" released by "delete_snapshot" :: held 0.620s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:06:48.366233 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a8ff7365-4a4f-42b6-8a32-ca439c0da49e tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:06:49.561920 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a8ff7365-4a4f-42b6-8a32-ca439c0da49e tempest-VolumesSnapshotTestJSON-2140298196 None] Create snapshot completed successfully Feb 19 21:07:16.106723 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-94de098a-f464-45bb-80dc-1097dee6b003 req-6e6952f0-e0dc-40da-a41a-a96514e9f9e7 tempest-VolumesSnapshotTestJSON-2140298196 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:07:17.747957 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-94de098a-f464-45bb-80dc-1097dee6b003 req-6e6952f0-e0dc-40da-a41a-a96514e9f9e7 tempest-VolumesSnapshotTestJSON-2140298196 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.643s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:07:17.750010 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-94de098a-f464-45bb-80dc-1097dee6b003 req-6e6952f0-e0dc-40da-a41a-a96514e9f9e7 tempest-VolumesSnapshotTestJSON-2140298196 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3c4659bd-63a9-4ccf-8885-d4725562e8a0', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '3c4659bd-63a9-4ccf-8885-d4725562e8a0', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:07:17.812656 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-94de098a-f464-45bb-80dc-1097dee6b003 req-6e6952f0-e0dc-40da-a41a-a96514e9f9e7 tempest-VolumesSnapshotTestJSON-2140298196 None] Connection info returned from driver {'name': 'volumes/volume-3c4659bd-63a9-4ccf-8885-d4725562e8a0', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3c4659bd-63a9-4ccf-8885-d4725562e8a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '46d18974-18b9-4714-9813-fdab9f7baa93'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:07:17.970574 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-94de098a-f464-45bb-80dc-1097dee6b003 req-6e6952f0-e0dc-40da-a41a-a96514e9f9e7 tempest-VolumesSnapshotTestJSON-2140298196 None] attachment_update completed successfully. Feb 19 21:07:19.307675 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-184a18f0-f3f6-47b6-b8b2-f982b516e105 req-bbaa21ff-2685-494b-8358-426942f7fbdc tempest-AttachVolumeShelveTestJSON-322283970 None] Terminate volume connection completed successfully. Feb 19 21:07:19.309088 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-184a18f0-f3f6-47b6-b8b2-f982b516e105 req-bbaa21ff-2685-494b-8358-426942f7fbdc tempest-AttachVolumeShelveTestJSON-322283970 None] Deleting attachment 46c5c1e6-c569-451d-a6ab-cd639bea279f. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:07:20.981020 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-846b7c88-33c5-463d-b31d-3fe953daf89e tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:21.578327 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-846b7c88-33c5-463d-b31d-3fe953daf89e tempest-VolumesSnapshotTestJSON-2140298196 None] Create snapshot completed successfully Feb 19 21:07:22.174121 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:07:22.175752 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:22.251270 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:22.355987 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:07:22.432802 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-55d0c4c3-b79d-495b-903d-f074d1b0664a tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:23.496667 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:07:23.505698 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:07:23.507729 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:07:23.546066 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Flow 'volume_create_manager' (779d9ae6-7180-4ef1-ae6b-ec52ee2e1c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:07:23.559116 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5134a8-e744-4f0e-a5bb-f97dfcece00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:23.573018 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:07:23.628056 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5134a8-e744-4f0e-a5bb-f97dfcece00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-76610970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dc1352cb-02fb-4212-ba31-55df6ddc6132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f81dcc5d52473ab53817e20df04cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:07:23Z,use_quota=True,user_id='20246495a35b4762be5b2ad98f537377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:23.634765 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56f83e2-7b25-482a-9dfb-3e9ad632b221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:23.643730 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56f83e2-7b25-482a-9dfb-3e9ad632b221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:23.656311 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781b9262-67a9-4837-a222-338cd31ae801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:23.668465 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781b9262-67a9-4837-a222-338cd31ae801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1352cb-02fb-4212-ba31-55df6ddc6132', 'volume_name': 'volume-dc1352cb-02fb-4212-ba31-55df6ddc6132', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:23.683278 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d07c6b-74be-4597-bc91-3a1ce078afdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:23.695428 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d07c6b-74be-4597-bc91-3a1ce078afdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:23.709100 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9760235-664a-46d5-a483-7c0b9accb825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:23.711002 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Volume dc1352cb-02fb-4212-ba31-55df6ddc6132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1352cb-02fb-4212-ba31-55df6ddc6132', 'volume_size': 1} Feb 19 21:07:23.711645 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] creating volume 'volume-dc1352cb-02fb-4212-ba31-55df6ddc6132' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:07:23.713106 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:23.893779 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-55d0c4c3-b79d-495b-903d-f074d1b0664a tempest-VolumesSnapshotTestJSON-2140298196 None] Create snapshot completed successfully Feb 19 21:07:23.912275 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:07:23.912662 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:07:23.917142 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9760235-664a-46d5-a483-7c0b9accb825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1352cb-02fb-4212-ba31-55df6ddc6132', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:23.922936 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984effda-252b-40d6-9046-e485ff4cb03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:23.943226 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Volume volume-dc1352cb-02fb-4212-ba31-55df6ddc6132 (dc1352cb-02fb-4212-ba31-55df6ddc6132): created successfully Feb 19 21:07:23.950247 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984effda-252b-40d6-9046-e485ff4cb03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:23.967777 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Flow 'volume_create_manager' (779d9ae6-7180-4ef1-ae6b-ec52ee2e1c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:07:23.977872 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8f1b49fd-4e84-43f6-a4cb-24bdb43310f1 tempest-DeleteServersTestJSON-1663057627 None] Created volume successfully. Feb 19 21:07:24.062877 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:07:24.068624 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:07:24.070235 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:07:24.099097 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Flow 'volume_create_manager' (d593ed1d-39c9-41fb-aca5-8e05fe0fb299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:07:24.107789 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd633296-464b-4d39-a74b-6186681ddeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:24.115508 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:07:24.141426 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd633296-464b-4d39-a74b-6186681ddeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-835394282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3ff6b310-d818-4d76-b66a-68ab83434270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f260ed47c5994487a4cc293c33dae3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:07:24Z,use_quota=True,user_id='2ee3e5caf3e44b21b66cf9ad197e5999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:24.149919 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9276e99-4053-492c-9528-7b5ae4f89e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:24.154973 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9276e99-4053-492c-9528-7b5ae4f89e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:24.160767 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6dd198-7119-46ce-b3ef-7c057eb0a346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:24.301446 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6dd198-7119-46ce-b3ef-7c057eb0a346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3ff6b310-d818-4d76-b66a-68ab83434270', 'volume_name': 'volume-3ff6b310-d818-4d76-b66a-68ab83434270', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:24.317285 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cfdabd3-c4fa-4934-a26f-ff933a949b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:24.355468 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cfdabd3-c4fa-4934-a26f-ff933a949b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:24.399300 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba3dfbf-edf2-4078-9842-566c9a5c2989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:24.401831 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Volume 3ff6b310-d818-4d76-b66a-68ab83434270: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3ff6b310-d818-4d76-b66a-68ab83434270', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 21:07:24.405774 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Cloning 3ff6b310-d818-4d76-b66a-68ab83434270 from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 21:07:24.440506 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.026s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:07:24.493775 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 7, 24, 465106)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:07:24.494521 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:07:24.495096 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Found cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 19 21:07:24.501697 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 0.066s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:07:24.502404 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 21:07:24.522842 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 7, 24, 506396)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:07:24.523200 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:07:24.523774 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Creating from source image-volume d609c16c-1e31-4237-8163-d85a8fcc768b {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 19 21:07:24.543772 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:24.650582 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] creating snapshot='volume-3ff6b310-d818-4d76-b66a-68ab83434270.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:07:25.665717 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] cloning 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b@volume-3ff6b310-d818-4d76-b66a-68ab83434270.clone_snap' to 'volume-3ff6b310-d818-4d76-b66a-68ab83434270' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:07:25.753341 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a1a1ce00-625a-476a-a0e2-2942d2ddb5fc tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-28eb5076-505d-4d05-b5a1-b89883f514af-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.081s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:07:25.761341 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a1a1ce00-625a-476a-a0e2-2942d2ddb5fc tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:25.946542 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71.deleted is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:07:25.947514 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:07:25.948072 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:07:25.997206 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:07:25.997895 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Marking volume 3ff6b310-d818-4d76-b66a-68ab83434270 as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:07:26.002042 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-900a5242-3875-419d-a2ac-80688e323041 req-db0fef93-9a5b-4a5b-ae9c-bfeb6f79e451 tempest-DeleteServersTestJSON-1663057627 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:07:26.106240 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to 3ff6b310-d818-4d76-b66a-68ab83434270. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 21:07:26.108626 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Creating volume glance metadata for volume 3ff6b310-d818-4d76-b66a-68ab83434270 backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 21:07:26.396410 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba3dfbf-edf2-4078-9842-566c9a5c2989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff6b310-d818-4d76-b66a-68ab83434270', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:26.426065 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ee188d-a655-476b-b1fd-5b15be673cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:26.446351 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Volume volume-3ff6b310-d818-4d76-b66a-68ab83434270 (3ff6b310-d818-4d76-b66a-68ab83434270): created successfully Feb 19 21:07:26.452004 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ee188d-a655-476b-b1fd-5b15be673cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:26.479366 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Flow 'volume_create_manager' (d593ed1d-39c9-41fb-aca5-8e05fe0fb299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:07:26.511417 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-38ce3a95-77cf-41d3-8829-0d01b98d304c tempest-TaggedBootDevicesTest-1240914161 None] Created volume successfully. Feb 19 21:07:27.264502 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-900a5242-3875-419d-a2ac-80688e323041 req-db0fef93-9a5b-4a5b-ae9c-bfeb6f79e451 tempest-DeleteServersTestJSON-1663057627 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.262s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:07:27.265143 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-900a5242-3875-419d-a2ac-80688e323041 req-db0fef93-9a5b-4a5b-ae9c-bfeb6f79e451 tempest-DeleteServersTestJSON-1663057627 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dc1352cb-02fb-4212-ba31-55df6ddc6132', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'dc1352cb-02fb-4212-ba31-55df6ddc6132', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:07:27.322398 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-900a5242-3875-419d-a2ac-80688e323041 req-db0fef93-9a5b-4a5b-ae9c-bfeb6f79e451 tempest-DeleteServersTestJSON-1663057627 None] Connection info returned from driver {'name': 'volumes/volume-dc1352cb-02fb-4212-ba31-55df6ddc6132', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dc1352cb-02fb-4212-ba31-55df6ddc6132', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fd891faa-e558-48d1-b9a7-6f68faad20a8'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:07:27.438965 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-900a5242-3875-419d-a2ac-80688e323041 req-db0fef93-9a5b-4a5b-ae9c-bfeb6f79e451 tempest-DeleteServersTestJSON-1663057627 None] attachment_update completed successfully. Feb 19 21:07:28.058503 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:07:28.072855 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:07:28.080585 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:07:28.129894 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Flow 'volume_create_manager' (02049914-7b13-4569-963e-89f441d93db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:07:28.139340 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece1e141-bc09-4169-a79d-d62325e06243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:28.164715 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:07:28.189616 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece1e141-bc09-4169-a79d-d62325e06243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-119678087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=56aed238-dfe7-4409-a1cc-1d5aee658c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f260ed47c5994487a4cc293c33dae3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:07:28Z,use_quota=True,user_id='2ee3e5caf3e44b21b66cf9ad197e5999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:28.196419 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12fd1ea9-504f-4981-9960-8db08e80c87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:28.200792 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12fd1ea9-504f-4981-9960-8db08e80c87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:28.214838 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b3bf0d-e0f6-4499-8fd1-2754d1a974c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:28.220394 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b3bf0d-e0f6-4499-8fd1-2754d1a974c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56aed238-dfe7-4409-a1cc-1d5aee658c06', 'volume_name': 'volume-56aed238-dfe7-4409-a1cc-1d5aee658c06', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:28.237768 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900ffd39-eaeb-4d9f-a774-830cf2994ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:28.250597 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900ffd39-eaeb-4d9f-a774-830cf2994ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:28.257155 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c510f8-2555-473b-8a9b-fa826e2f100f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:28.258321 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Volume 56aed238-dfe7-4409-a1cc-1d5aee658c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56aed238-dfe7-4409-a1cc-1d5aee658c06', 'volume_size': 1} Feb 19 21:07:28.258730 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] creating volume 'volume-56aed238-dfe7-4409-a1cc-1d5aee658c06' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:07:28.259857 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:28.407727 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:07:28.409530 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:07:28.417646 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c510f8-2555-473b-8a9b-fa826e2f100f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56aed238-dfe7-4409-a1cc-1d5aee658c06', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:28.427085 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a82e59a-99fa-4d19-8770-8bd3202a6df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:28.450921 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Volume volume-56aed238-dfe7-4409-a1cc-1d5aee658c06 (56aed238-dfe7-4409-a1cc-1d5aee658c06): created successfully Feb 19 21:07:28.461324 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a82e59a-99fa-4d19-8770-8bd3202a6df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:28.477068 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Flow 'volume_create_manager' (02049914-7b13-4569-963e-89f441d93db2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:07:28.496429 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-6591c8d5-4d85-4ba3-b567-6c0df77c4537 tempest-TaggedBootDevicesTest-1240914161 None] Created volume successfully. Feb 19 21:07:29.681573 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:07:29.691267 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:07:29.696305 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:07:29.751053 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Flow 'volume_create_manager' (17322c1a-9152-4aba-88ae-323056eafc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:07:29.785021 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbc3fbd-a4ad-4cf3-8449-aa441736c87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:29.806741 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:07:29.876210 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbc3fbd-a4ad-4cf3-8449-aa441736c87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-324402784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fd491209-be3e-4e2f-b5ae-a327e5f6dc9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f260ed47c5994487a4cc293c33dae3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:07:30Z,use_quota=True,user_id='2ee3e5caf3e44b21b66cf9ad197e5999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:29.894837 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29c0ad9-f73e-462f-a8b0-169a2783d17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:29.900639 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29c0ad9-f73e-462f-a8b0-169a2783d17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:29.906294 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4a700b-abe6-474d-8b24-46ec48fbe162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:29.911029 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4a700b-abe6-474d-8b24-46ec48fbe162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd491209-be3e-4e2f-b5ae-a327e5f6dc9b', 'volume_name': 'volume-fd491209-be3e-4e2f-b5ae-a327e5f6dc9b', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:29.916539 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40f7f45-a097-4ba3-a5c9-34309d94be03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:29.925788 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40f7f45-a097-4ba3-a5c9-34309d94be03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:29.930934 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99fb7014-7bf1-405d-862f-316bcf366f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:29.932365 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Volume fd491209-be3e-4e2f-b5ae-a327e5f6dc9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd491209-be3e-4e2f-b5ae-a327e5f6dc9b', 'volume_size': 1} Feb 19 21:07:29.932934 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] creating volume 'volume-fd491209-be3e-4e2f-b5ae-a327e5f6dc9b' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:07:29.934266 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:30.063352 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:07:30.063735 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:07:30.067842 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99fb7014-7bf1-405d-862f-316bcf366f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd491209-be3e-4e2f-b5ae-a327e5f6dc9b', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:30.073613 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8361d8c1-b6e7-427f-888c-c065f7b49d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:07:30.087904 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Volume volume-fd491209-be3e-4e2f-b5ae-a327e5f6dc9b (fd491209-be3e-4e2f-b5ae-a327e5f6dc9b): created successfully Feb 19 21:07:30.091891 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8361d8c1-b6e7-427f-888c-c065f7b49d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:07:30.098402 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Flow 'volume_create_manager' (17322c1a-9152-4aba-88ae-323056eafc46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:07:30.124566 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-c956e3e8-5437-4cb7-889e-5f6ce02045fc tempest-TaggedBootDevicesTest-1240914161 None] Created volume successfully. Feb 19 21:07:31.388471 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-505f201f-f382-438e-8d3e-17dae821798d tempest-ServersNegativeTestJSON-36785744 None] Lock "b'cinder-2af565df-bf28-4e7b-b3c5-f62ffab1dd66-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:07:31.444321 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-505f201f-f382-438e-8d3e-17dae821798d tempest-ServersNegativeTestJSON-36785744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:31.516678 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-505f201f-f382-438e-8d3e-17dae821798d tempest-ServersNegativeTestJSON-36785744 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:07:31.517581 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-505f201f-f382-438e-8d3e-17dae821798d tempest-ServersNegativeTestJSON-36785744 None] Volume volume-2af565df-bf28-4e7b-b3c5-f62ffab1dd66 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:07:31.526077 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-505f201f-f382-438e-8d3e-17dae821798d tempest-ServersNegativeTestJSON-36785744 None] deleting rbd volume volume-2af565df-bf28-4e7b-b3c5-f62ffab1dd66 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:07:31.962306 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-505f201f-f382-438e-8d3e-17dae821798d tempest-ServersNegativeTestJSON-36785744 None] Created reservations ['34635434-ef3b-4610-a6a6-e5b73f64c5da', '6bfc56ae-2bf3-44ae-9a38-04a9549cd7d5', '63d5b5c4-38c2-41d8-a466-d5b27528f45b', 'febd50db-616b-4c69-9d2c-1635d719ec05'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:07:32.031117 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-505f201f-f382-438e-8d3e-17dae821798d tempest-ServersNegativeTestJSON-36785744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:32.076003 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-505f201f-f382-438e-8d3e-17dae821798d tempest-ServersNegativeTestJSON-36785744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:32.129723 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-505f201f-f382-438e-8d3e-17dae821798d tempest-ServersNegativeTestJSON-36785744 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:07:32.135572 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-505f201f-f382-438e-8d3e-17dae821798d tempest-ServersNegativeTestJSON-36785744 None] Deleted volume successfully. Feb 19 21:07:32.155381 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-505f201f-f382-438e-8d3e-17dae821798d tempest-ServersNegativeTestJSON-36785744 None] Lock "b'cinder-2af565df-bf28-4e7b-b3c5-f62ffab1dd66-delete_volume'" released by "delete_volume" :: held 0.767s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:07:32.558977 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a9a23add-0120-48b4-bed5-9bcd2f44b90c tempest-ServersNegativeTestJSON-36785744 None] Lock "b'cinder-f9a0d149-5bcf-434f-90cb-ef3429b93f95-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:07:32.599395 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a9a23add-0120-48b4-bed5-9bcd2f44b90c tempest-ServersNegativeTestJSON-36785744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:32.644265 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a9a23add-0120-48b4-bed5-9bcd2f44b90c tempest-ServersNegativeTestJSON-36785744 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:07:32.644908 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a9a23add-0120-48b4-bed5-9bcd2f44b90c tempest-ServersNegativeTestJSON-36785744 None] Volume volume-f9a0d149-5bcf-434f-90cb-ef3429b93f95 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:07:32.653011 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a9a23add-0120-48b4-bed5-9bcd2f44b90c tempest-ServersNegativeTestJSON-36785744 None] deleting rbd volume volume-f9a0d149-5bcf-434f-90cb-ef3429b93f95 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:07:32.998726 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-a9a23add-0120-48b4-bed5-9bcd2f44b90c tempest-ServersNegativeTestJSON-36785744 None] Created reservations ['604292de-08da-494d-b32e-5bdb50f973e6', '78c0cf29-36c4-471d-9293-f617df9f9df3', 'b0749989-2cbe-4da8-9ec2-f942567dabb2', 'e797145b-8811-4550-aa8e-435e7e67814c'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:07:33.067237 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a9a23add-0120-48b4-bed5-9bcd2f44b90c tempest-ServersNegativeTestJSON-36785744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:33.098718 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a9a23add-0120-48b4-bed5-9bcd2f44b90c tempest-ServersNegativeTestJSON-36785744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:33.135337 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-a9a23add-0120-48b4-bed5-9bcd2f44b90c tempest-ServersNegativeTestJSON-36785744 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:07:33.139619 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a9a23add-0120-48b4-bed5-9bcd2f44b90c tempest-ServersNegativeTestJSON-36785744 None] Deleted volume successfully. Feb 19 21:07:33.155297 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a9a23add-0120-48b4-bed5-9bcd2f44b90c tempest-ServersNegativeTestJSON-36785744 None] Lock "b'cinder-f9a0d149-5bcf-434f-90cb-ef3429b93f95-delete_volume'" released by "delete_volume" :: held 0.597s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:07:34.378698 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-b89f6700-fbee-42d1-94e5-d205994c26b1 req-35519cb0-d6b1-4700-ae4b-5b4f76a5491f tempest-DeleteServersTestJSON-1663057627 None] Terminate volume connection completed successfully. Feb 19 21:07:34.383748 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-b89f6700-fbee-42d1-94e5-d205994c26b1 req-35519cb0-d6b1-4700-ae4b-5b4f76a5491f tempest-DeleteServersTestJSON-1663057627 None] Deleting attachment fd891faa-e558-48d1-b9a7-6f68faad20a8. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:07:54.681596 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-18347fee-0e1b-4c75-ae4a-46f35501a741 req-6e022073-b7f5-4c1a-88dd-d0051608eee5 tempest-TaggedBootDevicesTest-1240914161 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:07:55.766862 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-18347fee-0e1b-4c75-ae4a-46f35501a741 req-6e022073-b7f5-4c1a-88dd-d0051608eee5 tempest-TaggedBootDevicesTest-1240914161 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.085s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:07:55.770172 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-18347fee-0e1b-4c75-ae4a-46f35501a741 req-6e022073-b7f5-4c1a-88dd-d0051608eee5 tempest-TaggedBootDevicesTest-1240914161 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3ff6b310-d818-4d76-b66a-68ab83434270', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '3ff6b310-d818-4d76-b66a-68ab83434270', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:07:55.836272 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-18347fee-0e1b-4c75-ae4a-46f35501a741 req-6e022073-b7f5-4c1a-88dd-d0051608eee5 tempest-TaggedBootDevicesTest-1240914161 None] Connection info returned from driver {'name': 'volumes/volume-3ff6b310-d818-4d76-b66a-68ab83434270', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3ff6b310-d818-4d76-b66a-68ab83434270', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd2871cbc-9edc-4f5d-94ff-4386fbaa55f7'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:07:55.958124 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-18347fee-0e1b-4c75-ae4a-46f35501a741 req-6e022073-b7f5-4c1a-88dd-d0051608eee5 tempest-TaggedBootDevicesTest-1240914161 None] attachment_update completed successfully. Feb 19 21:07:56.196285 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-a1a1ce00-625a-476a-a0e2-2942d2ddb5fc tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['7fcebca0-1f6a-4172-b331-4829b4c72155', 'd0c56027-fb7d-4e47-a415-e1281851fc90', 'e429de07-1caa-45ea-bf43-d4004db993cb', '50ef6cf4-e6af-462b-a612-ea0c059418c8'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:07:56.324693 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a1a1ce00-625a-476a-a0e2-2942d2ddb5fc tempest-VolumesSnapshotTestJSON-2140298196 None] Delete snapshot completed successfully. Feb 19 21:07:56.340934 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a1a1ce00-625a-476a-a0e2-2942d2ddb5fc tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-28eb5076-505d-4d05-b5a1-b89883f514af-delete_snapshot'" released by "delete_snapshot" :: held 30.587s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:07:56.583440 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-18347fee-0e1b-4c75-ae4a-46f35501a741 req-76cc1504-07ad-4ac6-ac1c-8979d8597256 tempest-TaggedBootDevicesTest-1240914161 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:07:57.233005 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-bf571195-daa3-4926-9ddc-4efb575098d1 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-4709a1c3-f90e-43c8-a005-fd0a8f881f83-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:07:57.237952 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bf571195-daa3-4926-9ddc-4efb575098d1 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:07:57.865104 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-18347fee-0e1b-4c75-ae4a-46f35501a741 req-76cc1504-07ad-4ac6-ac1c-8979d8597256 tempest-TaggedBootDevicesTest-1240914161 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.282s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:07:57.866575 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-18347fee-0e1b-4c75-ae4a-46f35501a741 req-76cc1504-07ad-4ac6-ac1c-8979d8597256 tempest-TaggedBootDevicesTest-1240914161 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-56aed238-dfe7-4409-a1cc-1d5aee658c06', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '56aed238-dfe7-4409-a1cc-1d5aee658c06', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:07:57.901663 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-18347fee-0e1b-4c75-ae4a-46f35501a741 req-76cc1504-07ad-4ac6-ac1c-8979d8597256 tempest-TaggedBootDevicesTest-1240914161 None] Connection info returned from driver {'name': 'volumes/volume-56aed238-dfe7-4409-a1cc-1d5aee658c06', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '56aed238-dfe7-4409-a1cc-1d5aee658c06', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6376ef83-fc84-414f-b6e7-22b2241ab8c6'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:07:57.972064 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-18347fee-0e1b-4c75-ae4a-46f35501a741 req-76cc1504-07ad-4ac6-ac1c-8979d8597256 tempest-TaggedBootDevicesTest-1240914161 None] attachment_update completed successfully. Feb 19 21:07:58.402072 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-18347fee-0e1b-4c75-ae4a-46f35501a741 req-5a0d0803-87f1-4a0d-b7e8-57b485fff671 tempest-TaggedBootDevicesTest-1240914161 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:07:59.542962 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-18347fee-0e1b-4c75-ae4a-46f35501a741 req-5a0d0803-87f1-4a0d-b7e8-57b485fff671 tempest-TaggedBootDevicesTest-1240914161 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.140s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:07:59.546382 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-18347fee-0e1b-4c75-ae4a-46f35501a741 req-5a0d0803-87f1-4a0d-b7e8-57b485fff671 tempest-TaggedBootDevicesTest-1240914161 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fd491209-be3e-4e2f-b5ae-a327e5f6dc9b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'fd491209-be3e-4e2f-b5ae-a327e5f6dc9b', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:07:59.619742 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-18347fee-0e1b-4c75-ae4a-46f35501a741 req-5a0d0803-87f1-4a0d-b7e8-57b485fff671 tempest-TaggedBootDevicesTest-1240914161 None] Connection info returned from driver {'name': 'volumes/volume-fd491209-be3e-4e2f-b5ae-a327e5f6dc9b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fd491209-be3e-4e2f-b5ae-a327e5f6dc9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0f668150-e1ff-40a4-a5a0-bff25c228a9b'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:07:59.750749 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-18347fee-0e1b-4c75-ae4a-46f35501a741 req-5a0d0803-87f1-4a0d-b7e8-57b485fff671 tempest-TaggedBootDevicesTest-1240914161 None] attachment_update completed successfully. Feb 19 21:08:00.900919 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:08:00.906120 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:08:00.906708 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:08:00.927023 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Flow 'volume_create_manager' (d15b7a83-412e-45b2-8cf8-592538c1f3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:08:00.935726 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a08bf4-e62d-41a6-9cc8-ee971749a0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:00.946807 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:08:00.968794 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a08bf4-e62d-41a6-9cc8-ee971749a0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-36915538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3be2f43d-88e4-40bc-a3e5-285a7855b8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ad9ca9c0944ba68443aaa71a10eb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:08:01Z,use_quota=True,user_id='a388edbf88ba4749b3abb2a42b750757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:00.975263 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41283116-2ed8-4b4a-a611-e3dd47dee4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:00.982538 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41283116-2ed8-4b4a-a611-e3dd47dee4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:00.990009 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f67952f-d91e-4e29-ab45-cdaa01574d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:00.997191 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f67952f-d91e-4e29-ab45-cdaa01574d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3be2f43d-88e4-40bc-a3e5-285a7855b8e5', 'volume_name': 'volume-3be2f43d-88e4-40bc-a3e5-285a7855b8e5', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:01.003899 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6095f6a6-fdeb-481c-8866-94d92520e6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:01.011639 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6095f6a6-fdeb-481c-8866-94d92520e6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:01.018183 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d440f8b-08d0-4c27-8048-694f7e0462c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:01.019704 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Volume 3be2f43d-88e4-40bc-a3e5-285a7855b8e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3be2f43d-88e4-40bc-a3e5-285a7855b8e5', 'volume_size': 1} Feb 19 21:08:01.020273 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] creating volume 'volume-3be2f43d-88e4-40bc-a3e5-285a7855b8e5' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:08:01.021848 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:01.170388 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:08:01.171179 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:08:01.180475 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d440f8b-08d0-4c27-8048-694f7e0462c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be2f43d-88e4-40bc-a3e5-285a7855b8e5', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:01.188254 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b65b81-3301-465b-a69d-6d578ef9ef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:01.205203 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Volume volume-3be2f43d-88e4-40bc-a3e5-285a7855b8e5 (3be2f43d-88e4-40bc-a3e5-285a7855b8e5): created successfully Feb 19 21:08:01.209468 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b65b81-3301-465b-a69d-6d578ef9ef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:01.218111 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Flow 'volume_create_manager' (d15b7a83-412e-45b2-8cf8-592538c1f3fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:08:01.234056 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-f0b51d8f-ec1c-429c-baff-c25baee63ef7 tempest-AttachVolumeShelveTestJSON-322283970 None] Created volume successfully. Feb 19 21:08:05.917788 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ff7da4ac-74f3-4a94-b7ab-427dff5b10fa tempest-GroupSnapshotsTest-1844160717 None] Group tempest-GroupSnapshotsTest-Group-1166971141: creating Feb 19 21:08:05.967378 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ff7da4ac-74f3-4a94-b7ab-427dff5b10fa tempest-GroupSnapshotsTest-1844160717 None] Group tempest-GroupSnapshotsTest-Group-1166971141: created successfully Feb 19 21:08:05.994108 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ff7da4ac-74f3-4a94-b7ab-427dff5b10fa tempest-GroupSnapshotsTest-1844160717 None] Create group completed successfully. Feb 19 21:08:07.540699 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:08:07.544407 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:08:07.545601 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:08:07.567937 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Flow 'volume_create_manager' (64e29c94-1041-48af-8d54-d60d2f6c2cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:08:07.575009 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c84b174-80b9-4cec-977b-1fff86dd5686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:07.582741 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:08:07.602733 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c84b174-80b9-4cec-977b-1fff86dd5686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-78052060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d255d273-4ca9-4834-87f0-972efe839dd1,host='ncdv-master-1@ceph#ceph',id=8def28f5-3e5d-47b7-adeb-807ed76d0ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d10c7c8b9fba438abf201d80c58a8655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:08:08Z,use_quota=True,user_id='1466ade1177f483292054d2244caee36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(754a6589-9aed-46eb-b530-5a22c46eff07),volume_type_id=754a6589-9aed-46eb-b530-5a22c46eff07)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:07.608713 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9a011c-2333-4402-b760-c2a1537c95e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:07.613570 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9a011c-2333-4402-b760-c2a1537c95e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:07.619821 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a020c670-4456-4921-a1b2-28ed3b87b705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:07.624136 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a020c670-4456-4921-a1b2-28ed3b87b705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8def28f5-3e5d-47b7-adeb-807ed76d0ae3', 'volume_name': 'volume-8def28f5-3e5d-47b7-adeb-807ed76d0ae3', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:07.629195 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4606420-8e5e-4f39-acd0-46e14215f050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:07.633355 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4606420-8e5e-4f39-acd0-46e14215f050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:07.638192 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78a693b-b0a6-4fc6-8073-7686ff44733d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:07.639355 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Volume 8def28f5-3e5d-47b7-adeb-807ed76d0ae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8def28f5-3e5d-47b7-adeb-807ed76d0ae3', 'volume_size': 1} Feb 19 21:08:07.639744 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] creating volume 'volume-8def28f5-3e5d-47b7-adeb-807ed76d0ae3' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:08:07.640773 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:07.727337 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] extra_specs: {} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:08:07.727708 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] extra_specs: {} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:08:07.731894 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78a693b-b0a6-4fc6-8073-7686ff44733d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8def28f5-3e5d-47b7-adeb-807ed76d0ae3', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:07.738065 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e7dbb3-07e4-43c3-a97a-35f15d1cd136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:07.759601 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Volume volume-8def28f5-3e5d-47b7-adeb-807ed76d0ae3 (8def28f5-3e5d-47b7-adeb-807ed76d0ae3): created successfully Feb 19 21:08:07.767038 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e7dbb3-07e4-43c3-a97a-35f15d1cd136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:07.773898 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Flow 'volume_create_manager' (64e29c94-1041-48af-8d54-d60d2f6c2cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:08:07.791576 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-e14f4c39-b4fb-418e-8e6f-8597d619e0ec tempest-GroupSnapshotsTest-1844160717 None] Created volume successfully. Feb 19 21:08:08.721437 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-f24447cf-e023-4f6e-a42e-05235606e12b tempest-GroupSnapshotsTest-1844160717 None] GroupSnapshot 3d3924a7-98c3-4a0e-91f8-8ced1257360a: creating. Feb 19 21:08:08.748366 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f24447cf-e023-4f6e-a42e-05235606e12b tempest-GroupSnapshotsTest-1844160717 None] Group snapshot 3d3924a7-98c3-4a0e-91f8-8ced1257360a: creating. {{(pid=129319) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Feb 19 21:08:08.767765 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f24447cf-e023-4f6e-a42e-05235606e12b tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:09.357041 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-f24447cf-e023-4f6e-a42e-05235606e12b tempest-GroupSnapshotsTest-1844160717 None] group_snapshot 3d3924a7-98c3-4a0e-91f8-8ced1257360a: created successfully Feb 19 21:08:10.561900 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ad68c35e-6a63-461a-8b32-f3558d73cdf8 tempest-GroupSnapshotsTest-1844160717 None] cloning volumes/volume-8def28f5-3e5d-47b7-adeb-807ed76d0ae3@snapshot-56092180-5af6-467a-8d99-1c33cc08b0dc to volume-ff8148e7-1796-4e92-8d56-c37a768194d3 {{(pid=129319) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 19 21:08:10.562871 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ad68c35e-6a63-461a-8b32-f3558d73cdf8 tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:10.658968 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ad68c35e-6a63-461a-8b32-f3558d73cdf8 tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:10.967529 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ad68c35e-6a63-461a-8b32-f3558d73cdf8 tempest-GroupSnapshotsTest-1844160717 None] extra_specs: {} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:08:10.967965 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ad68c35e-6a63-461a-8b32-f3558d73cdf8 tempest-GroupSnapshotsTest-1844160717 None] extra_specs: {} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:08:11.109377 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ad68c35e-6a63-461a-8b32-f3558d73cdf8 tempest-GroupSnapshotsTest-1844160717 None] Create group from source-snapshot-3d3924a7-98c3-4a0e-91f8-8ced1257360a completed successfully. Feb 19 21:08:12.186175 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-409a5401-677f-461d-bcd4-bd4389169adc tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:12.256756 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-409a5401-677f-461d-bcd4-bd4389169adc tempest-GroupSnapshotsTest-1844160717 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:08:12.265248 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-409a5401-677f-461d-bcd4-bd4389169adc tempest-GroupSnapshotsTest-1844160717 None] deleting rbd volume volume-ff8148e7-1796-4e92-8d56-c37a768194d3 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:08:12.739075 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-409a5401-677f-461d-bcd4-bd4389169adc tempest-GroupSnapshotsTest-1844160717 None] Created reservations ['ce3aa3f0-091b-4308-b288-bd8f933bd623'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:12.758391 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-409a5401-677f-461d-bcd4-bd4389169adc tempest-GroupSnapshotsTest-1844160717 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1048478450 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1048478450, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:08:12.759192 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-409a5401-677f-461d-bcd4-bd4389169adc tempest-GroupSnapshotsTest-1844160717 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1048478450 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1048478450, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:08:12.773309 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-409a5401-677f-461d-bcd4-bd4389169adc tempest-GroupSnapshotsTest-1844160717 None] Created reservations ['7cd6334c-a479-4cc3-9697-6eb4847a3098', 'd5a8fe3f-9f3b-424a-b06d-6dc59bdd5533', '445364d3-310f-4d73-b8a0-32b6445cf6ba', '939c772f-a906-4112-b332-2c89b796479e'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:12.853449 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-409a5401-677f-461d-bcd4-bd4389169adc tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:12.898780 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-409a5401-677f-461d-bcd4-bd4389169adc tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:12.927698 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-409a5401-677f-461d-bcd4-bd4389169adc tempest-GroupSnapshotsTest-1844160717 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:08:12.932199 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-409a5401-677f-461d-bcd4-bd4389169adc tempest-GroupSnapshotsTest-1844160717 None] Delete group completed successfully. Feb 19 21:08:13.319555 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-dcb8045f-4d71-4b23-81a3-03a0e47b1625 tempest-GroupSnapshotsTest-1844160717 None] group_snapshot 3d3924a7-98c3-4a0e-91f8-8ced1257360a: deleting Feb 19 21:08:13.337954 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dcb8045f-4d71-4b23-81a3-03a0e47b1625 tempest-GroupSnapshotsTest-1844160717 None] group_snapshot 3d3924a7-98c3-4a0e-91f8-8ced1257360a: deleting {{(pid=129319) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Feb 19 21:08:13.356714 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dcb8045f-4d71-4b23-81a3-03a0e47b1625 tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:14.196191 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:08:14.202172 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:08:14.207159 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:08:14.234359 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Flow 'volume_create_manager' (60dd8c66-332b-41c4-838a-4bbbf51276e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:08:14.243912 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6812e7a8-f642-4090-beb1-5ee2ee1228da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:14.253467 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:08:14.281965 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6812e7a8-f642-4090-beb1-5ee2ee1228da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1328985936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=15fd35a7-de5b-44ee-af9e-26318f1c9422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adecc012aca243138d03c189f5623f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:08:14Z,use_quota=True,user_id='7132cae4ebd549d491f5d0dcf83394ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:14.288389 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db58ce5-fb29-4741-b151-e9deec8af6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:14.295601 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db58ce5-fb29-4741-b151-e9deec8af6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:14.307646 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76970685-b6b9-4f95-8106-7399a0cd3b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:14.313284 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76970685-b6b9-4f95-8106-7399a0cd3b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15fd35a7-de5b-44ee-af9e-26318f1c9422', 'volume_name': 'volume-15fd35a7-de5b-44ee-af9e-26318f1c9422', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:14.319978 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5131d55-9196-4798-8039-7027e87e3286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:14.324913 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5131d55-9196-4798-8039-7027e87e3286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:14.330410 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f350dfef-42f7-4f66-a940-0f356804e283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:14.331934 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Volume 15fd35a7-de5b-44ee-af9e-26318f1c9422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15fd35a7-de5b-44ee-af9e-26318f1c9422', 'volume_size': 1} Feb 19 21:08:14.332516 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] creating volume 'volume-15fd35a7-de5b-44ee-af9e-26318f1c9422' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:08:14.333820 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:14.401762 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-dcb8045f-4d71-4b23-81a3-03a0e47b1625 tempest-GroupSnapshotsTest-1844160717 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1048478450 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1048478450, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:08:14.415153 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:08:14.415529 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:08:14.419403 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f350dfef-42f7-4f66-a940-0f356804e283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15fd35a7-de5b-44ee-af9e-26318f1c9422', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:14.424296 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafff165-0e3b-4e9a-8cde-625028baf327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:14.438938 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-dcb8045f-4d71-4b23-81a3-03a0e47b1625 tempest-GroupSnapshotsTest-1844160717 None] Created reservations ['65037f20-b5c6-4177-9447-0c863ccc8576', '7a7484a2-6ec7-4259-b825-f90de57879ec', '1e6a2953-e8b8-451a-8242-4a6004bec8e7', 'd9e437ac-9cfe-458d-bef2-a0881152e86e'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:14.444846 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Volume volume-15fd35a7-de5b-44ee-af9e-26318f1c9422 (15fd35a7-de5b-44ee-af9e-26318f1c9422): created successfully Feb 19 21:08:14.450407 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafff165-0e3b-4e9a-8cde-625028baf327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:14.461678 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Flow 'volume_create_manager' (60dd8c66-332b-41c4-838a-4bbbf51276e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:08:14.478455 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-1ff0fb62-6bc5-4a51-af86-0d653a2c44f9 tempest-AttachVolumeTestJSON-597381258 None] Created volume successfully. Feb 19 21:08:14.526369 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-dcb8045f-4d71-4b23-81a3-03a0e47b1625 tempest-GroupSnapshotsTest-1844160717 None] group_snapshot 3d3924a7-98c3-4a0e-91f8-8ced1257360a: deleted successfully Feb 19 21:08:14.861924 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-79aec114-2700-48e8-9b52-781b18efdcf9 tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:14.932299 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-79aec114-2700-48e8-9b52-781b18efdcf9 tempest-GroupSnapshotsTest-1844160717 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:08:14.932871 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-79aec114-2700-48e8-9b52-781b18efdcf9 tempest-GroupSnapshotsTest-1844160717 None] Volume volume-8def28f5-3e5d-47b7-adeb-807ed76d0ae3 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:08:14.941895 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-79aec114-2700-48e8-9b52-781b18efdcf9 tempest-GroupSnapshotsTest-1844160717 None] deleting rbd volume volume-8def28f5-3e5d-47b7-adeb-807ed76d0ae3 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:08:15.366608 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-79aec114-2700-48e8-9b52-781b18efdcf9 tempest-GroupSnapshotsTest-1844160717 None] Created reservations ['ff703395-f3b9-48a3-8e0f-3366f29c6da5'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:15.402520 ncdv-master-1 cinder-volume[129319]: WARNING cinder.db.sqlalchemy.api [None req-79aec114-2700-48e8-9b52-781b18efdcf9 tempest-GroupSnapshotsTest-1844160717 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1048478450'] Feb 19 21:08:15.408179 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-79aec114-2700-48e8-9b52-781b18efdcf9 tempest-GroupSnapshotsTest-1844160717 None] Created reservations ['410e3a12-6366-422f-8f9a-242e92d613b6', '8838a68f-bdbe-43ef-89e4-4f883201d8d7', 'b16d3e7a-9469-45ac-b31b-58f3990dc9a3', 'ccf09650-cb4b-4250-9879-c392c147e4a0'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:15.518519 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-79aec114-2700-48e8-9b52-781b18efdcf9 tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:15.586415 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-79aec114-2700-48e8-9b52-781b18efdcf9 tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:15.653450 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-79aec114-2700-48e8-9b52-781b18efdcf9 tempest-GroupSnapshotsTest-1844160717 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:08:15.657774 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-79aec114-2700-48e8-9b52-781b18efdcf9 tempest-GroupSnapshotsTest-1844160717 None] Delete group completed successfully. Feb 19 21:08:16.424640 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-6768d674-2239-42f2-9cff-52dea663902f req-5aae118e-a9e6-4085-802e-82ea6117edf5 tempest-AttachVolumeTestJSON-597381258 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:08:16.503880 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-e0fb6ee6-2202-44ac-845c-958331c69aca tempest-GroupSnapshotsTest-1844160717 None] Group tempest-GroupSnapshotsTest-Group-1494724979: creating Feb 19 21:08:16.549750 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-e0fb6ee6-2202-44ac-845c-958331c69aca tempest-GroupSnapshotsTest-1844160717 None] Group tempest-GroupSnapshotsTest-Group-1494724979: created successfully Feb 19 21:08:16.562501 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-e0fb6ee6-2202-44ac-845c-958331c69aca tempest-GroupSnapshotsTest-1844160717 None] Create group completed successfully. Feb 19 21:08:17.560628 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-6768d674-2239-42f2-9cff-52dea663902f req-5aae118e-a9e6-4085-802e-82ea6117edf5 tempest-AttachVolumeTestJSON-597381258 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.136s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:08:17.561572 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-6768d674-2239-42f2-9cff-52dea663902f req-5aae118e-a9e6-4085-802e-82ea6117edf5 tempest-AttachVolumeTestJSON-597381258 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-15fd35a7-de5b-44ee-af9e-26318f1c9422', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '15fd35a7-de5b-44ee-af9e-26318f1c9422', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:08:17.601663 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-6768d674-2239-42f2-9cff-52dea663902f req-5aae118e-a9e6-4085-802e-82ea6117edf5 tempest-AttachVolumeTestJSON-597381258 None] Connection info returned from driver {'name': 'volumes/volume-15fd35a7-de5b-44ee-af9e-26318f1c9422', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '15fd35a7-de5b-44ee-af9e-26318f1c9422', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8480a9f8-de66-45b8-8608-e2f32c63e29e'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:08:17.667041 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-6768d674-2239-42f2-9cff-52dea663902f req-5aae118e-a9e6-4085-802e-82ea6117edf5 tempest-AttachVolumeTestJSON-597381258 None] attachment_update completed successfully. Feb 19 21:08:18.137635 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:08:18.150869 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:08:18.151285 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:08:18.174371 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Flow 'volume_create_manager' (d9589dfd-ad69-4797-ac32-827696c1f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:08:18.181725 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93da1ba6-c1dc-4b7d-bd60-b75466d40b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:18.193223 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:08:18.220574 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93da1ba6-c1dc-4b7d-bd60-b75466d40b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-45593353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=efd351ad-d3a2-492a-ba6b-13c65a1421f5,host='ncdv-master-1@ceph#ceph',id=ac1263db-ce68-40b9-a2c4-adfbafdff39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d10c7c8b9fba438abf201d80c58a8655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:08:18Z,use_quota=True,user_id='1466ade1177f483292054d2244caee36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a29a08d4-3fbf-436f-a5d4-44cccd67ba3c),volume_type_id=a29a08d4-3fbf-436f-a5d4-44cccd67ba3c)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:18.227339 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d35b92-bb4e-4d81-bc1a-a67c57d95f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:18.232141 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d35b92-bb4e-4d81-bc1a-a67c57d95f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:18.238738 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497d3d9d-0770-4ad3-aef9-36bda7d07a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:18.245083 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497d3d9d-0770-4ad3-aef9-36bda7d07a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac1263db-ce68-40b9-a2c4-adfbafdff39b', 'volume_name': 'volume-ac1263db-ce68-40b9-a2c4-adfbafdff39b', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:18.252198 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5daa7ee-a2b0-4131-9297-780e31edef6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:18.257820 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5daa7ee-a2b0-4131-9297-780e31edef6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:18.263718 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03bee88c-f709-4fe3-a763-ec1e8e17dd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:18.265237 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Volume ac1263db-ce68-40b9-a2c4-adfbafdff39b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac1263db-ce68-40b9-a2c4-adfbafdff39b', 'volume_size': 1} Feb 19 21:08:18.265653 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] creating volume 'volume-ac1263db-ce68-40b9-a2c4-adfbafdff39b' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:08:18.267438 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:18.384460 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] extra_specs: {} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:08:18.385074 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] extra_specs: {} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:08:18.389878 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03bee88c-f709-4fe3-a763-ec1e8e17dd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac1263db-ce68-40b9-a2c4-adfbafdff39b', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:18.395178 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6e74b4-e610-4a12-a3f5-a8deb4c7d1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:18.413788 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Volume volume-ac1263db-ce68-40b9-a2c4-adfbafdff39b (ac1263db-ce68-40b9-a2c4-adfbafdff39b): created successfully Feb 19 21:08:18.419800 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6e74b4-e610-4a12-a3f5-a8deb4c7d1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:18.427425 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Flow 'volume_create_manager' (d9589dfd-ad69-4797-ac32-827696c1f77e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:08:18.439497 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-375fcf5c-4445-4972-982f-b6ef73726a7e tempest-GroupSnapshotsTest-1844160717 None] Created volume successfully. Feb 19 21:08:20.040508 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:08:20.045544 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:08:20.046357 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:08:20.077652 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Flow 'volume_create_manager' (92d357a6-c5a5-4f2f-8be1-b3f025919c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:08:20.085946 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384794ec-e764-4925-8c6a-33f4e17f852b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:20.094432 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:08:20.111133 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384794ec-e764-4925-8c6a-33f4e17f852b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1322690306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=efd351ad-d3a2-492a-ba6b-13c65a1421f5,host='ncdv-master-1@ceph#ceph',id=b18a8420-ad56-41e3-8e6b-44dd8e2a22fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d10c7c8b9fba438abf201d80c58a8655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:08:20Z,use_quota=True,user_id='1466ade1177f483292054d2244caee36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a29a08d4-3fbf-436f-a5d4-44cccd67ba3c),volume_type_id=a29a08d4-3fbf-436f-a5d4-44cccd67ba3c)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:20.117529 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd10b6cb-4d6a-487e-939d-97b05a5267d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:20.122743 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd10b6cb-4d6a-487e-939d-97b05a5267d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:20.141888 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389671fa-4a2f-4529-b75b-648d2202909e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:20.155904 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389671fa-4a2f-4529-b75b-648d2202909e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18a8420-ad56-41e3-8e6b-44dd8e2a22fb', 'volume_name': 'volume-b18a8420-ad56-41e3-8e6b-44dd8e2a22fb', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:20.172978 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4137c2d4-787b-4271-a027-0a165ef0387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:20.184204 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4137c2d4-787b-4271-a027-0a165ef0387a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:20.191354 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7025d0a-a06a-46f5-99b8-39666885f801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:20.192676 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Volume b18a8420-ad56-41e3-8e6b-44dd8e2a22fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18a8420-ad56-41e3-8e6b-44dd8e2a22fb', 'volume_size': 1} Feb 19 21:08:20.193126 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] creating volume 'volume-b18a8420-ad56-41e3-8e6b-44dd8e2a22fb' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:08:20.194803 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:20.327192 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] extra_specs: {} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:08:20.327568 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] extra_specs: {} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:08:20.331440 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7025d0a-a06a-46f5-99b8-39666885f801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18a8420-ad56-41e3-8e6b-44dd8e2a22fb', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:20.341744 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763ea009-faaa-4088-8acd-9396db267054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:20.376941 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Volume volume-b18a8420-ad56-41e3-8e6b-44dd8e2a22fb (b18a8420-ad56-41e3-8e6b-44dd8e2a22fb): created successfully Feb 19 21:08:20.385522 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763ea009-faaa-4088-8acd-9396db267054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:20.394171 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Flow 'volume_create_manager' (92d357a6-c5a5-4f2f-8be1-b3f025919c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:08:20.409395 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-f4f502ce-f978-4963-aa69-bb7b789fed7f tempest-GroupSnapshotsTest-1844160717 None] Created volume successfully. Feb 19 21:08:21.181260 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-46d06347-e5e8-4ec0-9533-a3a485f9446a tempest-GroupSnapshotsTest-1844160717 None] Update group completed successfully. Feb 19 21:08:22.179203 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:08:22.180278 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:22.235317 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:22.292448 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:08:22.373221 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-e5432972-a402-4b38-96df-a19db5b80f19 tempest-GroupSnapshotsTest-1844160717 None] Update group completed successfully. Feb 19 21:08:23.487676 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d40ba12b-dd0c-4c94-b0bd-72c5512bfdb9 tempest-GroupSnapshotsTest-1844160717 None] Update group completed successfully. Feb 19 21:08:24.629505 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b4ef3266-da09-4ff0-80a2-38373dfc9ddc tempest-GroupSnapshotsTest-1844160717 None] Update group completed successfully. Feb 19 21:08:25.953339 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-607338cd-1b33-46f7-ac70-c8e77b88ce88 tempest-GroupSnapshotsTest-1844160717 None] GroupSnapshot 3de7ed4b-116b-4233-8563-820e8e780e44: creating. Feb 19 21:08:25.972817 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-607338cd-1b33-46f7-ac70-c8e77b88ce88 tempest-GroupSnapshotsTest-1844160717 None] Group snapshot 3de7ed4b-116b-4233-8563-820e8e780e44: creating. {{(pid=129319) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Feb 19 21:08:25.988842 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-607338cd-1b33-46f7-ac70-c8e77b88ce88 tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:27.106607 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-607338cd-1b33-46f7-ac70-c8e77b88ce88 tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:27.493648 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-bf571195-daa3-4926-9ddc-4efb575098d1 tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['bb582ae3-2ca3-4b96-85d0-cab643ce559a', '881afa94-add1-4066-ad07-71d04c222cd9', '49d0b396-8f52-4b84-a771-d38b076eccbd', '192824e2-78f3-418b-ba43-f1f427a10fda'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:27.541901 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-bf571195-daa3-4926-9ddc-4efb575098d1 tempest-VolumesSnapshotTestJSON-2140298196 None] Delete snapshot completed successfully. Feb 19 21:08:27.546543 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-bf571195-daa3-4926-9ddc-4efb575098d1 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-4709a1c3-f90e-43c8-a005-fd0a8f881f83-delete_snapshot'" released by "delete_snapshot" :: held 30.314s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:08:27.811316 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-225eb17c-51d6-4e72-8fd8-fb5274a82c83 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-a1602716-e7cb-4488-9c66-ef50faf65def-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.022s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:08:27.820417 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-225eb17c-51d6-4e72-8fd8-fb5274a82c83 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:28.201790 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-607338cd-1b33-46f7-ac70-c8e77b88ce88 tempest-GroupSnapshotsTest-1844160717 None] group_snapshot 3de7ed4b-116b-4233-8563-820e8e780e44: created successfully Feb 19 21:08:29.259556 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-5be7d2af-4585-4f51-83f5-b723f7b54a46 tempest-GroupSnapshotsTest-1844160717 None] group_snapshot 3de7ed4b-116b-4233-8563-820e8e780e44: deleting Feb 19 21:08:29.279237 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5be7d2af-4585-4f51-83f5-b723f7b54a46 tempest-GroupSnapshotsTest-1844160717 None] group_snapshot 3de7ed4b-116b-4233-8563-820e8e780e44: deleting {{(pid=129319) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Feb 19 21:08:29.297077 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5be7d2af-4585-4f51-83f5-b723f7b54a46 tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:30.154779 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5be7d2af-4585-4f51-83f5-b723f7b54a46 tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:31.243793 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-5be7d2af-4585-4f51-83f5-b723f7b54a46 tempest-GroupSnapshotsTest-1844160717 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-201469073 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-201469073, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:08:31.244613 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-5be7d2af-4585-4f51-83f5-b723f7b54a46 tempest-GroupSnapshotsTest-1844160717 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-201469073 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-201469073, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:08:31.264783 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-5be7d2af-4585-4f51-83f5-b723f7b54a46 tempest-GroupSnapshotsTest-1844160717 None] Created reservations ['ed3c010e-da23-4b11-8645-e049c6dd9abc', 'c6868e6f-f21e-49a7-bb3b-07767f1046d8', '69977dd6-f3e9-4047-8d10-44f4368f4748', '4fa268f7-9c19-423c-9454-4d0f5d4b16b2'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:31.368523 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-5be7d2af-4585-4f51-83f5-b723f7b54a46 tempest-GroupSnapshotsTest-1844160717 None] Created reservations ['bcaa4a7f-6600-4296-bbc0-355ff038cd1e', '6accfe5c-18a5-4980-93f5-8620004a5edd', 'bdfbd4cc-e697-49bb-abfd-627cb1f7d154', '16c79464-eccc-4707-b04a-2a385901a1d1'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:31.421883 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-5be7d2af-4585-4f51-83f5-b723f7b54a46 tempest-GroupSnapshotsTest-1844160717 None] group_snapshot 3de7ed4b-116b-4233-8563-820e8e780e44: deleted successfully Feb 19 21:08:31.857035 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:31.929036 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:08:31.929962 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] Volume volume-ac1263db-ce68-40b9-a2c4-adfbafdff39b is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:08:31.947849 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] deleting rbd volume volume-ac1263db-ce68-40b9-a2c4-adfbafdff39b {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:08:32.327925 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:32.425702 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:08:32.426828 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] Volume volume-b18a8420-ad56-41e3-8e6b-44dd8e2a22fb is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:08:32.440279 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] deleting rbd volume volume-b18a8420-ad56-41e3-8e6b-44dd8e2a22fb {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:08:32.784905 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] Created reservations ['2b5cb032-9045-4dcc-9997-53e5e50862cd'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:32.803962 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-201469073 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-201469073, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:08:32.818574 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] Created reservations ['160a6ea1-5a30-4eff-9ed3-078ae60739fc', 'df8e9a1e-a1d7-4e3a-b5e7-b83c343c6c35', '9e465627-e6ab-48d9-84e4-09758ac938df', '5b097fa4-b32f-47ff-84c5-fd551017b156'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:32.908502 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] Created reservations ['a0c6e0cd-57de-4705-8cb2-8d2fe70546b4', '888ca6b6-bf2a-41fd-85fc-ea5786263138', '87b87c06-c4a9-4dad-abc7-3ffa5dbd8be3', 'cd15d51b-9489-4ec8-aca5-a631377089c4'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:32.998047 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:33.027919 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:33.071746 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:08:33.076140 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-dd536370-afb6-4ea2-90da-69db33bca4fa tempest-GroupSnapshotsTest-1844160717 None] Delete group completed successfully. Feb 19 21:08:34.457310 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-490612ae-7c64-46da-a99e-32ecf804cfc9 tempest-GroupSnapshotsTest-1844160717 None] Group tempest-GroupSnapshotsTest-Group-1083459372: creating Feb 19 21:08:34.489789 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-490612ae-7c64-46da-a99e-32ecf804cfc9 tempest-GroupSnapshotsTest-1844160717 None] Group tempest-GroupSnapshotsTest-Group-1083459372: created successfully Feb 19 21:08:34.500886 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-490612ae-7c64-46da-a99e-32ecf804cfc9 tempest-GroupSnapshotsTest-1844160717 None] Create group completed successfully. Feb 19 21:08:36.311535 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:08:36.316670 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:08:36.317487 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:08:36.347593 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Flow 'volume_create_manager' (2b537b7f-024a-4d81-9bfe-7ca88f1aefea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:08:36.359529 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508ed31a-0365-4ebd-9be4-77f03765a35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:36.369904 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:08:36.388939 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508ed31a-0365-4ebd-9be4-77f03765a35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-422806478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa52e074-a33c-419c-985e-21cbe604444e,host='ncdv-master-1@ceph#ceph',id=a96a399f-a7c7-4a6d-b491-2002bc1615aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d10c7c8b9fba438abf201d80c58a8655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:08:36Z,use_quota=True,user_id='1466ade1177f483292054d2244caee36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea1173a2-d92e-466b-9e3b-a0656e0b0c77),volume_type_id=ea1173a2-d92e-466b-9e3b-a0656e0b0c77)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:36.395911 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902289dc-dceb-4374-af77-f18110ed7660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:36.402451 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902289dc-dceb-4374-af77-f18110ed7660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:36.408415 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228bce5a-9dee-4de5-abf9-b1036dd07b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:36.415311 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228bce5a-9dee-4de5-abf9-b1036dd07b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a96a399f-a7c7-4a6d-b491-2002bc1615aa', 'volume_name': 'volume-a96a399f-a7c7-4a6d-b491-2002bc1615aa', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:36.423989 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dcbf588-387b-4bd0-96ab-c713bb226eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:36.430159 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dcbf588-387b-4bd0-96ab-c713bb226eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:36.435605 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1708172b-0113-423c-a05d-dd87ac08d4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:36.437625 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Volume a96a399f-a7c7-4a6d-b491-2002bc1615aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a96a399f-a7c7-4a6d-b491-2002bc1615aa', 'volume_size': 1} Feb 19 21:08:36.438217 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] creating volume 'volume-a96a399f-a7c7-4a6d-b491-2002bc1615aa' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:08:36.439510 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:36.575825 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] extra_specs: {} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:08:36.576597 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] extra_specs: {} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:08:36.580850 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1708172b-0113-423c-a05d-dd87ac08d4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a96a399f-a7c7-4a6d-b491-2002bc1615aa', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:36.594109 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a7e2b3-9cf0-42fb-a26f-ac75b80fd541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:36.605597 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Volume volume-a96a399f-a7c7-4a6d-b491-2002bc1615aa (a96a399f-a7c7-4a6d-b491-2002bc1615aa): created successfully Feb 19 21:08:36.613540 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a7e2b3-9cf0-42fb-a26f-ac75b80fd541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:36.626105 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Flow 'volume_create_manager' (2b537b7f-024a-4d81-9bfe-7ca88f1aefea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:08:36.641697 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-fa361baf-3d96-4573-9dda-b08dfba781ec tempest-GroupSnapshotsTest-1844160717 None] Created volume successfully. Feb 19 21:08:37.692094 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3dd2564b-5f23-47db-8c0d-d9e0dbefb280 tempest-GroupSnapshotsTest-1844160717 None] GroupSnapshot 303f9500-6ded-48f9-9cc1-89c4c52fe292: creating. Feb 19 21:08:37.747785 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3dd2564b-5f23-47db-8c0d-d9e0dbefb280 tempest-GroupSnapshotsTest-1844160717 None] Group snapshot 303f9500-6ded-48f9-9cc1-89c4c52fe292: creating. {{(pid=129319) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Feb 19 21:08:37.791466 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3dd2564b-5f23-47db-8c0d-d9e0dbefb280 tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:38.562949 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3dd2564b-5f23-47db-8c0d-d9e0dbefb280 tempest-GroupSnapshotsTest-1844160717 None] group_snapshot 303f9500-6ded-48f9-9cc1-89c4c52fe292: created successfully Feb 19 21:08:39.214032 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d7a25887-2425-449d-8944-9c5c0e7b05a4 tempest-GroupSnapshotsTest-1844160717 None] group_snapshot 303f9500-6ded-48f9-9cc1-89c4c52fe292: deleting Feb 19 21:08:39.280008 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d7a25887-2425-449d-8944-9c5c0e7b05a4 tempest-GroupSnapshotsTest-1844160717 None] group_snapshot 303f9500-6ded-48f9-9cc1-89c4c52fe292: deleting {{(pid=129319) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Feb 19 21:08:39.318726 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d7a25887-2425-449d-8944-9c5c0e7b05a4 tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:40.585770 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-d7a25887-2425-449d-8944-9c5c0e7b05a4 tempest-GroupSnapshotsTest-1844160717 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-808076277 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-808076277, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:08:40.588663 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-d7a25887-2425-449d-8944-9c5c0e7b05a4 tempest-GroupSnapshotsTest-1844160717 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-808076277 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-808076277, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:08:40.609031 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-d7a25887-2425-449d-8944-9c5c0e7b05a4 tempest-GroupSnapshotsTest-1844160717 None] Created reservations ['6f335730-8f2b-47ac-b68a-083ee792ed83', 'ad8c3355-8434-48e4-99ef-196520b28aa0', '89ff6bb9-6bef-41c2-9706-c92871e15971', 'b59178ec-36ad-466c-832d-f1dfc3db5ba4'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:40.681475 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d7a25887-2425-449d-8944-9c5c0e7b05a4 tempest-GroupSnapshotsTest-1844160717 None] group_snapshot 303f9500-6ded-48f9-9cc1-89c4c52fe292: deleted successfully Feb 19 21:08:42.112356 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-35876f76-4406-42a1-9205-79d4aca3a3d1 tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:42.206003 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-35876f76-4406-42a1-9205-79d4aca3a3d1 tempest-GroupSnapshotsTest-1844160717 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:08:42.206687 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-35876f76-4406-42a1-9205-79d4aca3a3d1 tempest-GroupSnapshotsTest-1844160717 None] Volume volume-a96a399f-a7c7-4a6d-b491-2002bc1615aa is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:08:42.216831 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-35876f76-4406-42a1-9205-79d4aca3a3d1 tempest-GroupSnapshotsTest-1844160717 None] deleting rbd volume volume-a96a399f-a7c7-4a6d-b491-2002bc1615aa {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:08:42.770377 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-35876f76-4406-42a1-9205-79d4aca3a3d1 tempest-GroupSnapshotsTest-1844160717 None] Created reservations ['f23f9357-2d86-4774-b1f0-9781607ce5ac'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:42.791049 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-35876f76-4406-42a1-9205-79d4aca3a3d1 tempest-GroupSnapshotsTest-1844160717 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-808076277 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-808076277, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:08:42.818087 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-35876f76-4406-42a1-9205-79d4aca3a3d1 tempest-GroupSnapshotsTest-1844160717 None] Created reservations ['19b25d14-61a9-4593-8d7b-c1e5b4de4b40', '1f153868-ff2f-4e8c-ace1-70dc54c435ca', '44ed5e5b-a23f-49e5-9723-9921bfa45dc7', '8c4684c3-f67a-42ab-bf32-c1d0df7794ea'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:42.940765 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-35876f76-4406-42a1-9205-79d4aca3a3d1 tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:43.000762 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-35876f76-4406-42a1-9205-79d4aca3a3d1 tempest-GroupSnapshotsTest-1844160717 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:43.053443 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-35876f76-4406-42a1-9205-79d4aca3a3d1 tempest-GroupSnapshotsTest-1844160717 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:08:43.068095 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-35876f76-4406-42a1-9205-79d4aca3a3d1 tempest-GroupSnapshotsTest-1844160717 None] Delete group completed successfully. Feb 19 21:08:49.732386 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a561791f-e807-42d1-bf89-51332e5bd28c tempest-GroupsV314Test-431137722 None] Group tempest-GroupsV314Test-Group-894859535: creating Feb 19 21:08:49.761597 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a561791f-e807-42d1-bf89-51332e5bd28c tempest-GroupsV314Test-431137722 None] Group tempest-GroupsV314Test-Group-894859535: created successfully Feb 19 21:08:49.771944 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a561791f-e807-42d1-bf89-51332e5bd28c tempest-GroupsV314Test-431137722 None] Create group completed successfully. Feb 19 21:08:51.014434 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:08:51.030678 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:08:51.031368 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:08:51.051653 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Flow 'volume_create_manager' (871884fc-cb4a-42a0-8aab-838576f101c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:08:51.059281 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdc7bdd-6ace-4588-9fb6-fcad8539ee80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:51.065957 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:08:51.081047 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdc7bdd-6ace-4588-9fb6-fcad8539ee80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-921503319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d30d60bb-062b-4f19-a75c-1459ed361507,host='ncdv-master-1@ceph#ceph',id=1e91646b-3f00-475f-b794-f0683cd260cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b55d0fe70045ddac8112f06b75b66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:08:51Z,use_quota=True,user_id='f21551db5b4c4803baec9f555c9008f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2320386-075d-4a9b-ae23-a4638fa0afad),volume_type_id=f2320386-075d-4a9b-ae23-a4638fa0afad)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:51.086474 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8b0c97-84d9-4f5f-bf9e-2c86624b89c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:51.090655 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8b0c97-84d9-4f5f-bf9e-2c86624b89c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:51.096486 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85492905-bce7-41e4-9a82-75390fe1c203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:51.102207 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85492905-bce7-41e4-9a82-75390fe1c203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e91646b-3f00-475f-b794-f0683cd260cf', 'volume_name': 'volume-1e91646b-3f00-475f-b794-f0683cd260cf', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:51.107075 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046e70d7-0025-4e82-a73c-bdecb3ca7294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:51.111518 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046e70d7-0025-4e82-a73c-bdecb3ca7294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:51.116967 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48ec104-636d-48d3-a014-be7f30e97e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:51.118127 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Volume 1e91646b-3f00-475f-b794-f0683cd260cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e91646b-3f00-475f-b794-f0683cd260cf', 'volume_size': 1} Feb 19 21:08:51.118504 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] creating volume 'volume-1e91646b-3f00-475f-b794-f0683cd260cf' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:08:51.119692 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:51.205467 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] extra_specs: {} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:08:51.205892 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] extra_specs: {} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:08:51.210628 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48ec104-636d-48d3-a014-be7f30e97e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e91646b-3f00-475f-b794-f0683cd260cf', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:51.216254 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a38209-12d6-4844-af03-3e9a5855305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:08:51.226342 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Volume volume-1e91646b-3f00-475f-b794-f0683cd260cf (1e91646b-3f00-475f-b794-f0683cd260cf): created successfully Feb 19 21:08:51.230928 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a38209-12d6-4844-af03-3e9a5855305a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:08:51.236141 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Flow 'volume_create_manager' (871884fc-cb4a-42a0-8aab-838576f101c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:08:51.244827 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-43eda1fa-4c43-4bec-9072-5675a56b8484 tempest-GroupsV314Test-431137722 None] Created volume successfully. Feb 19 21:08:52.602314 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cfbf9503-0a11-4e26-8ad4-3185fe6571e2 tempest-GroupsV314Test-431137722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:52.681318 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cfbf9503-0a11-4e26-8ad4-3185fe6571e2 tempest-GroupsV314Test-431137722 None] creating snapshot='volume-779572f6-47ac-45b3-886c-27b6ce49b016.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:08:52.852002 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cfbf9503-0a11-4e26-8ad4-3185fe6571e2 tempest-GroupsV314Test-431137722 None] cloning 'volume-1e91646b-3f00-475f-b794-f0683cd260cf@volume-779572f6-47ac-45b3-886c-27b6ce49b016.clone_snap' to 'volume-779572f6-47ac-45b3-886c-27b6ce49b016' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:08:52.996576 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cfbf9503-0a11-4e26-8ad4-3185fe6571e2 tempest-GroupsV314Test-431137722 None] Volume volume-1e91646b-3f00-475f-b794-f0683cd260cf is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:08:53.001915 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cfbf9503-0a11-4e26-8ad4-3185fe6571e2 tempest-GroupsV314Test-431137722 None] extra_specs: {} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:08:53.002293 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cfbf9503-0a11-4e26-8ad4-3185fe6571e2 tempest-GroupsV314Test-431137722 None] extra_specs: {} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:08:53.045592 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cfbf9503-0a11-4e26-8ad4-3185fe6571e2 tempest-GroupsV314Test-431137722 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:08:53.111415 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-cfbf9503-0a11-4e26-8ad4-3185fe6571e2 tempest-GroupsV314Test-431137722 None] Create group from source-group-d30d60bb-062b-4f19-a75c-1459ed361507 completed successfully. Feb 19 21:08:54.442643 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-96c85055-1625-4381-85dd-113d9f956779 tempest-GroupsV314Test-431137722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:54.549087 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-96c85055-1625-4381-85dd-113d9f956779 tempest-GroupsV314Test-431137722 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:08:54.567247 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-96c85055-1625-4381-85dd-113d9f956779 tempest-GroupsV314Test-431137722 None] deleting rbd volume volume-779572f6-47ac-45b3-886c-27b6ce49b016 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:08:55.042835 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-96c85055-1625-4381-85dd-113d9f956779 tempest-GroupsV314Test-431137722 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:08:55.078950 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-96c85055-1625-4381-85dd-113d9f956779 tempest-GroupsV314Test-431137722 None] Volume volume-1e91646b-3f00-475f-b794-f0683cd260cf is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:08:55.078950 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-96c85055-1625-4381-85dd-113d9f956779 tempest-GroupsV314Test-431137722 None] deleting parent snapshot volume-779572f6-47ac-45b3-886c-27b6ce49b016.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:08:56.263683 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-96c85055-1625-4381-85dd-113d9f956779 tempest-GroupsV314Test-431137722 None] Created reservations ['e11270e6-9ae1-491e-b262-cf63f06e0c45'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:56.299274 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-96c85055-1625-4381-85dd-113d9f956779 tempest-GroupsV314Test-431137722 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1862868382 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1862868382, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:08:56.300136 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-96c85055-1625-4381-85dd-113d9f956779 tempest-GroupsV314Test-431137722 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1862868382 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1862868382, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:08:56.334930 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-96c85055-1625-4381-85dd-113d9f956779 tempest-GroupsV314Test-431137722 None] Created reservations ['e9da1d4f-c1ab-4140-b59f-0daa65aff19c', '4a10847a-129c-4131-9de7-1d42cc9fd928', '9ae55d92-389a-454c-a37b-328c28e38c67', '8c5d484a-abab-4718-b67c-c2b919322891'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:56.452495 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-96c85055-1625-4381-85dd-113d9f956779 tempest-GroupsV314Test-431137722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:56.508641 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-96c85055-1625-4381-85dd-113d9f956779 tempest-GroupsV314Test-431137722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:56.556568 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-96c85055-1625-4381-85dd-113d9f956779 tempest-GroupsV314Test-431137722 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:08:56.565448 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-96c85055-1625-4381-85dd-113d9f956779 tempest-GroupsV314Test-431137722 None] Delete group completed successfully. Feb 19 21:08:57.024159 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-75f823c6-1354-4c23-acfc-f75f0eb5478c tempest-GroupsV314Test-431137722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:57.141488 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-75f823c6-1354-4c23-acfc-f75f0eb5478c tempest-GroupsV314Test-431137722 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:08:57.141918 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-75f823c6-1354-4c23-acfc-f75f0eb5478c tempest-GroupsV314Test-431137722 None] Volume volume-1e91646b-3f00-475f-b794-f0683cd260cf is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:08:57.157593 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-75f823c6-1354-4c23-acfc-f75f0eb5478c tempest-GroupsV314Test-431137722 None] deleting rbd volume volume-1e91646b-3f00-475f-b794-f0683cd260cf {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:08:57.762602 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-75f823c6-1354-4c23-acfc-f75f0eb5478c tempest-GroupsV314Test-431137722 None] Created reservations ['2be699fd-e8c8-4c6e-bb1d-5337de4da756'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:57.815963 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-75f823c6-1354-4c23-acfc-f75f0eb5478c tempest-GroupsV314Test-431137722 None] Created reservations ['456f6630-4d3d-4870-8192-de9c1e8907f1', '81e8115c-4696-46db-99f9-d145907f69cd', '1fa99018-5907-4f4b-872e-81028bb82dc5', 'd97b2d2f-46a3-4480-873f-3a357196681b'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:57.927447 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-75f823c6-1354-4c23-acfc-f75f0eb5478c tempest-GroupsV314Test-431137722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:57.966279 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-75f823c6-1354-4c23-acfc-f75f0eb5478c tempest-GroupsV314Test-431137722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:08:58.019339 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-75f823c6-1354-4c23-acfc-f75f0eb5478c tempest-GroupsV314Test-431137722 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:08:58.049736 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-75f823c6-1354-4c23-acfc-f75f0eb5478c tempest-GroupsV314Test-431137722 None] Delete group completed successfully. Feb 19 21:08:58.105533 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-225eb17c-51d6-4e72-8fd8-fb5274a82c83 tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['6759801b-9921-4deb-bec5-c55c24872398', '6d4cbb4b-6827-4f58-bb42-75535c8edd19', '0adba486-6101-4bf4-97cf-b6035277ec1d', 'a5fba16e-c8fa-46cf-a901-403998a1c3b9'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:08:58.167091 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-225eb17c-51d6-4e72-8fd8-fb5274a82c83 tempest-VolumesSnapshotTestJSON-2140298196 None] Delete snapshot completed successfully. Feb 19 21:08:58.186844 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-225eb17c-51d6-4e72-8fd8-fb5274a82c83 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-a1602716-e7cb-4488-9c66-ef50faf65def-delete_snapshot'" released by "delete_snapshot" :: held 30.375s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:08:59.861668 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-e48dae99-f40a-4d11-82ad-2c36a0e7a383 req-d8d3f111-5dd2-4f60-b9d1-a6c9fdd98c20 tempest-VolumesSnapshotTestJSON-2140298196 None] Terminate volume connection completed successfully. Feb 19 21:08:59.863067 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-e48dae99-f40a-4d11-82ad-2c36a0e7a383 req-d8d3f111-5dd2-4f60-b9d1-a6c9fdd98c20 tempest-VolumesSnapshotTestJSON-2140298196 None] Deleting attachment 46d18974-18b9-4714-9813-fdab9f7baa93. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:09:04.428727 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:09:04.443277 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:09:04.446526 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:09:04.507651 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Flow 'volume_create_manager' (79047ce7-53a9-405b-b754-dcf425cc0f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:04.515701 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c00bf8-2e8b-4ccb-991f-4a909375cee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:04.524010 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:09:04.548278 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c00bf8-2e8b-4ccb-991f-4a909375cee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1153811241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b093079c-4b38-42c3-8d3a-5bb7721f272b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dea5f032894c1f968944abdac71f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:09:04Z,use_quota=True,user_id='93f89149cadc47ac81dd4885c5eec984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:04.555587 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd083bd-b78e-4756-982e-e6be9f47d230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:04.560385 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd083bd-b78e-4756-982e-e6be9f47d230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:04.566865 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ecff72-ef46-480f-a4ce-eded6a54a879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:04.571760 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ecff72-ef46-480f-a4ce-eded6a54a879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b093079c-4b38-42c3-8d3a-5bb7721f272b', 'volume_name': 'volume-b093079c-4b38-42c3-8d3a-5bb7721f272b', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:04.581791 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c1e39a-1caf-4b26-a849-89ee13732ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:04.586893 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c1e39a-1caf-4b26-a849-89ee13732ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:04.592972 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62610f6c-d8ff-4249-83cc-4065d774b0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:04.594921 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Volume b093079c-4b38-42c3-8d3a-5bb7721f272b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b093079c-4b38-42c3-8d3a-5bb7721f272b', 'volume_size': 1} Feb 19 21:09:04.595516 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] creating volume 'volume-b093079c-4b38-42c3-8d3a-5bb7721f272b' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:09:04.596768 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:04.765833 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:09:04.768152 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:09:04.773614 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62610f6c-d8ff-4249-83cc-4065d774b0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b093079c-4b38-42c3-8d3a-5bb7721f272b', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:04.780010 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60bc9010-3218-4d55-b16e-26079ecc4bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:04.798596 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Volume volume-b093079c-4b38-42c3-8d3a-5bb7721f272b (b093079c-4b38-42c3-8d3a-5bb7721f272b): created successfully Feb 19 21:09:04.807308 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60bc9010-3218-4d55-b16e-26079ecc4bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:04.821108 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Flow 'volume_create_manager' (79047ce7-53a9-405b-b754-dcf425cc0f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:04.842974 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-c406a37b-f51a-4e53-9310-f49887b6631d tempest-SnapshotsActionsTest-1340325958 None] Created volume successfully. Feb 19 21:09:05.472384 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:09:05.482405 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:09:05.489787 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:09:05.522775 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Flow 'volume_create_manager' (300ae5c6-352b-4fc8-82e0-88478ae83646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:05.558123 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dda4bdf-18d1-40ee-9dff-5be92875aa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:05.574712 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:09:05.600482 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dda4bdf-18d1-40ee-9dff-5be92875aa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-255703698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2d621d24-f58a-4e98-b668-c26d73aace5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9b396737a34280bdc448a2b0df5a7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:09:05Z,use_quota=True,user_id='0edf621841d44514b6082172d15af2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:05.607421 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f9c967-23f6-480d-aaf0-b619866f653f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:05.612711 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f9c967-23f6-480d-aaf0-b619866f653f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:05.619688 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c98e4b6-3d54-4335-8d3c-f1b5814dade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:05.625700 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c98e4b6-3d54-4335-8d3c-f1b5814dade2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d621d24-f58a-4e98-b668-c26d73aace5f', 'volume_name': 'volume-2d621d24-f58a-4e98-b668-c26d73aace5f', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:05.632726 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2848ad55-d136-4dfa-9060-b9c149b595ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:05.640436 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2848ad55-d136-4dfa-9060-b9c149b595ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:05.646894 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f3ddaf-a2ca-4592-bec0-e7bb864534a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:05.648908 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Volume 2d621d24-f58a-4e98-b668-c26d73aace5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d621d24-f58a-4e98-b668-c26d73aace5f', 'volume_size': 1} Feb 19 21:09:05.649610 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] creating volume 'volume-2d621d24-f58a-4e98-b668-c26d73aace5f' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:09:05.650884 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:05.780695 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3e4b80e0-a4f1-47fd-b736-92ea43fa6207 tempest-SnapshotsActionsTest-1340325958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:05.882361 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:09:05.882953 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:09:05.887479 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f3ddaf-a2ca-4592-bec0-e7bb864534a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d621d24-f58a-4e98-b668-c26d73aace5f', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:05.918030 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb99398-aea3-4c2c-92ce-598e5d599f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:05.945530 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Volume volume-2d621d24-f58a-4e98-b668-c26d73aace5f (2d621d24-f58a-4e98-b668-c26d73aace5f): created successfully Feb 19 21:09:05.954770 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb99398-aea3-4c2c-92ce-598e5d599f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:05.983586 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Flow 'volume_create_manager' (300ae5c6-352b-4fc8-82e0-88478ae83646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:05.998042 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-51fa966e-c793-40e0-8051-b792b6cbbe8a tempest-VolumesSnapshotTestJSON-2140298196 None] Created volume successfully. Feb 19 21:09:06.644312 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8fe5cdf1-9d13-4d6f-a2f3-0305b43b594c tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:06.862650 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3e4b80e0-a4f1-47fd-b736-92ea43fa6207 tempest-SnapshotsActionsTest-1340325958 None] Create snapshot completed successfully Feb 19 21:09:07.790257 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8fe5cdf1-9d13-4d6f-a2f3-0305b43b594c tempest-VolumesSnapshotTestJSON-2140298196 None] Create snapshot completed successfully Feb 19 21:09:08.520289 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cd196000-3799-4bcd-8eb9-7dcecec35a1f tempest-SnapshotsActionsTest-1340325958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:09.306142 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:09:09.310848 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:09:09.311711 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:09:09.349835 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Flow 'volume_create_manager' (2216349b-c00b-4759-b9ae-c281a39734f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:09.356541 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87a961e-f872-4b91-bd6e-0a3b2aee2c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:09.364006 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:09:09.379706 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87a961e-f872-4b91-bd6e-0a3b2aee2c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-20980637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6c9029fa-fdf4-4e74-b9b0-5060cee03f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9b396737a34280bdc448a2b0df5a7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:09:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8afd9c63-530c-4a92-949f-c6a1e95fb31a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:09:09Z,use_quota=True,user_id='0edf621841d44514b6082172d15af2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:09.386579 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41122f39-ab51-4b71-ba6b-8e9e503babdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:09.391695 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41122f39-ab51-4b71-ba6b-8e9e503babdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:09.398427 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069c8051-13e5-44b3-af0f-81cd9ccc7ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:09.402971 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069c8051-13e5-44b3-af0f-81cd9ccc7ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6c9029fa-fdf4-4e74-b9b0-5060cee03f7a', 'volume_name': 'volume-6c9029fa-fdf4-4e74-b9b0-5060cee03f7a', 'volume_size': 2, 'snapshot_id': '8afd9c63-530c-4a92-949f-c6a1e95fb31a'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:09.408085 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45471bfc-69b5-4e50-a54b-66cd3b3b44fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:09.413311 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45471bfc-69b5-4e50-a54b-66cd3b3b44fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:09.419211 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c043a2-f005-44f0-9e77-f44d36c1d5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:09.420560 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Volume 6c9029fa-fdf4-4e74-b9b0-5060cee03f7a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6c9029fa-fdf4-4e74-b9b0-5060cee03f7a', 'volume_size': 2, 'snapshot_id': '8afd9c63-530c-4a92-949f-c6a1e95fb31a'} Feb 19 21:09:09.440590 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] cloning volumes/volume-2d621d24-f58a-4e98-b668-c26d73aace5f@snapshot-8afd9c63-530c-4a92-949f-c6a1e95fb31a to volume-6c9029fa-fdf4-4e74-b9b0-5060cee03f7a {{(pid=129319) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 19 21:09:09.441843 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:09.500190 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:09.655246 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:09:09.656016 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:09:09.662794 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:09.840319 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-cd196000-3799-4bcd-8eb9-7dcecec35a1f tempest-SnapshotsActionsTest-1340325958 None] Create snapshot completed successfully Feb 19 21:09:09.883598 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c043a2-f005-44f0-9e77-f44d36c1d5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c9029fa-fdf4-4e74-b9b0-5060cee03f7a', 'volume_size': 2, 'snapshot_id': '8afd9c63-530c-4a92-949f-c6a1e95fb31a'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:09.888308 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22bd533-cd1f-4de5-97b3-b543629e2c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:09.897175 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Volume volume-6c9029fa-fdf4-4e74-b9b0-5060cee03f7a (6c9029fa-fdf4-4e74-b9b0-5060cee03f7a): created successfully Feb 19 21:09:09.900955 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22bd533-cd1f-4de5-97b3-b543629e2c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:09.907158 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Flow 'volume_create_manager' (2216349b-c00b-4759-b9ae-c281a39734f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:09.920988 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-6adf8fdb-14cb-44c2-b702-d4849019062b tempest-VolumesSnapshotTestJSON-2140298196 None] Created volume successfully. Feb 19 21:09:10.354367 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-60b697de-fd16-43fd-90c6-fcec602892e8 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-6c9029fa-fdf4-4e74-b9b0-5060cee03f7a-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:10.410550 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-60b697de-fd16-43fd-90c6-fcec602892e8 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:10.507602 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-60b697de-fd16-43fd-90c6-fcec602892e8 tempest-VolumesSnapshotTestJSON-2140298196 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:09:10.517985 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-60b697de-fd16-43fd-90c6-fcec602892e8 tempest-VolumesSnapshotTestJSON-2140298196 None] deleting rbd volume volume-6c9029fa-fdf4-4e74-b9b0-5060cee03f7a {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:09:10.753673 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3db3c710-c205-4cee-b9fe-1cab91be9cae tempest-SnapshotsActionsTest-1555434808 None] Lock "b'cinder-de1ec351-072c-462b-a66c-993fff3b355d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:10.766985 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3db3c710-c205-4cee-b9fe-1cab91be9cae tempest-SnapshotsActionsTest-1555434808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:10.898222 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-60b697de-fd16-43fd-90c6-fcec602892e8 tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['86c2e354-6820-4e92-bd78-d37ca33490ab', 'c60e9432-7bb9-4f90-b955-7e9cdf168668', 'eec3a6fa-fbf7-43ae-a9ee-eea5e5a10a4c', 'fde6b7f9-007e-429f-a3d6-3e49520f4d54'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:10.964426 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-60b697de-fd16-43fd-90c6-fcec602892e8 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:11.010748 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-60b697de-fd16-43fd-90c6-fcec602892e8 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:11.083781 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-60b697de-fd16-43fd-90c6-fcec602892e8 tempest-VolumesSnapshotTestJSON-2140298196 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:11.089618 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-60b697de-fd16-43fd-90c6-fcec602892e8 tempest-VolumesSnapshotTestJSON-2140298196 None] Deleted volume successfully. Feb 19 21:09:11.107485 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-60b697de-fd16-43fd-90c6-fcec602892e8 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-6c9029fa-fdf4-4e74-b9b0-5060cee03f7a-delete_volume'" released by "delete_volume" :: held 0.753s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:11.847291 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-3db3c710-c205-4cee-b9fe-1cab91be9cae tempest-SnapshotsActionsTest-1555434808 None] Created reservations ['49b958ec-fbd6-48bc-a9d1-33be5e22f633', 'cc1a282b-43d5-4b02-b025-8f3fb9269fc5', '81a335d7-7f6c-4b25-8925-22ab44e61dcc', '1f7ee900-66b7-4168-883c-271a01624277'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:11.907247 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3db3c710-c205-4cee-b9fe-1cab91be9cae tempest-SnapshotsActionsTest-1555434808 None] Delete snapshot completed successfully. Feb 19 21:09:11.914394 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3db3c710-c205-4cee-b9fe-1cab91be9cae tempest-SnapshotsActionsTest-1555434808 None] Lock "b'cinder-de1ec351-072c-462b-a66c-993fff3b355d-delete_snapshot'" released by "delete_snapshot" :: held 1.161s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:11.939184 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:09:11.944603 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:09:11.945283 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:09:11.966230 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Flow 'volume_create_manager' (a9240c88-7a40-45ad-9c3b-bb84f0fabae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:11.973258 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f58f9eb-6313-41ff-a6de-9b2f570ab25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:11.982001 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:09:11.997540 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f58f9eb-6313-41ff-a6de-9b2f570ab25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-44355470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e0dd6639-878a-46c6-9770-091d86cd4f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9b396737a34280bdc448a2b0df5a7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:09:12Z,use_quota=True,user_id='0edf621841d44514b6082172d15af2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:12.005731 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de93392-36c1-478c-9344-9617eec02e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:12.011303 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de93392-36c1-478c-9344-9617eec02e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:12.019114 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8289ffd-5686-4306-93c1-93d49c1eb191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:12.026084 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8289ffd-5686-4306-93c1-93d49c1eb191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0dd6639-878a-46c6-9770-091d86cd4f2a', 'volume_name': 'volume-e0dd6639-878a-46c6-9770-091d86cd4f2a', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:12.033125 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b386a75-0793-4631-bbb5-9ccf14f1fd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:12.035820 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b386a75-0793-4631-bbb5-9ccf14f1fd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:12.042775 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73af481a-3030-4480-bf57-a9710638b30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:12.044018 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Volume e0dd6639-878a-46c6-9770-091d86cd4f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0dd6639-878a-46c6-9770-091d86cd4f2a', 'volume_size': 1} Feb 19 21:09:12.044443 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] creating volume 'volume-e0dd6639-878a-46c6-9770-091d86cd4f2a' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:09:12.045497 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:12.129494 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:09:12.129785 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:09:12.134218 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73af481a-3030-4480-bf57-a9710638b30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0dd6639-878a-46c6-9770-091d86cd4f2a', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:12.139273 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9130d02f-ba3a-4c42-80e6-3a72dbc2827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:12.149959 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Volume volume-e0dd6639-878a-46c6-9770-091d86cd4f2a (e0dd6639-878a-46c6-9770-091d86cd4f2a): created successfully Feb 19 21:09:12.153895 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9130d02f-ba3a-4c42-80e6-3a72dbc2827f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:12.159624 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Flow 'volume_create_manager' (a9240c88-7a40-45ad-9c3b-bb84f0fabae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:12.169122 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-09b0d019-1d17-45c0-b2d9-d1f1bd9fb03d tempest-VolumesSnapshotTestJSON-2140298196 None] Created volume successfully. Feb 19 21:09:13.191383 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:09:13.196526 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:09:13.197129 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:09:13.220848 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Flow 'volume_create_manager' (019ac5b9-c130-4f65-afaa-8231ed4085e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:13.229850 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8683c40-2aba-46f0-8c7c-3fd67ea4e5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:13.240221 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:09:13.264814 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8683c40-2aba-46f0-8c7c-3fd67ea4e5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-536016436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9eeb3952-afce-4cc3-aefc-9628c75b06c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a9695bfcbf4ba2bb0e81f060f0a4e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:09:13Z,use_quota=True,user_id='74e8119404b84d46a857e43d1e2567d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(781feec3-e324-49d1-b4f4-ab5fb54e4153),volume_type_id=781feec3-e324-49d1-b4f4-ab5fb54e4153)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:13.271985 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf54542-b59d-40f3-b642-ac6d0aab97de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:13.277951 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf54542-b59d-40f3-b642-ac6d0aab97de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:13.284567 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba93ed1-6446-4c59-8956-094a75e61d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:13.291297 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba93ed1-6446-4c59-8956-094a75e61d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eeb3952-afce-4cc3-aefc-9628c75b06c9', 'volume_name': 'volume-9eeb3952-afce-4cc3-aefc-9628c75b06c9', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:13.298007 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e424d8a4-9843-4aca-917c-16203fd364e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:13.302690 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e424d8a4-9843-4aca-917c-16203fd364e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:13.308742 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae31c0e3-0393-46f5-9e00-025e5042b458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:13.309904 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Volume 9eeb3952-afce-4cc3-aefc-9628c75b06c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eeb3952-afce-4cc3-aefc-9628c75b06c9', 'volume_size': 1} Feb 19 21:09:13.310535 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] creating volume 'volume-9eeb3952-afce-4cc3-aefc-9628c75b06c9' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:09:13.311672 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:13.385312 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-fa5c55c3-d4d4-4eaa-88e3-b2d8db98a5ae tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:13.491916 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] extra_specs: {} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:09:13.492287 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] extra_specs: {} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:09:13.496371 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae31c0e3-0393-46f5-9e00-025e5042b458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eeb3952-afce-4cc3-aefc-9628c75b06c9', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:13.501689 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2222b6-884b-480c-99db-b9120abca698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:13.516278 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Volume volume-9eeb3952-afce-4cc3-aefc-9628c75b06c9 (9eeb3952-afce-4cc3-aefc-9628c75b06c9): created successfully Feb 19 21:09:13.520181 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2222b6-884b-480c-99db-b9120abca698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:13.526633 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Flow 'volume_create_manager' (019ac5b9-c130-4f65-afaa-8231ed4085e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:13.544418 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f2a0e4f7-680b-4e9b-89e6-5cbc8d8f505a tempest-SnapshotsActionsTest-1340325958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:13.598249 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-be778582-a84c-4de5-a5bc-df38557c09f2 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Created volume successfully. Feb 19 21:09:13.911915 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-fa5c55c3-d4d4-4eaa-88e3-b2d8db98a5ae tempest-VolumesSnapshotTestJSON-2140298196 None] Create snapshot completed successfully Feb 19 21:09:13.916356 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-f2a0e4f7-680b-4e9b-89e6-5cbc8d8f505a tempest-SnapshotsActionsTest-1340325958 None] Create snapshot completed successfully Feb 19 21:09:14.718632 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ed51c4b3-ffa3-4f3c-9ff7-0b15520fdda0 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:14.788891 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ed51c4b3-ffa3-4f3c-9ff7-0b15520fdda0 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:14.842938 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-ed51c4b3-ffa3-4f3c-9ff7-0b15520fdda0 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:14.869079 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ed51c4b3-ffa3-4f3c-9ff7-0b15520fdda0 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Retype volume completed successfully. Feb 19 21:09:14.894293 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-53f8e112-abce-4cb4-8da7-3ab802acebab tempest-SnapshotsActionsTest-1555434808 None] Lock "b'cinder-3b4dd666-68e0-442c-9ee2-bf1991a34d5f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.038s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:14.898071 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-53f8e112-abce-4cb4-8da7-3ab802acebab tempest-SnapshotsActionsTest-1555434808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:14.991264 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:09:14.994906 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:09:14.995538 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:09:15.029676 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Flow 'volume_create_manager' (d55809fd-1f4c-490e-9b23-b5d810d8c2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:15.037445 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08e41b5-7874-4322-90c3-1485d3318863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:15.045191 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:09:15.064819 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08e41b5-7874-4322-90c3-1485d3318863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1529647602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2eac2460-a651-4735-bc73-f112396c9981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9b396737a34280bdc448a2b0df5a7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e415d407-a78b-4258-9967-d00931eb45b2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:09:15Z,use_quota=True,user_id='0edf621841d44514b6082172d15af2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:15.072121 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc39ebd-af81-4364-9410-fa3de1abd51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:15.077896 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc39ebd-af81-4364-9410-fa3de1abd51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:15.084105 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77174dd9-4f19-4db2-bb48-0eea1c193e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:15.089029 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77174dd9-4f19-4db2-bb48-0eea1c193e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2eac2460-a651-4735-bc73-f112396c9981', 'volume_name': 'volume-2eac2460-a651-4735-bc73-f112396c9981', 'volume_size': 1, 'snapshot_id': 'e415d407-a78b-4258-9967-d00931eb45b2'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:15.094507 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0b160c-9595-4fd4-adff-e80f4179d93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:15.100192 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0b160c-9595-4fd4-adff-e80f4179d93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:15.105385 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b24d7d0-944f-4f51-969a-adc6b6bf454b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:15.106620 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Volume 2eac2460-a651-4735-bc73-f112396c9981: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2eac2460-a651-4735-bc73-f112396c9981', 'volume_size': 1, 'snapshot_id': 'e415d407-a78b-4258-9967-d00931eb45b2'} Feb 19 21:09:15.127329 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] cloning volumes/volume-e0dd6639-878a-46c6-9770-091d86cd4f2a@snapshot-e415d407-a78b-4258-9967-d00931eb45b2 to volume-2eac2460-a651-4735-bc73-f112396c9981 {{(pid=129319) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 19 21:09:15.128179 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:15.195630 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:15.373668 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:09:15.374059 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:09:15.397004 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b24d7d0-944f-4f51-969a-adc6b6bf454b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eac2460-a651-4735-bc73-f112396c9981', 'volume_size': 1, 'snapshot_id': 'e415d407-a78b-4258-9967-d00931eb45b2'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:15.402732 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7dd0b9c-e01c-4cc4-9603-eb86624505a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:15.413476 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Volume volume-2eac2460-a651-4735-bc73-f112396c9981 (2eac2460-a651-4735-bc73-f112396c9981): created successfully Feb 19 21:09:15.418648 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7dd0b9c-e01c-4cc4-9603-eb86624505a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:15.424490 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Flow 'volume_create_manager' (d55809fd-1f4c-490e-9b23-b5d810d8c2f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:15.439428 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3024839d-ac4f-4c0c-8d4b-863de013b797 tempest-VolumesSnapshotTestJSON-2140298196 None] Created volume successfully. Feb 19 21:09:15.896871 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-74482522-cb3a-45a5-be18-eda03b5b0482 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Lock "b'cinder-9eeb3952-afce-4cc3-aefc-9628c75b06c9-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:15.977867 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-74482522-cb3a-45a5-be18-eda03b5b0482 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:16.045851 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-74482522-cb3a-45a5-be18-eda03b5b0482 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:09:16.046985 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-74482522-cb3a-45a5-be18-eda03b5b0482 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Volume volume-9eeb3952-afce-4cc3-aefc-9628c75b06c9 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:09:16.062535 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-74482522-cb3a-45a5-be18-eda03b5b0482 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] deleting rbd volume volume-9eeb3952-afce-4cc3-aefc-9628c75b06c9 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:09:16.103696 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-0b58240e-5dc9-4e36-96f5-204a948d2d12 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-2eac2460-a651-4735-bc73-f112396c9981-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:16.147040 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-53f8e112-abce-4cb4-8da7-3ab802acebab tempest-SnapshotsActionsTest-1555434808 None] Created reservations ['4c23625a-6b56-4f6d-9d54-4343c9573d26', 'b179456b-a699-4093-a518-1f6ca3a83aa5', '0df5596d-c229-4e42-902b-e8e5a269d8ab', '2251e45a-184e-4263-8167-0d0beb63f873'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:16.170643 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-0b58240e-5dc9-4e36-96f5-204a948d2d12 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:16.287042 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-0b58240e-5dc9-4e36-96f5-204a948d2d12 tempest-VolumesSnapshotTestJSON-2140298196 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:09:16.303210 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-0b58240e-5dc9-4e36-96f5-204a948d2d12 tempest-VolumesSnapshotTestJSON-2140298196 None] deleting rbd volume volume-2eac2460-a651-4735-bc73-f112396c9981 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:09:16.346401 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-53f8e112-abce-4cb4-8da7-3ab802acebab tempest-SnapshotsActionsTest-1555434808 None] Delete snapshot completed successfully. Feb 19 21:09:16.358312 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-53f8e112-abce-4cb4-8da7-3ab802acebab tempest-SnapshotsActionsTest-1555434808 None] Lock "b'cinder-3b4dd666-68e0-442c-9ee2-bf1991a34d5f-delete_snapshot'" released by "delete_snapshot" :: held 1.466s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:16.622437 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-74482522-cb3a-45a5-be18-eda03b5b0482 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:09:16.623014 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-74482522-cb3a-45a5-be18-eda03b5b0482 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:09:16.641973 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-74482522-cb3a-45a5-be18-eda03b5b0482 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Created reservations ['a2a8b673-6cef-4422-8f47-bbeec8812a06', '8d8170e2-894c-4f4f-8cbd-6f29d1512bf1', '3a1a1d11-ffb0-4c73-9724-70ac4dc3b6f7', 'e372e162-995d-4c32-afaf-bcf51ddade79'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:16.706214 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-74482522-cb3a-45a5-be18-eda03b5b0482 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:16.747421 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-74482522-cb3a-45a5-be18-eda03b5b0482 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:16.789650 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-74482522-cb3a-45a5-be18-eda03b5b0482 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:16.813132 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-74482522-cb3a-45a5-be18-eda03b5b0482 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Deleted volume successfully. Feb 19 21:09:16.836955 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-74482522-cb3a-45a5-be18-eda03b5b0482 tempest-VolumeRetypeWithoutMigrationTest-1988670183 None] Lock "b'cinder-9eeb3952-afce-4cc3-aefc-9628c75b06c9-delete_volume'" released by "delete_volume" :: held 0.939s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:16.866540 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-0b58240e-5dc9-4e36-96f5-204a948d2d12 tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['649aa619-c730-4946-b73d-728442ef56d5', 'dd53491f-ce24-467d-a3fc-237760051f44', 'f8bb3a98-5384-4a2f-b93a-a7d20642e57a', '8340cd7d-3735-4497-a3a1-a25c5fb671e2'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:16.926456 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-0b58240e-5dc9-4e36-96f5-204a948d2d12 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:16.993153 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-0b58240e-5dc9-4e36-96f5-204a948d2d12 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:17.041813 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-0b58240e-5dc9-4e36-96f5-204a948d2d12 tempest-VolumesSnapshotTestJSON-2140298196 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:17.048939 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-0b58240e-5dc9-4e36-96f5-204a948d2d12 tempest-VolumesSnapshotTestJSON-2140298196 None] Deleted volume successfully. Feb 19 21:09:17.076961 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-0b58240e-5dc9-4e36-96f5-204a948d2d12 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-2eac2460-a651-4735-bc73-f112396c9981-delete_volume'" released by "delete_volume" :: held 0.974s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:17.430619 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2773fba2-5a69-4bff-9a32-d1eb40d07915 tempest-SnapshotsActionsTest-1340325958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:17.544074 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-ded8f5ef-077b-47f8-9a44-687d330fd3af tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-e415d407-a78b-4258-9967-d00931eb45b2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.133s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:17.546579 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ded8f5ef-077b-47f8-9a44-687d330fd3af tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:18.009272 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-2773fba2-5a69-4bff-9a32-d1eb40d07915 tempest-SnapshotsActionsTest-1340325958 None] Create snapshot completed successfully Feb 19 21:09:18.733504 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a4f355fc-03de-4b8f-9067-59d78e420a85 tempest-SnapshotsActionsTest-1555434808 None] Lock "b'cinder-f1e5427f-4239-484c-ad61-60a7e247c265-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:18.734951 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a4f355fc-03de-4b8f-9067-59d78e420a85 tempest-SnapshotsActionsTest-1555434808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:19.122944 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-ded8f5ef-077b-47f8-9a44-687d330fd3af tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['ba0f2751-373f-4f60-aef1-91a6f23f62de', '023e10c2-92bd-4aea-834a-25b395b54a43', 'a9a6ee24-73f8-4a8c-a7ff-1f278ccc4c66', '573b97aa-2c44-460e-8e33-54c5bc4f0829'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:19.255616 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ded8f5ef-077b-47f8-9a44-687d330fd3af tempest-VolumesSnapshotTestJSON-2140298196 None] Delete snapshot completed successfully. Feb 19 21:09:19.271605 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-ded8f5ef-077b-47f8-9a44-687d330fd3af tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-e415d407-a78b-4258-9967-d00931eb45b2-delete_snapshot'" released by "delete_snapshot" :: held 1.727s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:19.613255 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-7e59dc4f-2f73-4fe8-870b-adc89eb504d8 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-e0dd6639-878a-46c6-9770-091d86cd4f2a-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:19.678618 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7e59dc4f-2f73-4fe8-870b-adc89eb504d8 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:19.757000 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7e59dc4f-2f73-4fe8-870b-adc89eb504d8 tempest-VolumesSnapshotTestJSON-2140298196 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:09:19.758251 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7e59dc4f-2f73-4fe8-870b-adc89eb504d8 tempest-VolumesSnapshotTestJSON-2140298196 None] Volume volume-e0dd6639-878a-46c6-9770-091d86cd4f2a is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:09:19.773990 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7e59dc4f-2f73-4fe8-870b-adc89eb504d8 tempest-VolumesSnapshotTestJSON-2140298196 None] deleting rbd volume volume-e0dd6639-878a-46c6-9770-091d86cd4f2a {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:09:20.054559 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-a4f355fc-03de-4b8f-9067-59d78e420a85 tempest-SnapshotsActionsTest-1555434808 None] Created reservations ['407aeb89-37bc-4ea1-891e-997761d01ebd', 'ca29314f-6653-4bbf-a923-ab6cfe74fd4a', '0ce93e8f-b9de-4009-9773-ba7c63dd1437', '1f08c183-4b5d-4d52-bcba-145e360c0195'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:20.114454 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a4f355fc-03de-4b8f-9067-59d78e420a85 tempest-SnapshotsActionsTest-1555434808 None] Delete snapshot completed successfully. Feb 19 21:09:20.120740 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a4f355fc-03de-4b8f-9067-59d78e420a85 tempest-SnapshotsActionsTest-1555434808 None] Lock "b'cinder-f1e5427f-4239-484c-ad61-60a7e247c265-delete_snapshot'" released by "delete_snapshot" :: held 1.387s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:20.423482 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-7e59dc4f-2f73-4fe8-870b-adc89eb504d8 tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['7753a5ff-5500-4439-8313-1a86f426cd19', 'c8c0824c-5af0-45c7-8e4f-2dc0e0da3a11', 'ad3992f6-300b-4142-9b1e-2a6eb9515078', '8b30eb96-0eba-4765-a99d-e747aa9eab7c'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:20.502314 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7e59dc4f-2f73-4fe8-870b-adc89eb504d8 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:20.559165 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7e59dc4f-2f73-4fe8-870b-adc89eb504d8 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:20.632500 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-7e59dc4f-2f73-4fe8-870b-adc89eb504d8 tempest-VolumesSnapshotTestJSON-2140298196 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:20.637974 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-7e59dc4f-2f73-4fe8-870b-adc89eb504d8 tempest-VolumesSnapshotTestJSON-2140298196 None] Deleted volume successfully. Feb 19 21:09:20.653975 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-7e59dc4f-2f73-4fe8-870b-adc89eb504d8 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-e0dd6639-878a-46c6-9770-091d86cd4f2a-delete_volume'" released by "delete_volume" :: held 1.041s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:20.894595 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-86966c85-dc42-4b64-a854-0df2ef99bb86 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-8afd9c63-530c-4a92-949f-c6a1e95fb31a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.042s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:20.900191 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-86966c85-dc42-4b64-a854-0df2ef99bb86 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:21.230806 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-71734eab-432f-48b2-b547-31d991f67e2b tempest-SnapshotsActionsTest-1340325958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:22.146843 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-86966c85-dc42-4b64-a854-0df2ef99bb86 tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['2fe35d65-71b6-455a-bbc8-87881e18677c', '25c8f563-93a3-455f-816a-5d62d8b4eb62', 'fffa9b03-089d-4e48-8bb1-5368a7c0c32b', '99716821-de6a-40da-b265-370750225307'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:22.149847 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-71734eab-432f-48b2-b547-31d991f67e2b tempest-SnapshotsActionsTest-1340325958 None] Create snapshot completed successfully Feb 19 21:09:22.178384 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:09:22.179484 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:22.248851 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:22.310553 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:22.395433 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-86966c85-dc42-4b64-a854-0df2ef99bb86 tempest-VolumesSnapshotTestJSON-2140298196 None] Delete snapshot completed successfully. Feb 19 21:09:22.400575 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-86966c85-dc42-4b64-a854-0df2ef99bb86 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-8afd9c63-530c-4a92-949f-c6a1e95fb31a-delete_snapshot'" released by "delete_snapshot" :: held 1.506s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:22.548637 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-6ccc4bad-bd1d-4fca-9e94-129b8ed670ed tempest-SnapshotsActionsTest-1555434808 None] Lock "b'cinder-a9e88fa1-ffcc-4ac6-b262-7cd0f57d4fde-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.038s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:22.548637 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6ccc4bad-bd1d-4fca-9e94-129b8ed670ed tempest-SnapshotsActionsTest-1555434808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:23.091853 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-f1ba3971-4d4e-4347-8a94-67ac576d530c tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-2d621d24-f58a-4e98-b668-c26d73aace5f-delete_volume'" acquired by "delete_volume" :: waited 0.050s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:23.144400 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f1ba3971-4d4e-4347-8a94-67ac576d530c tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:23.200416 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f1ba3971-4d4e-4347-8a94-67ac576d530c tempest-VolumesSnapshotTestJSON-2140298196 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:09:23.201542 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f1ba3971-4d4e-4347-8a94-67ac576d530c tempest-VolumesSnapshotTestJSON-2140298196 None] Volume volume-2d621d24-f58a-4e98-b668-c26d73aace5f is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:09:23.210960 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f1ba3971-4d4e-4347-8a94-67ac576d530c tempest-VolumesSnapshotTestJSON-2140298196 None] deleting rbd volume volume-2d621d24-f58a-4e98-b668-c26d73aace5f {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:09:23.217178 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-6ccc4bad-bd1d-4fca-9e94-129b8ed670ed tempest-SnapshotsActionsTest-1555434808 None] Created reservations ['d5df1a20-668c-4040-800f-9263c0e7430d', 'acfd4a41-7ecf-40cb-8027-8c8b994d463c', '9474ef65-df94-4e0d-9174-7a34dc4bdca0', '4cc7574f-802e-4ecd-9698-5046b862ef34'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:23.291516 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-6ccc4bad-bd1d-4fca-9e94-129b8ed670ed tempest-SnapshotsActionsTest-1555434808 None] Delete snapshot completed successfully. Feb 19 21:09:23.299382 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-6ccc4bad-bd1d-4fca-9e94-129b8ed670ed tempest-SnapshotsActionsTest-1555434808 None] Lock "b'cinder-a9e88fa1-ffcc-4ac6-b262-7cd0f57d4fde-delete_snapshot'" released by "delete_snapshot" :: held 0.755s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:23.674542 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-f1ba3971-4d4e-4347-8a94-67ac576d530c tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['de2b1c31-9c27-47e3-be59-9885c8e99187', 'd80e9d2e-6d83-47f8-b271-47086f4ea1b3', 'b2a86d24-e33c-4041-bf77-5fcb5fcd0b50', 'b4ed327a-bcc4-438a-b6be-81fe5e5ba197'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:23.832419 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f1ba3971-4d4e-4347-8a94-67ac576d530c tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:23.905426 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f1ba3971-4d4e-4347-8a94-67ac576d530c tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:23.982674 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-f1ba3971-4d4e-4347-8a94-67ac576d530c tempest-VolumesSnapshotTestJSON-2140298196 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:23.999565 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-f1ba3971-4d4e-4347-8a94-67ac576d530c tempest-VolumesSnapshotTestJSON-2140298196 None] Deleted volume successfully. Feb 19 21:09:24.027144 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-f1ba3971-4d4e-4347-8a94-67ac576d530c tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-2d621d24-f58a-4e98-b668-c26d73aace5f-delete_volume'" released by "delete_volume" :: held 0.941s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:24.373000 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-213a1172-86cc-4820-b3da-d1eb2ac793a5 tempest-SnapshotsActionsTest-1340325958 None] Lock "b'cinder-53453a52-3025-478c-a950-0d948687badb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.023s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:24.376021 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-213a1172-86cc-4820-b3da-d1eb2ac793a5 tempest-SnapshotsActionsTest-1340325958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:24.555578 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-2a70ef24-38a0-4576-9f87-6952c6d5f1ad tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-493c2856-8fb5-4b6f-bc89-58eb61177127-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:24.606412 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2a70ef24-38a0-4576-9f87-6952c6d5f1ad tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:24.691495 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2a70ef24-38a0-4576-9f87-6952c6d5f1ad tempest-VolumesSnapshotTestJSON-2140298196 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:09:24.706593 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2a70ef24-38a0-4576-9f87-6952c6d5f1ad tempest-VolumesSnapshotTestJSON-2140298196 None] deleting rbd volume volume-493c2856-8fb5-4b6f-bc89-58eb61177127 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:09:24.946532 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2a70ef24-38a0-4576-9f87-6952c6d5f1ad tempest-VolumesSnapshotTestJSON-2140298196 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:09:24.996416 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2a70ef24-38a0-4576-9f87-6952c6d5f1ad tempest-VolumesSnapshotTestJSON-2140298196 None] deleting parent snapshot volume-493c2856-8fb5-4b6f-bc89-58eb61177127.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:09:25.767516 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-2a70ef24-38a0-4576-9f87-6952c6d5f1ad tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['bafba3a4-be2c-4bb9-a9d4-f4a56bbce094', '0ae6073c-d24c-4d36-b35e-bc6ebbe3b932', 'a221c7f0-179a-4ca2-833f-397948e20fd6', 'b57af757-fd1f-49b0-a415-0904a63165c8'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:25.845135 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-213a1172-86cc-4820-b3da-d1eb2ac793a5 tempest-SnapshotsActionsTest-1340325958 None] Created reservations ['ce13209c-f936-4410-a0f5-058890bd3b9b', '2846bb58-f151-4a9d-98e1-3776bec07ff6', '558cc9c1-ded5-46d8-98fe-1c2a001f77af', 'e7fee1ea-93d7-4e72-bf28-456cf7369fa8'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:25.880722 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2a70ef24-38a0-4576-9f87-6952c6d5f1ad tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:25.935416 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2a70ef24-38a0-4576-9f87-6952c6d5f1ad tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:26.018057 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-2a70ef24-38a0-4576-9f87-6952c6d5f1ad tempest-VolumesSnapshotTestJSON-2140298196 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:26.026564 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-2a70ef24-38a0-4576-9f87-6952c6d5f1ad tempest-VolumesSnapshotTestJSON-2140298196 None] Deleted volume successfully. Feb 19 21:09:26.046079 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-2a70ef24-38a0-4576-9f87-6952c6d5f1ad tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-493c2856-8fb5-4b6f-bc89-58eb61177127-delete_volume'" released by "delete_volume" :: held 1.491s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:26.058683 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-213a1172-86cc-4820-b3da-d1eb2ac793a5 tempest-SnapshotsActionsTest-1340325958 None] Delete snapshot completed successfully. Feb 19 21:09:26.065851 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-213a1172-86cc-4820-b3da-d1eb2ac793a5 tempest-SnapshotsActionsTest-1340325958 None] Lock "b'cinder-53453a52-3025-478c-a950-0d948687badb-delete_snapshot'" released by "delete_snapshot" :: held 1.692s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:26.611948 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-2f313db7-85cc-4de6-b1a6-f9f72c3a9dc7 tempest-SnapshotsActionsTest-1340325958 None] Lock "b'cinder-b093079c-4b38-42c3-8d3a-5bb7721f272b-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:26.696229 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2f313db7-85cc-4de6-b1a6-f9f72c3a9dc7 tempest-SnapshotsActionsTest-1340325958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:26.802288 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2f313db7-85cc-4de6-b1a6-f9f72c3a9dc7 tempest-SnapshotsActionsTest-1340325958 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:09:26.802897 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2f313db7-85cc-4de6-b1a6-f9f72c3a9dc7 tempest-SnapshotsActionsTest-1340325958 None] Volume volume-b093079c-4b38-42c3-8d3a-5bb7721f272b is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:09:26.817108 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2f313db7-85cc-4de6-b1a6-f9f72c3a9dc7 tempest-SnapshotsActionsTest-1340325958 None] deleting rbd volume volume-b093079c-4b38-42c3-8d3a-5bb7721f272b {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:09:26.976045 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-52e5332b-7e67-4211-a7bc-2066aa36ee27 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-1a3ea589-1e1c-4cc0-ad9c-0f18a0026976-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.022s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:26.979555 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-52e5332b-7e67-4211-a7bc-2066aa36ee27 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:27.333704 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-2f313db7-85cc-4de6-b1a6-f9f72c3a9dc7 tempest-SnapshotsActionsTest-1340325958 None] Created reservations ['0066cedd-80a8-4f1e-80f3-bdf34baed3fc', 'cc3a18e6-fb67-4033-87f1-5309804cd9b4', '630996a6-60e6-412e-9f2b-65a85e3abc35', '56828f05-b789-401e-b69c-086c773208fa'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:27.409203 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2f313db7-85cc-4de6-b1a6-f9f72c3a9dc7 tempest-SnapshotsActionsTest-1340325958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:27.442994 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2f313db7-85cc-4de6-b1a6-f9f72c3a9dc7 tempest-SnapshotsActionsTest-1340325958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:27.485066 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-2f313db7-85cc-4de6-b1a6-f9f72c3a9dc7 tempest-SnapshotsActionsTest-1340325958 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:27.489927 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-2f313db7-85cc-4de6-b1a6-f9f72c3a9dc7 tempest-SnapshotsActionsTest-1340325958 None] Deleted volume successfully. Feb 19 21:09:27.503779 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-2f313db7-85cc-4de6-b1a6-f9f72c3a9dc7 tempest-SnapshotsActionsTest-1340325958 None] Lock "b'cinder-b093079c-4b38-42c3-8d3a-5bb7721f272b-delete_volume'" released by "delete_volume" :: held 0.892s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:28.152693 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:09:28.157628 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:09:28.158308 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:09:28.177924 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Flow 'volume_create_manager' (a63767d5-5cb5-47b5-92c6-faa551b855ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:28.184758 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95aa3c8a-5730-473f-bd2b-858bdf390352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:28.199054 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:09:28.224725 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95aa3c8a-5730-473f-bd2b-858bdf390352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1230416965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e5226fd7-c21d-4e64-b702-37724ce4c595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc16bded5c94738af3359f5d222bfe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:09:28Z,use_quota=True,user_id='9b38446c9fb34a33a7b297eae8fbf6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(186a0965-bbb0-4afa-9312-6734db88ac18),volume_type_id=186a0965-bbb0-4afa-9312-6734db88ac18)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:28.230604 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4cf0e1-ba60-4454-b4f8-8ec65c300932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:28.235165 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4cf0e1-ba60-4454-b4f8-8ec65c300932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:28.241333 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c015eb73-aee7-4721-98b8-d52ce12b3080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:28.245649 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c015eb73-aee7-4721-98b8-d52ce12b3080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5226fd7-c21d-4e64-b702-37724ce4c595', 'volume_name': 'volume-e5226fd7-c21d-4e64-b702-37724ce4c595', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:28.250701 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826a6432-a959-44a3-b196-4fe6d6573e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:28.255426 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826a6432-a959-44a3-b196-4fe6d6573e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:28.260247 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ab7d33-b811-4f05-8d7c-98b4b1e4cfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:28.261403 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Volume e5226fd7-c21d-4e64-b702-37724ce4c595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5226fd7-c21d-4e64-b702-37724ce4c595', 'volume_size': 1} Feb 19 21:09:28.261796 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] creating volume 'volume-e5226fd7-c21d-4e64-b702-37724ce4c595' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:09:28.262895 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:28.343485 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-52e5332b-7e67-4211-a7bc-2066aa36ee27 tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['2a22471f-9ba9-4cce-9805-21caecd90e03', '2338e04c-621e-499a-8fcf-ad67862f4d12', 'f9e3b900-94be-47cf-a7d8-be3a1fcc6e93', '075115e9-8f0e-495f-8d85-e84d712eb16a'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:28.380644 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] extra_specs: {} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:09:28.381131 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] extra_specs: {} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:09:28.385346 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ab7d33-b811-4f05-8d7c-98b4b1e4cfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5226fd7-c21d-4e64-b702-37724ce4c595', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:28.390306 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebca781-0f89-4e8d-bcca-8de8f41033c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:28.410001 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Volume volume-e5226fd7-c21d-4e64-b702-37724ce4c595 (e5226fd7-c21d-4e64-b702-37724ce4c595): created successfully Feb 19 21:09:28.416371 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebca781-0f89-4e8d-bcca-8de8f41033c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:28.423104 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Flow 'volume_create_manager' (a63767d5-5cb5-47b5-92c6-faa551b855ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:28.430722 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-52e5332b-7e67-4211-a7bc-2066aa36ee27 tempest-VolumesSnapshotTestJSON-2140298196 None] Delete snapshot completed successfully. Feb 19 21:09:28.440345 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-52e5332b-7e67-4211-a7bc-2066aa36ee27 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-1a3ea589-1e1c-4cc0-ad9c-0f18a0026976-delete_snapshot'" released by "delete_snapshot" :: held 1.464s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:28.442479 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-74e001a9-a18d-48d3-ad85-633499e9d335 tempest-VolumeTypesAccessTest-1732402236 None] Created volume successfully. Feb 19 21:09:29.243639 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-d483ea62-833b-4f00-979a-7466cf7faa36 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-3c4659bd-63a9-4ccf-8885-d4725562e8a0-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:29.308712 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d483ea62-833b-4f00-979a-7466cf7faa36 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:29.397194 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d483ea62-833b-4f00-979a-7466cf7faa36 tempest-VolumesSnapshotTestJSON-2140298196 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:09:29.397615 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d483ea62-833b-4f00-979a-7466cf7faa36 tempest-VolumesSnapshotTestJSON-2140298196 None] Volume volume-3c4659bd-63a9-4ccf-8885-d4725562e8a0 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:09:29.429168 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d483ea62-833b-4f00-979a-7466cf7faa36 tempest-VolumesSnapshotTestJSON-2140298196 None] deleting rbd volume volume-3c4659bd-63a9-4ccf-8885-d4725562e8a0 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:09:29.882625 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-9bdaaae9-e744-4788-90a1-69be7ead20eb tempest-VolumeTypesAccessTest-1732402236 None] Lock "b'cinder-e5226fd7-c21d-4e64-b702-37724ce4c595-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:30.024676 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9bdaaae9-e744-4788-90a1-69be7ead20eb tempest-VolumeTypesAccessTest-1732402236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:30.108476 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9bdaaae9-e744-4788-90a1-69be7ead20eb tempest-VolumeTypesAccessTest-1732402236 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:09:30.109393 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9bdaaae9-e744-4788-90a1-69be7ead20eb tempest-VolumeTypesAccessTest-1732402236 None] Volume volume-e5226fd7-c21d-4e64-b702-37724ce4c595 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:09:30.126682 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9bdaaae9-e744-4788-90a1-69be7ead20eb tempest-VolumeTypesAccessTest-1732402236 None] deleting rbd volume volume-e5226fd7-c21d-4e64-b702-37724ce4c595 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:09:30.150985 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-d483ea62-833b-4f00-979a-7466cf7faa36 tempest-VolumesSnapshotTestJSON-2140298196 None] Created reservations ['fbf89d4a-9dcc-4e86-b8e4-16d4e5524d20', '39537546-511e-41a3-a075-3303751511aa', '2f16269b-0d7c-435e-8460-8739c6d19714', 'a1ceda09-b251-4fbf-9886-1b7b42abd9c7'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:30.246915 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d483ea62-833b-4f00-979a-7466cf7faa36 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:30.345718 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d483ea62-833b-4f00-979a-7466cf7faa36 tempest-VolumesSnapshotTestJSON-2140298196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:30.455577 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-d483ea62-833b-4f00-979a-7466cf7faa36 tempest-VolumesSnapshotTestJSON-2140298196 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:30.461028 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d483ea62-833b-4f00-979a-7466cf7faa36 tempest-VolumesSnapshotTestJSON-2140298196 None] Deleted volume successfully. Feb 19 21:09:30.483976 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-d483ea62-833b-4f00-979a-7466cf7faa36 tempest-VolumesSnapshotTestJSON-2140298196 None] Lock "b'cinder-3c4659bd-63a9-4ccf-8885-d4725562e8a0-delete_volume'" released by "delete_volume" :: held 1.241s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:30.720542 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-9bdaaae9-e744-4788-90a1-69be7ead20eb tempest-VolumeTypesAccessTest-1732402236 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1426475551 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1426475551, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:09:30.721347 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-9bdaaae9-e744-4788-90a1-69be7ead20eb tempest-VolumeTypesAccessTest-1732402236 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1426475551 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1426475551, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:09:30.739083 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-9bdaaae9-e744-4788-90a1-69be7ead20eb tempest-VolumeTypesAccessTest-1732402236 None] Created reservations ['13e6e90a-b552-4d2c-a1fd-6c34c960b70f', 'd58819e7-ed05-4930-a367-4569bc416a22', '4fb88db8-b01b-4592-8997-380c55ed2649', '731667bb-4ba3-4036-9e1b-d176e1abd056'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:30.809182 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9bdaaae9-e744-4788-90a1-69be7ead20eb tempest-VolumeTypesAccessTest-1732402236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:30.857508 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9bdaaae9-e744-4788-90a1-69be7ead20eb tempest-VolumeTypesAccessTest-1732402236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:30.902219 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-9bdaaae9-e744-4788-90a1-69be7ead20eb tempest-VolumeTypesAccessTest-1732402236 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:30.908402 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-9bdaaae9-e744-4788-90a1-69be7ead20eb tempest-VolumeTypesAccessTest-1732402236 None] Deleted volume successfully. Feb 19 21:09:30.934475 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-9bdaaae9-e744-4788-90a1-69be7ead20eb tempest-VolumeTypesAccessTest-1732402236 None] Lock "b'cinder-e5226fd7-c21d-4e64-b702-37724ce4c595-delete_volume'" released by "delete_volume" :: held 1.052s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:33.252830 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:09:33.256771 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:09:33.257537 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:09:33.278051 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Flow 'volume_create_manager' (25adeb2f-e325-43a7-ab67-28273865550b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:33.284750 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd58239-1fed-4f62-9f44-8afc5580c096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:33.293319 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:09:33.308699 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd58239-1fed-4f62-9f44-8afc5580c096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1394888419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=037667a7-c1f2-458e-aa11-2d3a515e9929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe922c59496340b484fcbc21e6b98aa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:09:33Z,use_quota=True,user_id='06d114f732524806aef02b8091c1adfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:33.314389 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59371809-02ff-477b-821b-7067f66a649c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:33.319288 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59371809-02ff-477b-821b-7067f66a649c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:33.324699 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78540d28-487d-43e8-ae29-70da961daf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:33.329100 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78540d28-487d-43e8-ae29-70da961daf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '037667a7-c1f2-458e-aa11-2d3a515e9929', 'volume_name': 'volume-037667a7-c1f2-458e-aa11-2d3a515e9929', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:33.338058 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f5bb10-a331-4fa1-bb1f-b500e8a950e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:33.344194 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f5bb10-a331-4fa1-bb1f-b500e8a950e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:33.349828 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02acf00-137c-43af-ad01-c835d5faac70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:33.351114 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Volume 037667a7-c1f2-458e-aa11-2d3a515e9929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-037667a7-c1f2-458e-aa11-2d3a515e9929', 'volume_size': 1} Feb 19 21:09:33.352176 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] creating volume 'volume-037667a7-c1f2-458e-aa11-2d3a515e9929' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:09:33.352748 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:33.472207 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:09:33.472617 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:09:33.477942 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02acf00-137c-43af-ad01-c835d5faac70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-037667a7-c1f2-458e-aa11-2d3a515e9929', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:33.483064 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68abdf06-2edc-4955-a7bb-8b1e28681f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:33.496266 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Volume volume-037667a7-c1f2-458e-aa11-2d3a515e9929 (037667a7-c1f2-458e-aa11-2d3a515e9929): created successfully Feb 19 21:09:33.500981 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68abdf06-2edc-4955-a7bb-8b1e28681f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:33.508079 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Flow 'volume_create_manager' (25adeb2f-e325-43a7-ab67-28273865550b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:33.525912 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-37daed8a-bddb-457b-8a0b-4bdb694bdd2f tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Created volume successfully. Feb 19 21:09:34.681072 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8feb008e-c485-45da-87cb-08359f8248ef tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:35.363485 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8feb008e-c485-45da-87cb-08359f8248ef tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Create snapshot completed successfully Feb 19 21:09:36.299562 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a178f2c7-a17b-45ec-8eea-a577ac6c330c tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Lock "b'cinder-128630af-667f-4779-bf64-12a2050aff50-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.026s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:36.302839 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a178f2c7-a17b-45ec-8eea-a577ac6c330c tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:37.429901 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-a178f2c7-a17b-45ec-8eea-a577ac6c330c tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Created reservations ['1a6cbf2b-4773-4606-a766-2e7b2cc32738', '0daad5ca-908e-42a8-8f77-699eb388f2bd', '1138871e-11b7-4d8d-a3d9-93151c5954e4', '82053ae9-0693-4007-8873-158d411ac45a'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:37.510795 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a178f2c7-a17b-45ec-8eea-a577ac6c330c tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Delete snapshot completed successfully. Feb 19 21:09:37.518954 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a178f2c7-a17b-45ec-8eea-a577ac6c330c tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Lock "b'cinder-128630af-667f-4779-bf64-12a2050aff50-delete_snapshot'" released by "delete_snapshot" :: held 1.220s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:38.451498 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-c8ecda37-4c93-4aa1-9b5c-8288ba6bbbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Lock "b'cinder-037667a7-c1f2-458e-aa11-2d3a515e9929-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:38.491455 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c8ecda37-4c93-4aa1-9b5c-8288ba6bbbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:38.550054 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c8ecda37-4c93-4aa1-9b5c-8288ba6bbbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:09:38.550452 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c8ecda37-4c93-4aa1-9b5c-8288ba6bbbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Volume volume-037667a7-c1f2-458e-aa11-2d3a515e9929 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:09:38.560432 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c8ecda37-4c93-4aa1-9b5c-8288ba6bbbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] deleting rbd volume volume-037667a7-c1f2-458e-aa11-2d3a515e9929 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:09:39.052815 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-c8ecda37-4c93-4aa1-9b5c-8288ba6bbbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Created reservations ['47e0e5f6-31ae-4186-84ac-6d3a2c8e3100', 'ece36671-9ebb-49ae-b1b9-4004e34566b6', '1f227105-9975-43a1-ba7d-5ea57a29d372', 'a324d801-e104-476a-981a-7343c3d14f81'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:39.128613 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c8ecda37-4c93-4aa1-9b5c-8288ba6bbbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:39.182988 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c8ecda37-4c93-4aa1-9b5c-8288ba6bbbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:39.238425 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-c8ecda37-4c93-4aa1-9b5c-8288ba6bbbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:39.243874 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-c8ecda37-4c93-4aa1-9b5c-8288ba6bbbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Deleted volume successfully. Feb 19 21:09:39.262634 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-c8ecda37-4c93-4aa1-9b5c-8288ba6bbbdb tempest-VolumeSnapshotQuotasNegativeTestJSON-2120298722 None] Lock "b'cinder-037667a7-c1f2-458e-aa11-2d3a515e9929-delete_volume'" released by "delete_volume" :: held 0.811s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:43.439532 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:09:43.444855 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:09:43.445735 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:09:43.470842 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Flow 'volume_create_manager' (c18e69a3-3614-427c-93e9-4becbb4639d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:43.479650 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdee3ea-4a5d-4d5f-8b42-ea6a2d49c707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:43.486658 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:09:43.503186 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdee3ea-4a5d-4d5f-8b42-ea6a2d49c707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-565121456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9da44adb-907a-46cf-b30b-95a1ae5aea77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='817d9ee0a83c4d7bb3f89e39672b3ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:09:43Z,use_quota=True,user_id='98e561dfb87f4d7b8bdac1b469ed2c90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:43.509709 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab084daa-a4e0-408f-b905-5e6934a80652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:43.514543 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab084daa-a4e0-408f-b905-5e6934a80652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:43.521400 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818f823f-09e7-433e-9e66-33b3fa243188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:43.530189 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818f823f-09e7-433e-9e66-33b3fa243188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da44adb-907a-46cf-b30b-95a1ae5aea77', 'volume_name': 'volume-9da44adb-907a-46cf-b30b-95a1ae5aea77', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:43.535509 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2590c6dd-3bac-48e8-9ed4-878effac375c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:43.540890 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2590c6dd-3bac-48e8-9ed4-878effac375c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:43.545901 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa57e9c-1d16-4983-9d6c-13bfbcfcef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:43.547013 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Volume 9da44adb-907a-46cf-b30b-95a1ae5aea77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da44adb-907a-46cf-b30b-95a1ae5aea77', 'volume_size': 1} Feb 19 21:09:43.547403 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] creating volume 'volume-9da44adb-907a-46cf-b30b-95a1ae5aea77' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:09:43.548435 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:43.696986 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:09:43.697527 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:09:43.702718 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa57e9c-1d16-4983-9d6c-13bfbcfcef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da44adb-907a-46cf-b30b-95a1ae5aea77', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:43.714170 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04526630-af57-4d7f-ae63-08e00897bdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:43.745250 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Volume volume-9da44adb-907a-46cf-b30b-95a1ae5aea77 (9da44adb-907a-46cf-b30b-95a1ae5aea77): created successfully Feb 19 21:09:43.750870 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04526630-af57-4d7f-ae63-08e00897bdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:43.764269 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Flow 'volume_create_manager' (c18e69a3-3614-427c-93e9-4becbb4639d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:43.790419 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-78bf5940-187d-41e1-88d0-292ece2d1f14 tempest-VolumesListTestJSON-1102891740 None] Created volume successfully. Feb 19 21:09:45.008698 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:09:45.016979 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:09:45.021464 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:09:45.065218 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Flow 'volume_create_manager' (508914b6-c31f-45b6-9523-8814a7e60900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:45.081720 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2540797-3383-472b-9bbd-c3794c8d17da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:45.101973 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:09:45.129205 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2540797-3383-472b-9bbd-c3794c8d17da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1691795788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0262ad70-1541-44e8-a89f-104f380ac013,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='817d9ee0a83c4d7bb3f89e39672b3ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:09:45Z,use_quota=True,user_id='98e561dfb87f4d7b8bdac1b469ed2c90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:45.142962 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59f1344-dd43-4357-873a-13657a3d41ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:45.153929 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59f1344-dd43-4357-873a-13657a3d41ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:45.171340 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85b489b-53cd-4e35-b6a7-ef9456623591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:45.188658 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85b489b-53cd-4e35-b6a7-ef9456623591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0262ad70-1541-44e8-a89f-104f380ac013', 'volume_name': 'volume-0262ad70-1541-44e8-a89f-104f380ac013', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:45.200587 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6806e5-bb79-427b-84e0-84b2f6611659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:45.209751 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6806e5-bb79-427b-84e0-84b2f6611659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:45.226034 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fa6aa0-8d83-45bb-976c-38078961363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:45.229889 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Volume 0262ad70-1541-44e8-a89f-104f380ac013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0262ad70-1541-44e8-a89f-104f380ac013', 'volume_size': 1} Feb 19 21:09:45.230530 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] creating volume 'volume-0262ad70-1541-44e8-a89f-104f380ac013' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:09:45.236525 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:45.409784 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:09:45.410414 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:09:45.415258 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fa6aa0-8d83-45bb-976c-38078961363e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0262ad70-1541-44e8-a89f-104f380ac013', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:45.420522 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84952eff-975e-42df-8d3c-8a26bc2b486d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:45.453006 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Volume volume-0262ad70-1541-44e8-a89f-104f380ac013 (0262ad70-1541-44e8-a89f-104f380ac013): created successfully Feb 19 21:09:45.457973 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84952eff-975e-42df-8d3c-8a26bc2b486d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:45.472492 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Flow 'volume_create_manager' (508914b6-c31f-45b6-9523-8814a7e60900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:45.497003 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8c5d326b-8d98-4c04-860c-cc04853122fe tempest-VolumesListTestJSON-1102891740 None] Created volume successfully. Feb 19 21:09:46.647381 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:09:46.654507 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:09:46.655937 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:09:46.723192 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Flow 'volume_create_manager' (efcc74cd-8d5b-44c8-93b2-00e5004ddf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:46.749294 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a650016-1397-4ec0-8050-a62e8fa756ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:46.761508 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:09:46.825648 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a650016-1397-4ec0-8050-a62e8fa756ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1229360284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=42a55df3-699a-4b50-8702-5ce93da7fff1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='817d9ee0a83c4d7bb3f89e39672b3ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:09:47Z,use_quota=True,user_id='98e561dfb87f4d7b8bdac1b469ed2c90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:46.839101 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca6c598-1dd1-4a07-988b-7e2c7f23895c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:46.845324 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca6c598-1dd1-4a07-988b-7e2c7f23895c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:46.853166 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6211ed-64af-4135-a604-51539697249e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:46.862509 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6211ed-64af-4135-a604-51539697249e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a55df3-699a-4b50-8702-5ce93da7fff1', 'volume_name': 'volume-42a55df3-699a-4b50-8702-5ce93da7fff1', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:46.869320 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36b0408-3a80-4dac-977c-29f9669820bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:46.874676 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36b0408-3a80-4dac-977c-29f9669820bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:46.881076 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5050bc62-ff44-4547-9553-b89201fae14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:46.883199 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Volume 42a55df3-699a-4b50-8702-5ce93da7fff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a55df3-699a-4b50-8702-5ce93da7fff1', 'volume_size': 1} Feb 19 21:09:46.883962 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] creating volume 'volume-42a55df3-699a-4b50-8702-5ce93da7fff1' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:09:46.885491 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:46.960497 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:09:46.965742 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:09:46.966478 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:09:46.993846 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Flow 'volume_create_manager' (33bd7bcd-9d03-4b9d-b256-b88c29f29042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:47.003408 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10e474f-8e7c-46b1-b530-09152e4891ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:47.013094 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:09:47.034095 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10e474f-8e7c-46b1-b530-09152e4891ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1819319719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d9b285e-72d2-4afc-ab5d-5a6e940c5fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='991178f94bdc40b69af75ce8c36ab5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:09:47Z,use_quota=True,user_id='23571a2bdce54e46b86c89ae723dae1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9e96ad5-68d6-4801-80cb-2e1c962dab7f),volume_type_id=a9e96ad5-68d6-4801-80cb-2e1c962dab7f)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:47.041037 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573fb485-84ec-476f-a95d-b67cb0db4fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:47.045772 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573fb485-84ec-476f-a95d-b67cb0db4fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:47.055188 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7f8ed8-aa05-4afc-b4df-059122765fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:47.060070 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7f8ed8-aa05-4afc-b4df-059122765fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9b285e-72d2-4afc-ab5d-5a6e940c5fdd', 'volume_name': 'volume-5d9b285e-72d2-4afc-ab5d-5a6e940c5fdd', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:47.065588 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448ec1e4-6367-4d56-9164-c1d3998849c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:47.075093 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448ec1e4-6367-4d56-9164-c1d3998849c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:47.080993 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50db5005-8b13-4798-80aa-a81e5f9699e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:47.082389 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Volume 5d9b285e-72d2-4afc-ab5d-5a6e940c5fdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9b285e-72d2-4afc-ab5d-5a6e940c5fdd', 'volume_size': 1} Feb 19 21:09:47.083581 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] creating volume 'volume-5d9b285e-72d2-4afc-ab5d-5a6e940c5fdd' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:09:47.084824 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:47.151557 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:09:47.153269 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:09:47.159375 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5050bc62-ff44-4547-9553-b89201fae14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a55df3-699a-4b50-8702-5ce93da7fff1', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:47.170287 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b77f20-e94e-48fa-8035-c0329642ed91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:47.188638 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Volume volume-42a55df3-699a-4b50-8702-5ce93da7fff1 (42a55df3-699a-4b50-8702-5ce93da7fff1): created successfully Feb 19 21:09:47.194935 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b77f20-e94e-48fa-8035-c0329642ed91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:47.202198 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Flow 'volume_create_manager' (efcc74cd-8d5b-44c8-93b2-00e5004ddf00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:47.215400 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-647adb9c-29f0-40bc-9aed-10e12ec107b7 tempest-VolumesListTestJSON-1102891740 None] Created volume successfully. Feb 19 21:09:47.236935 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:09:47.237632 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:09:47.242096 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50db5005-8b13-4798-80aa-a81e5f9699e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9b285e-72d2-4afc-ab5d-5a6e940c5fdd', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:47.247842 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba795a44-10a0-429d-8f24-f6867948cc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:09:47.262251 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Volume volume-5d9b285e-72d2-4afc-ab5d-5a6e940c5fdd (5d9b285e-72d2-4afc-ab5d-5a6e940c5fdd): created successfully Feb 19 21:09:47.271634 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba795a44-10a0-429d-8f24-f6867948cc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:09:47.281105 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Flow 'volume_create_manager' (33bd7bcd-9d03-4b9d-b256-b88c29f29042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:09:47.296011 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-2e8c46fb-e85d-454c-bfde-4a228d8b3335 tempest-VolumeTypesTest-171373637 None] Created volume successfully. Feb 19 21:09:48.392963 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a705703e-3e54-4ad3-9e07-7280e741bc30 tempest-VolumeTypesTest-171373637 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:48.534552 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a705703e-3e54-4ad3-9e07-7280e741bc30 tempest-VolumeTypesTest-171373637 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:48.632469 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-a705703e-3e54-4ad3-9e07-7280e741bc30 tempest-VolumeTypesTest-171373637 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:48.639666 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a705703e-3e54-4ad3-9e07-7280e741bc30 tempest-VolumeTypesTest-171373637 None] Retype volume completed successfully. Feb 19 21:09:49.008868 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-8c6468c3-1a0e-477f-a1ed-2a6ebdf573e0 req-df24b5e8-f9d0-4012-ab4a-a761d851577c tempest-AttachVolumeTestJSON-597381258 None] Terminate volume connection completed successfully. Feb 19 21:09:49.009288 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-8c6468c3-1a0e-477f-a1ed-2a6ebdf573e0 req-df24b5e8-f9d0-4012-ab4a-a761d851577c tempest-AttachVolumeTestJSON-597381258 None] Deleting attachment 8480a9f8-de66-45b8-8608-e2f32c63e29e. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:09:51.221374 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-1d72ab5b-6587-4e98-ba01-ee0de42ca0c2 tempest-VolumeTypesTest-171373637 None] Lock "b'cinder-5d9b285e-72d2-4afc-ab5d-5a6e940c5fdd-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:51.331276 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1d72ab5b-6587-4e98-ba01-ee0de42ca0c2 tempest-VolumeTypesTest-171373637 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:51.457618 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1d72ab5b-6587-4e98-ba01-ee0de42ca0c2 tempest-VolumeTypesTest-171373637 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:09:51.458036 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1d72ab5b-6587-4e98-ba01-ee0de42ca0c2 tempest-VolumeTypesTest-171373637 None] Volume volume-5d9b285e-72d2-4afc-ab5d-5a6e940c5fdd is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:09:51.470358 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1d72ab5b-6587-4e98-ba01-ee0de42ca0c2 tempest-VolumeTypesTest-171373637 None] deleting rbd volume volume-5d9b285e-72d2-4afc-ab5d-5a6e940c5fdd {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:09:52.206376 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-1d72ab5b-6587-4e98-ba01-ee0de42ca0c2 tempest-VolumeTypesTest-171373637 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1536986756 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1536986756, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:09:52.208437 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-1d72ab5b-6587-4e98-ba01-ee0de42ca0c2 tempest-VolumeTypesTest-171373637 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1536986756 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1536986756, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:09:52.245440 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-1d72ab5b-6587-4e98-ba01-ee0de42ca0c2 tempest-VolumeTypesTest-171373637 None] Created reservations ['f0a76f95-4354-484e-b708-a54c7c7d94ea', '208dcdf4-970e-4cf5-b46e-9d9c3a6f948c', '65a353d5-5f17-40bc-9068-05ef8e0bc0c4', '245d0d6c-dccb-4e31-ad59-e8f59100f59d'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:52.355447 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1d72ab5b-6587-4e98-ba01-ee0de42ca0c2 tempest-VolumeTypesTest-171373637 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:52.446077 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1d72ab5b-6587-4e98-ba01-ee0de42ca0c2 tempest-VolumeTypesTest-171373637 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:52.512867 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-1d72ab5b-6587-4e98-ba01-ee0de42ca0c2 tempest-VolumeTypesTest-171373637 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:52.517797 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-1d72ab5b-6587-4e98-ba01-ee0de42ca0c2 tempest-VolumeTypesTest-171373637 None] Deleted volume successfully. Feb 19 21:09:52.537151 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-1d72ab5b-6587-4e98-ba01-ee0de42ca0c2 tempest-VolumeTypesTest-171373637 None] Lock "b'cinder-5d9b285e-72d2-4afc-ab5d-5a6e940c5fdd-delete_volume'" released by "delete_volume" :: held 1.316s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:52.669822 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-6ef5e397-be97-4166-b959-61247e4f0859 tempest-VolumesListTestJSON-1102891740 None] Lock "b'cinder-42a55df3-699a-4b50-8702-5ce93da7fff1-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:52.740695 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6ef5e397-be97-4166-b959-61247e4f0859 tempest-VolumesListTestJSON-1102891740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:52.844465 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6ef5e397-be97-4166-b959-61247e4f0859 tempest-VolumesListTestJSON-1102891740 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:09:52.845166 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6ef5e397-be97-4166-b959-61247e4f0859 tempest-VolumesListTestJSON-1102891740 None] Volume volume-42a55df3-699a-4b50-8702-5ce93da7fff1 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:09:52.870274 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6ef5e397-be97-4166-b959-61247e4f0859 tempest-VolumesListTestJSON-1102891740 None] deleting rbd volume volume-42a55df3-699a-4b50-8702-5ce93da7fff1 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:09:53.722396 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-6ef5e397-be97-4166-b959-61247e4f0859 tempest-VolumesListTestJSON-1102891740 None] Created reservations ['7ac97680-e006-4fe3-b4ac-c59fe4351c16', '9965f61e-04e1-4b0a-8983-0b6ac4400573', '47866126-2817-4c8a-8565-fc7f7345ef70', '54c9a616-ac2d-4a1d-9525-70cdc58625ed'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:53.792389 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6ef5e397-be97-4166-b959-61247e4f0859 tempest-VolumesListTestJSON-1102891740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:53.873306 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6ef5e397-be97-4166-b959-61247e4f0859 tempest-VolumesListTestJSON-1102891740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:53.952040 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-6ef5e397-be97-4166-b959-61247e4f0859 tempest-VolumesListTestJSON-1102891740 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:53.986944 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-6ef5e397-be97-4166-b959-61247e4f0859 tempest-VolumesListTestJSON-1102891740 None] Deleted volume successfully. Feb 19 21:09:54.037051 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-c361a5ba-d1e1-4d04-ab8a-069cd19fde42 tempest-VolumesListTestJSON-1102891740 None] Lock "b'cinder-0262ad70-1541-44e8-a89f-104f380ac013-delete_volume'" acquired by "delete_volume" :: waited 0.046s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:54.074293 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-6ef5e397-be97-4166-b959-61247e4f0859 tempest-VolumesListTestJSON-1102891740 None] Lock "b'cinder-42a55df3-699a-4b50-8702-5ce93da7fff1-delete_volume'" released by "delete_volume" :: held 1.408s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:54.201892 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c361a5ba-d1e1-4d04-ab8a-069cd19fde42 tempest-VolumesListTestJSON-1102891740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:54.308687 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c361a5ba-d1e1-4d04-ab8a-069cd19fde42 tempest-VolumesListTestJSON-1102891740 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:09:54.309227 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c361a5ba-d1e1-4d04-ab8a-069cd19fde42 tempest-VolumesListTestJSON-1102891740 None] Volume volume-0262ad70-1541-44e8-a89f-104f380ac013 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:09:54.347220 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c361a5ba-d1e1-4d04-ab8a-069cd19fde42 tempest-VolumesListTestJSON-1102891740 None] deleting rbd volume volume-0262ad70-1541-44e8-a89f-104f380ac013 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:09:55.196639 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-c361a5ba-d1e1-4d04-ab8a-069cd19fde42 tempest-VolumesListTestJSON-1102891740 None] Created reservations ['005dee21-9737-46b0-92c0-f576f2928b3f', '347d147e-51d5-4c0c-81b7-db8126c7b45c', '0aab3140-c9ad-4db4-94a8-bf547d5856cf', '262d19de-2d72-4147-a525-7b3a5e41588f'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:55.308991 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c361a5ba-d1e1-4d04-ab8a-069cd19fde42 tempest-VolumesListTestJSON-1102891740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:55.388114 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c361a5ba-d1e1-4d04-ab8a-069cd19fde42 tempest-VolumesListTestJSON-1102891740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:55.450010 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-c361a5ba-d1e1-4d04-ab8a-069cd19fde42 tempest-VolumesListTestJSON-1102891740 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:55.458161 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-c361a5ba-d1e1-4d04-ab8a-069cd19fde42 tempest-VolumesListTestJSON-1102891740 None] Deleted volume successfully. Feb 19 21:09:55.479003 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-c361a5ba-d1e1-4d04-ab8a-069cd19fde42 tempest-VolumesListTestJSON-1102891740 None] Lock "b'cinder-0262ad70-1541-44e8-a89f-104f380ac013-delete_volume'" released by "delete_volume" :: held 1.454s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:09:56.300201 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-19c31525-9983-4ea8-a4f3-a8dc3f375f6c tempest-VolumesListTestJSON-1102891740 None] Lock "b'cinder-9da44adb-907a-46cf-b30b-95a1ae5aea77-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:09:56.371197 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19c31525-9983-4ea8-a4f3-a8dc3f375f6c tempest-VolumesListTestJSON-1102891740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:56.459314 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19c31525-9983-4ea8-a4f3-a8dc3f375f6c tempest-VolumesListTestJSON-1102891740 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:09:56.460197 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19c31525-9983-4ea8-a4f3-a8dc3f375f6c tempest-VolumesListTestJSON-1102891740 None] Volume volume-9da44adb-907a-46cf-b30b-95a1ae5aea77 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:09:56.483611 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19c31525-9983-4ea8-a4f3-a8dc3f375f6c tempest-VolumesListTestJSON-1102891740 None] deleting rbd volume volume-9da44adb-907a-46cf-b30b-95a1ae5aea77 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:09:57.110487 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-19c31525-9983-4ea8-a4f3-a8dc3f375f6c tempest-VolumesListTestJSON-1102891740 None] Created reservations ['f2350bae-ddb4-48d9-9d06-b7ec34af7bb0', '71081477-31f5-42c1-ba4e-deb6b948fa7b', '459c5839-e494-4530-a56f-18b26e0831a4', 'ff4788a9-2e2e-476c-9fda-787aac715b9c'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:09:57.206312 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19c31525-9983-4ea8-a4f3-a8dc3f375f6c tempest-VolumesListTestJSON-1102891740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:57.293986 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19c31525-9983-4ea8-a4f3-a8dc3f375f6c tempest-VolumesListTestJSON-1102891740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:09:57.426109 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-19c31525-9983-4ea8-a4f3-a8dc3f375f6c tempest-VolumesListTestJSON-1102891740 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:09:57.438713 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-19c31525-9983-4ea8-a4f3-a8dc3f375f6c tempest-VolumesListTestJSON-1102891740 None] Deleted volume successfully. Feb 19 21:09:57.466563 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-19c31525-9983-4ea8-a4f3-a8dc3f375f6c tempest-VolumesListTestJSON-1102891740 None] Lock "b'cinder-9da44adb-907a-46cf-b30b-95a1ae5aea77-delete_volume'" released by "delete_volume" :: held 1.166s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:10:02.066580 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:10:02.089067 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:10:02.089619 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:10:02.120223 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Flow 'volume_create_manager' (6ceae3e4-ae25-44b3-8d5a-905ae21571d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:10:02.126943 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2e6806-b9f9-4551-957e-42998a230c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:02.141917 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:10:02.163129 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2e6806-b9f9-4551-957e-42998a230c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2027604714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=baf5490b-2ff6-4b8c-b2b2-1275d69f89cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6febf49fb5f409ebd8ed6d9427348de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:10:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:10:02Z,use_quota=True,user_id='aa1513aa7d1542af9143c209717ad117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:02.170376 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2d0766-ddf6-468c-8ea5-32dba4f9145c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:02.175636 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2d0766-ddf6-468c-8ea5-32dba4f9145c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:02.182697 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b82b38-d176-46b0-a507-7a9e8130ac7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:02.188489 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b82b38-d176-46b0-a507-7a9e8130ac7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baf5490b-2ff6-4b8c-b2b2-1275d69f89cf', 'volume_name': 'volume-baf5490b-2ff6-4b8c-b2b2-1275d69f89cf', 'volume_size': 2}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:02.199983 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5d6600-d390-4c01-8463-4d4467e493cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:02.205838 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5d6600-d390-4c01-8463-4d4467e493cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:02.220493 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c9c7ff-a6d6-4748-9f50-d136e9245e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:02.222232 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Volume baf5490b-2ff6-4b8c-b2b2-1275d69f89cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baf5490b-2ff6-4b8c-b2b2-1275d69f89cf', 'volume_size': 2} Feb 19 21:10:02.223087 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] creating volume 'volume-baf5490b-2ff6-4b8c-b2b2-1275d69f89cf' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:10:02.224876 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:02.340503 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:10:02.341424 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:10:02.349445 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c9c7ff-a6d6-4748-9f50-d136e9245e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baf5490b-2ff6-4b8c-b2b2-1275d69f89cf', 'volume_size': 2}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:02.359482 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b464739-f54c-4ac2-8d8e-504b14728948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:02.377655 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Volume volume-baf5490b-2ff6-4b8c-b2b2-1275d69f89cf (baf5490b-2ff6-4b8c-b2b2-1275d69f89cf): created successfully Feb 19 21:10:02.383011 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b464739-f54c-4ac2-8d8e-504b14728948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:02.393392 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Flow 'volume_create_manager' (6ceae3e4-ae25-44b3-8d5a-905ae21571d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:10:02.407231 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-2705eee9-d7c1-4477-a639-e44713604749 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Created volume successfully. Feb 19 21:10:03.282231 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-03ebdc31-f927-4dbe-929f-bf69cf2e76b5 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:04.225597 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-03ebdc31-f927-4dbe-929f-bf69cf2e76b5 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Create snapshot completed successfully Feb 19 21:10:04.508003 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-60434882-2e02-4f23-a552-e2b3ee5d68c3 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Lock "b'cinder-102a80c0-672f-414f-af09-cc4b8dd5774b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:10:04.509606 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-60434882-2e02-4f23-a552-e2b3ee5d68c3 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:05.295194 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-60434882-2e02-4f23-a552-e2b3ee5d68c3 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Created reservations ['61960d10-5655-4517-b305-e03fd503979f', 'e7935238-4f5f-402c-88b2-2c552acadcad', '8eafbc3b-6419-49bc-af72-5466598060a6', 'cc7176fe-aaf8-4e3b-8a3d-e46931c48e3b'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:10:05.342915 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-60434882-2e02-4f23-a552-e2b3ee5d68c3 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Delete snapshot completed successfully. Feb 19 21:10:05.349726 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-60434882-2e02-4f23-a552-e2b3ee5d68c3 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Lock "b'cinder-102a80c0-672f-414f-af09-cc4b8dd5774b-delete_snapshot'" released by "delete_snapshot" :: held 0.842s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:10:05.659354 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-80e4a045-3d6c-446e-95b7-18a3df47fd27 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Lock "b'cinder-baf5490b-2ff6-4b8c-b2b2-1275d69f89cf-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:10:05.736547 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80e4a045-3d6c-446e-95b7-18a3df47fd27 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:05.816793 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80e4a045-3d6c-446e-95b7-18a3df47fd27 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:10:05.817583 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80e4a045-3d6c-446e-95b7-18a3df47fd27 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Volume volume-baf5490b-2ff6-4b8c-b2b2-1275d69f89cf is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:10:05.835258 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80e4a045-3d6c-446e-95b7-18a3df47fd27 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] deleting rbd volume volume-baf5490b-2ff6-4b8c-b2b2-1275d69f89cf {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:10:06.185931 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:10:06.190738 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:10:06.191414 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:10:06.217427 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Flow 'volume_create_manager' (cb74f700-f697-4b1a-bd28-330917fecb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:10:06.225729 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8cc3418-522f-49a8-b910-f4a7d69b1bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:06.233912 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:10:06.259907 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8cc3418-522f-49a8-b910-f4a7d69b1bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1467745890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ab2e608e-c1b2-44e5-a09d-5a19e8943ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff0d215a214460c9416ea760e822a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:10:06Z,use_quota=True,user_id='80f051bbb561496181a42136f6ca2032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:06.275543 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecafb541-8977-4045-aa33-a1e41fb300d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:06.280628 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecafb541-8977-4045-aa33-a1e41fb300d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:06.287430 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abbfb65-1cbb-4bd3-ac80-33c8e066196d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:06.295353 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abbfb65-1cbb-4bd3-ac80-33c8e066196d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab2e608e-c1b2-44e5-a09d-5a19e8943ea9', 'volume_name': 'volume-ab2e608e-c1b2-44e5-a09d-5a19e8943ea9', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:06.302580 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3704f98a-6a72-4df2-95be-e1cfee999964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:06.307379 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3704f98a-6a72-4df2-95be-e1cfee999964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:06.313785 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568ead54-1aed-453b-b3e3-a75483aeaaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:06.315297 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Volume ab2e608e-c1b2-44e5-a09d-5a19e8943ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab2e608e-c1b2-44e5-a09d-5a19e8943ea9', 'volume_size': 1} Feb 19 21:10:06.315884 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] creating volume 'volume-ab2e608e-c1b2-44e5-a09d-5a19e8943ea9' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:10:06.318157 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:06.425292 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-80e4a045-3d6c-446e-95b7-18a3df47fd27 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Created reservations ['a4c71edc-053d-4745-8b95-b8bda8b48825', '0546c278-42f0-444e-b05d-42b43f4fd6db', '81d631bb-08e3-402b-9204-81150684a664', '1ce1e779-1778-47af-b0be-8f76a0d91563'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:10:06.486051 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80e4a045-3d6c-446e-95b7-18a3df47fd27 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:06.557327 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80e4a045-3d6c-446e-95b7-18a3df47fd27 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:06.620812 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-80e4a045-3d6c-446e-95b7-18a3df47fd27 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:10:06.638352 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:10:06.638802 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:10:06.643150 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568ead54-1aed-453b-b3e3-a75483aeaaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab2e608e-c1b2-44e5-a09d-5a19e8943ea9', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:06.649387 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1bc056-d7fe-40f7-a39c-ec0e2b132e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:06.658084 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-80e4a045-3d6c-446e-95b7-18a3df47fd27 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Deleted volume successfully. Feb 19 21:10:06.690509 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-80e4a045-3d6c-446e-95b7-18a3df47fd27 tempest-VolumesSnapshotNegativeTestJSON-1661995276 None] Lock "b'cinder-baf5490b-2ff6-4b8c-b2b2-1275d69f89cf-delete_volume'" released by "delete_volume" :: held 1.031s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:10:06.693112 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Volume volume-ab2e608e-c1b2-44e5-a09d-5a19e8943ea9 (ab2e608e-c1b2-44e5-a09d-5a19e8943ea9): created successfully Feb 19 21:10:06.697595 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1bc056-d7fe-40f7-a39c-ec0e2b132e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:06.704284 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Flow 'volume_create_manager' (cb74f700-f697-4b1a-bd28-330917fecb15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:10:06.718049 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-3ffa9bbf-fa53-48f3-ae81-49cc5ed965f5 req-6ece7d6c-6c25-498a-8837-d831caf20a0c tempest-AttachVolumeShelveTestJSON-322283970 None] No connector for attachment 860a6d1b-22f3-457b-b1ab-a5e2e5422386; skipping storage backend terminate_connection call. {{(pid=129319) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4915}} Feb 19 21:10:06.718460 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-3ffa9bbf-fa53-48f3-ae81-49cc5ed965f5 req-6ece7d6c-6c25-498a-8837-d831caf20a0c tempest-AttachVolumeShelveTestJSON-322283970 None] Deleting attachment 860a6d1b-22f3-457b-b1ab-a5e2e5422386. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:10:06.742704 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a7256d71-5274-43fa-89f1-c7622c3c2c65 tempest-VolumesListAdminTestJSON-455736457 None] Created volume successfully. Feb 19 21:10:07.902971 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:10:07.910431 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:10:07.911009 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:10:07.937811 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Flow 'volume_create_manager' (990e219a-09de-4bee-a2fb-f13166bafd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:10:07.946727 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54d3f90-5f4f-4082-9081-57bc45e9b562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:07.954281 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:10:07.975233 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54d3f90-5f4f-4082-9081-57bc45e9b562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2029754301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9a6e4ccd-631c-4d0a-bac8-f1868228508b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff0d215a214460c9416ea760e822a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:10:08Z,use_quota=True,user_id='80f051bbb561496181a42136f6ca2032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:07.984012 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70fed50-237b-48ee-959b-4bc89de444eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:07.989737 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70fed50-237b-48ee-959b-4bc89de444eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:08.001912 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84581c0-76e9-423c-b442-dc7f521ff70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:08.004991 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84581c0-76e9-423c-b442-dc7f521ff70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a6e4ccd-631c-4d0a-bac8-f1868228508b', 'volume_name': 'volume-9a6e4ccd-631c-4d0a-bac8-f1868228508b', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:08.011254 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbeea70b-691b-4b6c-b9ef-40ae7d0674ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:08.017694 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbeea70b-691b-4b6c-b9ef-40ae7d0674ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:08.023145 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746621e9-dffd-4103-8d58-45cbf090a6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:08.024533 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Volume 9a6e4ccd-631c-4d0a-bac8-f1868228508b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a6e4ccd-631c-4d0a-bac8-f1868228508b', 'volume_size': 1} Feb 19 21:10:08.025097 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] creating volume 'volume-9a6e4ccd-631c-4d0a-bac8-f1868228508b' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:10:08.026257 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:08.234694 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:10:08.235433 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:10:08.242106 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746621e9-dffd-4103-8d58-45cbf090a6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a6e4ccd-631c-4d0a-bac8-f1868228508b', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:08.250987 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1fd405-007f-45f0-a6e1-80e6874b54a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:08.262149 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Volume volume-9a6e4ccd-631c-4d0a-bac8-f1868228508b (9a6e4ccd-631c-4d0a-bac8-f1868228508b): created successfully Feb 19 21:10:08.266416 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1fd405-007f-45f0-a6e1-80e6874b54a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:08.272753 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Flow 'volume_create_manager' (990e219a-09de-4bee-a2fb-f13166bafd20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:10:08.281921 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8a030013-08d3-46d5-ad49-849a78cea6be tempest-VolumesListAdminTestJSON-455736457 None] Created volume successfully. Feb 19 21:10:09.381208 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:10:09.385492 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:10:09.386626 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:10:09.420360 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Flow 'volume_create_manager' (353154fc-6c5c-4bde-8f5c-560b4d71cc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:10:09.429882 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9421e58a-292e-4958-87a2-021fede9febb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:09.442566 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:10:09.467690 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9421e58a-292e-4958-87a2-021fede9febb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1932979053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=37a41cb5-ca9c-4726-a647-ea122db55b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff0d215a214460c9416ea760e822a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:10:09Z,use_quota=True,user_id='80f051bbb561496181a42136f6ca2032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:09.474069 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fd5082-e67e-4dc7-940e-4a5593aefe93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:09.478920 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fd5082-e67e-4dc7-940e-4a5593aefe93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:09.494251 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96140020-73bd-4c6a-a192-805568af9b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:09.500395 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96140020-73bd-4c6a-a192-805568af9b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a41cb5-ca9c-4726-a647-ea122db55b0a', 'volume_name': 'volume-37a41cb5-ca9c-4726-a647-ea122db55b0a', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:09.507577 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdb6e47-cd21-4cb9-a441-a4a8dee1a3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:09.512231 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdb6e47-cd21-4cb9-a441-a4a8dee1a3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:09.518650 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0648ba-fd2d-4af6-9a8b-65eb4ae7065d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:09.520808 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Volume 37a41cb5-ca9c-4726-a647-ea122db55b0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a41cb5-ca9c-4726-a647-ea122db55b0a', 'volume_size': 1} Feb 19 21:10:09.521750 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] creating volume 'volume-37a41cb5-ca9c-4726-a647-ea122db55b0a' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:10:09.523182 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:09.643868 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:10:09.645780 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:10:09.651629 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0648ba-fd2d-4af6-9a8b-65eb4ae7065d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a41cb5-ca9c-4726-a647-ea122db55b0a', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:09.665828 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f976a835-fd37-4806-a14d-7fbb8728b100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:09.693635 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Volume volume-37a41cb5-ca9c-4726-a647-ea122db55b0a (37a41cb5-ca9c-4726-a647-ea122db55b0a): created successfully Feb 19 21:10:09.696952 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f976a835-fd37-4806-a14d-7fbb8728b100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:09.711046 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Flow 'volume_create_manager' (353154fc-6c5c-4bde-8f5c-560b4d71cc63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:10:09.722448 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-281a38eb-81a9-4fde-b149-64cf5a9bb7c0 tempest-VolumesListAdminTestJSON-455736457 None] Created volume successfully. Feb 19 21:10:11.765042 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:10:11.774438 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:10:11.775291 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:10:11.800600 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Flow 'volume_create_manager' (92e41e32-b463-4eb7-8680-60e4132e4150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:10:11.808725 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3221193d-2276-48f0-ab77-e4c5420c11b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:11.818325 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:10:11.852012 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3221193d-2276-48f0-ab77-e4c5420c11b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ebff2c41-d689-4c41-bc95-3078f4f1e6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c2481a0ee54734ab42231ae9ec6ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:10:12Z,use_quota=True,user_id='041dd96820174f1c9bfa020cef480c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:11.866864 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eaac12f-ba06-4806-bd3a-ecc4f94db676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:11.877976 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eaac12f-ba06-4806-bd3a-ecc4f94db676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:11.887839 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff76b45-7606-4529-bed6-163368930106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:11.928180 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff76b45-7606-4529-bed6-163368930106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebff2c41-d689-4c41-bc95-3078f4f1e6cf', 'volume_name': 'volume-ebff2c41-d689-4c41-bc95-3078f4f1e6cf', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:11.943708 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8be27c-9dd6-48ed-9bbb-da5e736742a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:11.951534 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8be27c-9dd6-48ed-9bbb-da5e736742a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:11.958455 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f24947f-e465-4ef2-a245-281dd70d3659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:11.960843 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Volume ebff2c41-d689-4c41-bc95-3078f4f1e6cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebff2c41-d689-4c41-bc95-3078f4f1e6cf', 'volume_size': 1} Feb 19 21:10:11.961533 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] creating volume 'volume-ebff2c41-d689-4c41-bc95-3078f4f1e6cf' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:10:11.963147 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:12.114853 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:10:12.115843 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:10:12.124274 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f24947f-e465-4ef2-a245-281dd70d3659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebff2c41-d689-4c41-bc95-3078f4f1e6cf', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:12.134050 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b41b9e-c199-41f6-a9f1-d783da6d3fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:12.152564 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Volume volume-ebff2c41-d689-4c41-bc95-3078f4f1e6cf (ebff2c41-d689-4c41-bc95-3078f4f1e6cf): created successfully Feb 19 21:10:12.161550 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b41b9e-c199-41f6-a9f1-d783da6d3fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:12.168911 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Flow 'volume_create_manager' (92e41e32-b463-4eb7-8680-60e4132e4150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:10:12.180744 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-cb39b029-f3c7-43d6-8f2e-28b97e95efd5 tempest-VolumesListAdminTestJSON-1814241723 None] Created volume successfully. Feb 19 21:10:12.959639 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-7424cbcf-3873-452c-8070-23b3a091d8c3 tempest-VolumesListAdminTestJSON-1814241723 None] Lock "b'cinder-ebff2c41-d689-4c41-bc95-3078f4f1e6cf-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:10:13.038176 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7424cbcf-3873-452c-8070-23b3a091d8c3 tempest-VolumesListAdminTestJSON-1814241723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:13.161702 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7424cbcf-3873-452c-8070-23b3a091d8c3 tempest-VolumesListAdminTestJSON-1814241723 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:10:13.162735 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7424cbcf-3873-452c-8070-23b3a091d8c3 tempest-VolumesListAdminTestJSON-1814241723 None] Volume volume-ebff2c41-d689-4c41-bc95-3078f4f1e6cf is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:10:13.177324 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7424cbcf-3873-452c-8070-23b3a091d8c3 tempest-VolumesListAdminTestJSON-1814241723 None] deleting rbd volume volume-ebff2c41-d689-4c41-bc95-3078f4f1e6cf {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:10:13.236906 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-ce772df2-35f5-4c94-8d3d-011ea8a44fa7 tempest-VolumesListAdminTestJSON-455736457 None] Lock "b'cinder-37a41cb5-ca9c-4726-a647-ea122db55b0a-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:10:13.374759 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ce772df2-35f5-4c94-8d3d-011ea8a44fa7 tempest-VolumesListAdminTestJSON-455736457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:13.495120 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ce772df2-35f5-4c94-8d3d-011ea8a44fa7 tempest-VolumesListAdminTestJSON-455736457 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:10:13.495858 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ce772df2-35f5-4c94-8d3d-011ea8a44fa7 tempest-VolumesListAdminTestJSON-455736457 None] Volume volume-37a41cb5-ca9c-4726-a647-ea122db55b0a is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:10:13.513665 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ce772df2-35f5-4c94-8d3d-011ea8a44fa7 tempest-VolumesListAdminTestJSON-455736457 None] deleting rbd volume volume-37a41cb5-ca9c-4726-a647-ea122db55b0a {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:10:13.856136 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-7424cbcf-3873-452c-8070-23b3a091d8c3 tempest-VolumesListAdminTestJSON-1814241723 None] Created reservations ['d11d24f2-7b1b-41b2-aa85-a23a59b7df81', '669f30cc-ed1d-4d8b-8a44-65de04d08d6a', '7ff6e880-598f-4d5b-8751-bee7f4bb56cf', 'be79d895-783f-40be-aba1-729f8c1a3e43'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:10:13.959350 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7424cbcf-3873-452c-8070-23b3a091d8c3 tempest-VolumesListAdminTestJSON-1814241723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:14.031694 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7424cbcf-3873-452c-8070-23b3a091d8c3 tempest-VolumesListAdminTestJSON-1814241723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:14.123393 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-7424cbcf-3873-452c-8070-23b3a091d8c3 tempest-VolumesListAdminTestJSON-1814241723 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:10:14.132523 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-7424cbcf-3873-452c-8070-23b3a091d8c3 tempest-VolumesListAdminTestJSON-1814241723 None] Deleted volume successfully. Feb 19 21:10:14.226277 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-7424cbcf-3873-452c-8070-23b3a091d8c3 tempest-VolumesListAdminTestJSON-1814241723 None] Lock "b'cinder-ebff2c41-d689-4c41-bc95-3078f4f1e6cf-delete_volume'" released by "delete_volume" :: held 1.266s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:10:14.244957 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-ce772df2-35f5-4c94-8d3d-011ea8a44fa7 tempest-VolumesListAdminTestJSON-455736457 None] Created reservations ['de672cdc-600a-4393-a3d0-24ca6e960c09', '9ac46290-25f2-40c3-b293-f78e3be09ee4', '9a75cb99-de55-44dc-a801-f8699c7c0fe8', '8a46cd05-5071-433c-92c5-5ed008e5a5e2'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:10:14.372767 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ce772df2-35f5-4c94-8d3d-011ea8a44fa7 tempest-VolumesListAdminTestJSON-455736457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:14.467543 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ce772df2-35f5-4c94-8d3d-011ea8a44fa7 tempest-VolumesListAdminTestJSON-455736457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:14.553113 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-ce772df2-35f5-4c94-8d3d-011ea8a44fa7 tempest-VolumesListAdminTestJSON-455736457 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:10:14.563307 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ce772df2-35f5-4c94-8d3d-011ea8a44fa7 tempest-VolumesListAdminTestJSON-455736457 None] Deleted volume successfully. Feb 19 21:10:14.593466 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-b2af3805-b907-4761-babe-95b9ffe74433 tempest-VolumesListAdminTestJSON-455736457 None] Lock "b'cinder-9a6e4ccd-631c-4d0a-bac8-f1868228508b-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:10:14.619421 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-ce772df2-35f5-4c94-8d3d-011ea8a44fa7 tempest-VolumesListAdminTestJSON-455736457 None] Lock "b'cinder-37a41cb5-ca9c-4726-a647-ea122db55b0a-delete_volume'" released by "delete_volume" :: held 1.386s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:10:14.685783 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b2af3805-b907-4761-babe-95b9ffe74433 tempest-VolumesListAdminTestJSON-455736457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:14.777359 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b2af3805-b907-4761-babe-95b9ffe74433 tempest-VolumesListAdminTestJSON-455736457 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:10:14.777792 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b2af3805-b907-4761-babe-95b9ffe74433 tempest-VolumesListAdminTestJSON-455736457 None] Volume volume-9a6e4ccd-631c-4d0a-bac8-f1868228508b is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:10:14.803797 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b2af3805-b907-4761-babe-95b9ffe74433 tempest-VolumesListAdminTestJSON-455736457 None] deleting rbd volume volume-9a6e4ccd-631c-4d0a-bac8-f1868228508b {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:10:15.323228 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-b2af3805-b907-4761-babe-95b9ffe74433 tempest-VolumesListAdminTestJSON-455736457 None] Created reservations ['fe62f9e4-1669-46a4-bf25-e76bfaa8a3c9', '28d8ff32-fbc1-4a56-a007-bde7f7f1fa9a', 'a97ad63f-c834-4548-84b6-5a538b20be33', 'de2aa541-bb40-4197-8797-d902a755227d'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:10:15.460653 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b2af3805-b907-4761-babe-95b9ffe74433 tempest-VolumesListAdminTestJSON-455736457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:15.512583 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b2af3805-b907-4761-babe-95b9ffe74433 tempest-VolumesListAdminTestJSON-455736457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:15.616403 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-b2af3805-b907-4761-babe-95b9ffe74433 tempest-VolumesListAdminTestJSON-455736457 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:10:15.627644 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b2af3805-b907-4761-babe-95b9ffe74433 tempest-VolumesListAdminTestJSON-455736457 None] Deleted volume successfully. Feb 19 21:10:15.651543 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-b2af3805-b907-4761-babe-95b9ffe74433 tempest-VolumesListAdminTestJSON-455736457 None] Lock "b'cinder-9a6e4ccd-631c-4d0a-bac8-f1868228508b-delete_volume'" released by "delete_volume" :: held 1.058s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:10:15.743163 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-19943b42-c627-4b21-a764-a4f7c33fca71 tempest-VolumesListAdminTestJSON-455736457 None] Lock "b'cinder-ab2e608e-c1b2-44e5-a09d-5a19e8943ea9-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:10:15.840575 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19943b42-c627-4b21-a764-a4f7c33fca71 tempest-VolumesListAdminTestJSON-455736457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:15.943613 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19943b42-c627-4b21-a764-a4f7c33fca71 tempest-VolumesListAdminTestJSON-455736457 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:10:15.944589 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19943b42-c627-4b21-a764-a4f7c33fca71 tempest-VolumesListAdminTestJSON-455736457 None] Volume volume-ab2e608e-c1b2-44e5-a09d-5a19e8943ea9 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:10:15.953383 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19943b42-c627-4b21-a764-a4f7c33fca71 tempest-VolumesListAdminTestJSON-455736457 None] deleting rbd volume volume-ab2e608e-c1b2-44e5-a09d-5a19e8943ea9 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:10:16.532500 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-19943b42-c627-4b21-a764-a4f7c33fca71 tempest-VolumesListAdminTestJSON-455736457 None] Created reservations ['a2039fe8-2807-415f-af79-1df10f81104e', 'f7ba0a8f-8017-41d7-93c4-5f28b7d7f1ff', 'f7342d50-e6e8-4402-a6ab-c85cf7997547', '1844b641-96f3-48bc-b0b6-5a8b4f561bd3'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:10:16.664569 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19943b42-c627-4b21-a764-a4f7c33fca71 tempest-VolumesListAdminTestJSON-455736457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:16.780549 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-19943b42-c627-4b21-a764-a4f7c33fca71 tempest-VolumesListAdminTestJSON-455736457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:16.894344 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-19943b42-c627-4b21-a764-a4f7c33fca71 tempest-VolumesListAdminTestJSON-455736457 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:10:16.900694 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-19943b42-c627-4b21-a764-a4f7c33fca71 tempest-VolumesListAdminTestJSON-455736457 None] Deleted volume successfully. Feb 19 21:10:16.934692 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-19943b42-c627-4b21-a764-a4f7c33fca71 tempest-VolumesListAdminTestJSON-455736457 None] Lock "b'cinder-ab2e608e-c1b2-44e5-a09d-5a19e8943ea9-delete_volume'" released by "delete_volume" :: held 1.192s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:10:22.184724 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:10:22.188899 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:22.283972 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:22.356986 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:10:28.531431 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:10:28.547060 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:10:28.547554 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:10:28.592547 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Flow 'volume_create_manager' (79aa58bc-a5ae-48d8-b7dc-606ba7013110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:10:28.620723 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec942d1-52a6-46c7-a1d2-997eb1c6d9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:28.636387 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:10:28.685258 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec942d1-52a6-46c7-a1d2-997eb1c6d9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-164250631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fa915c15-1972-44ba-8e9f-ed2bfea67417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8784470ae96b46a79c5b058ffb1173c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:10:28Z,use_quota=True,user_id='d29d77f86ecd490da83816708092ff71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:28.701750 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89394fe0-4e51-470a-9f2b-a1e5c7b49d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:28.716927 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89394fe0-4e51-470a-9f2b-a1e5c7b49d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:28.740541 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3593b50b-ef9e-4c10-85c7-8a67dabd4528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:28.755233 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3593b50b-ef9e-4c10-85c7-8a67dabd4528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa915c15-1972-44ba-8e9f-ed2bfea67417', 'volume_name': 'volume-fa915c15-1972-44ba-8e9f-ed2bfea67417', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:28.764872 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40910fba-8044-47d3-8475-2ca2053bc512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:28.769417 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40910fba-8044-47d3-8475-2ca2053bc512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:28.802239 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156fc7f0-88b3-4e16-a1c7-d227b1f9da07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:28.813363 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Volume fa915c15-1972-44ba-8e9f-ed2bfea67417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa915c15-1972-44ba-8e9f-ed2bfea67417', 'volume_size': 1} Feb 19 21:10:28.813992 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] creating volume 'volume-fa915c15-1972-44ba-8e9f-ed2bfea67417' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:10:28.815853 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:28.980068 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:10:28.981060 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:10:28.988440 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156fc7f0-88b3-4e16-a1c7-d227b1f9da07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa915c15-1972-44ba-8e9f-ed2bfea67417', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:29.002534 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19899b66-ab5b-46f1-8872-574faaa3336f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:29.026937 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Volume volume-fa915c15-1972-44ba-8e9f-ed2bfea67417 (fa915c15-1972-44ba-8e9f-ed2bfea67417): created successfully Feb 19 21:10:29.031338 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19899b66-ab5b-46f1-8872-574faaa3336f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:29.041577 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Flow 'volume_create_manager' (79aa58bc-a5ae-48d8-b7dc-606ba7013110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:10:29.074951 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-84ec0cde-6dca-4674-b76c-0fb0f02063d4 tempest-VolumesMetadataTest-371258953 None] Created volume successfully. Feb 19 21:10:31.094087 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-f8632998-ce2c-483b-8881-67e12c9bfceb tempest-VolumesMetadataTest-371258953 None] Lock "b'cinder-fa915c15-1972-44ba-8e9f-ed2bfea67417-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:10:31.184176 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f8632998-ce2c-483b-8881-67e12c9bfceb tempest-VolumesMetadataTest-371258953 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:31.280352 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f8632998-ce2c-483b-8881-67e12c9bfceb tempest-VolumesMetadataTest-371258953 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:10:31.280812 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f8632998-ce2c-483b-8881-67e12c9bfceb tempest-VolumesMetadataTest-371258953 None] Volume volume-fa915c15-1972-44ba-8e9f-ed2bfea67417 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:10:31.289915 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f8632998-ce2c-483b-8881-67e12c9bfceb tempest-VolumesMetadataTest-371258953 None] deleting rbd volume volume-fa915c15-1972-44ba-8e9f-ed2bfea67417 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:10:31.819917 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-f8632998-ce2c-483b-8881-67e12c9bfceb tempest-VolumesMetadataTest-371258953 None] Created reservations ['146e14d6-4344-4296-bb4c-29b7e87112ae', 'a37d3be9-1edc-4cda-9c0f-b4e1c460ccbb', 'ca9c142f-fc05-4019-90a1-7469fb8780a6', '52069074-e750-40d6-b9f0-56b58da1c08b'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:10:31.987315 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f8632998-ce2c-483b-8881-67e12c9bfceb tempest-VolumesMetadataTest-371258953 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:32.103880 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f8632998-ce2c-483b-8881-67e12c9bfceb tempest-VolumesMetadataTest-371258953 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:32.198596 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-f8632998-ce2c-483b-8881-67e12c9bfceb tempest-VolumesMetadataTest-371258953 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:10:32.204768 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-f8632998-ce2c-483b-8881-67e12c9bfceb tempest-VolumesMetadataTest-371258953 None] Deleted volume successfully. Feb 19 21:10:32.234927 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-f8632998-ce2c-483b-8881-67e12c9bfceb tempest-VolumesMetadataTest-371258953 None] Lock "b'cinder-fa915c15-1972-44ba-8e9f-ed2bfea67417-delete_volume'" released by "delete_volume" :: held 1.141s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:10:35.807468 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:10:35.811280 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:10:35.811715 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:10:35.852779 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Flow 'volume_create_manager' (4441f826-be57-42c2-a7a8-06b175260cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:10:35.856182 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e50339c-dbea-4ad1-af35-0c7f53c96519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:35.865306 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:10:35.890971 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e50339c-dbea-4ad1-af35-0c7f53c96519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1762680694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=46718fc1-de22-4f32-9233-e05f81bf31e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='463a97fa588d4fc2bb01401ca0fcb8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:10:36Z,use_quota=True,user_id='52c7a837477849768d5a90636fddf7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:35.898853 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891f2ee5-3917-4c0d-90ab-563b3937abce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:35.904207 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891f2ee5-3917-4c0d-90ab-563b3937abce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:35.911134 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e5d4fc-c176-41cc-a251-0db07f41299f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:35.917353 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e5d4fc-c176-41cc-a251-0db07f41299f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46718fc1-de22-4f32-9233-e05f81bf31e3', 'volume_name': 'volume-46718fc1-de22-4f32-9233-e05f81bf31e3', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:35.923402 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9659230-6ac8-42dc-886a-72fa96056cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:35.928883 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9659230-6ac8-42dc-886a-72fa96056cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:35.934091 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8dd935-1155-47e7-9ee5-72268d5ba808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:35.935759 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Volume 46718fc1-de22-4f32-9233-e05f81bf31e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46718fc1-de22-4f32-9233-e05f81bf31e3', 'volume_size': 1} Feb 19 21:10:35.936376 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] creating volume 'volume-46718fc1-de22-4f32-9233-e05f81bf31e3' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:10:35.937647 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:36.072068 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:10:36.073728 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:10:36.082349 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8dd935-1155-47e7-9ee5-72268d5ba808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46718fc1-de22-4f32-9233-e05f81bf31e3', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:36.092249 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223e9f77-3d0c-48db-b236-6d0d1d88aa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:10:36.112410 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Volume volume-46718fc1-de22-4f32-9233-e05f81bf31e3 (46718fc1-de22-4f32-9233-e05f81bf31e3): created successfully Feb 19 21:10:36.126257 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223e9f77-3d0c-48db-b236-6d0d1d88aa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:10:36.147185 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Flow 'volume_create_manager' (4441f826-be57-42c2-a7a8-06b175260cf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:10:36.173101 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-02c436ab-e0c6-4d06-a3e7-d0978df3cf34 tempest-VolumesBackupsTest-1229161186 None] Created volume successfully. Feb 19 21:10:41.358867 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-1f680d35-246f-48ba-a42f-d2c7a86182ca tempest-DeleteServersTestJSON-1663057627 None] Lock "b'cinder-dc1352cb-02fb-4212-ba31-55df6ddc6132-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:10:41.438854 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1f680d35-246f-48ba-a42f-d2c7a86182ca tempest-DeleteServersTestJSON-1663057627 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:41.537162 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1f680d35-246f-48ba-a42f-d2c7a86182ca tempest-DeleteServersTestJSON-1663057627 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:10:41.537897 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1f680d35-246f-48ba-a42f-d2c7a86182ca tempest-DeleteServersTestJSON-1663057627 None] Volume volume-dc1352cb-02fb-4212-ba31-55df6ddc6132 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:10:41.553189 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1f680d35-246f-48ba-a42f-d2c7a86182ca tempest-DeleteServersTestJSON-1663057627 None] deleting rbd volume volume-dc1352cb-02fb-4212-ba31-55df6ddc6132 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:10:42.092783 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-1f680d35-246f-48ba-a42f-d2c7a86182ca tempest-DeleteServersTestJSON-1663057627 None] Created reservations ['1ba715fd-484f-467c-b03f-e2d72ba6be45', 'c6b908dc-6ab0-4ea2-80c9-5456d30b1e25', '096d3aa4-b602-4da3-a19a-f1a8509e3a52', '99907293-a8d6-45a0-838a-b9ecf1f9983a'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:10:42.194513 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1f680d35-246f-48ba-a42f-d2c7a86182ca tempest-DeleteServersTestJSON-1663057627 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:42.261442 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1f680d35-246f-48ba-a42f-d2c7a86182ca tempest-DeleteServersTestJSON-1663057627 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:10:42.330892 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-1f680d35-246f-48ba-a42f-d2c7a86182ca tempest-DeleteServersTestJSON-1663057627 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:10:42.349345 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-1f680d35-246f-48ba-a42f-d2c7a86182ca tempest-DeleteServersTestJSON-1663057627 None] Deleted volume successfully. Feb 19 21:10:42.371343 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-1f680d35-246f-48ba-a42f-d2c7a86182ca tempest-DeleteServersTestJSON-1663057627 None] Lock "b'cinder-dc1352cb-02fb-4212-ba31-55df6ddc6132-delete_volume'" released by "delete_volume" :: held 1.012s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:10:57.086773 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-619b420d-862a-4231-a47a-7b68a819defd req-d8121d89-539d-4937-9cc9-8895fe5f77a0 tempest-VolumesBackupsTest-1229161186 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:10:58.264928 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-619b420d-862a-4231-a47a-7b68a819defd req-d8121d89-539d-4937-9cc9-8895fe5f77a0 tempest-VolumesBackupsTest-1229161186 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.178s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:10:58.267964 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-619b420d-862a-4231-a47a-7b68a819defd req-d8121d89-539d-4937-9cc9-8895fe5f77a0 tempest-VolumesBackupsTest-1229161186 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-46718fc1-de22-4f32-9233-e05f81bf31e3', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '46718fc1-de22-4f32-9233-e05f81bf31e3', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:10:58.302275 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-619b420d-862a-4231-a47a-7b68a819defd req-d8121d89-539d-4937-9cc9-8895fe5f77a0 tempest-VolumesBackupsTest-1229161186 None] Connection info returned from driver {'name': 'volumes/volume-46718fc1-de22-4f32-9233-e05f81bf31e3', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '46718fc1-de22-4f32-9233-e05f81bf31e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9962b62e-a022-4488-987b-5f000fa98c1c'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:10:58.363268 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-619b420d-862a-4231-a47a-7b68a819defd req-d8121d89-539d-4937-9cc9-8895fe5f77a0 tempest-VolumesBackupsTest-1229161186 None] attachment_update completed successfully. Feb 19 21:11:00.667552 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b4b9b5ce-1066-45af-9c5c-1a23c9534869 tempest-VolumesBackupsTest-1229161186 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-19T21:11:00Z,data_timestamp=2022-02-19T21:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1501626097',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=d8578643-04d6-4c96-9ae5-e6d15d45c94b,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='463a97fa588d4fc2bb01401ca0fcb8aa',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='52c7a837477849768d5a90636fddf7b4',volume_id=46718fc1-de22-4f32-9233-e05f81bf31e3) Feb 19 21:11:00.669838 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.backup.rpcapi [None req-b4b9b5ce-1066-45af-9c5c-1a23c9534869 tempest-VolumesBackupsTest-1229161186 None] continue_backup in rpcapi backup_id d8578643-04d6-4c96-9ae5-e6d15d45c94b {{(pid=129319) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 19 21:11:00.957888 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-b4b9b5ce-1066-45af-9c5c-1a23c9534869 tempest-VolumesBackupsTest-1229161186 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:11:01.919973 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-b4b9b5ce-1066-45af-9c5c-1a23c9534869 tempest-VolumesBackupsTest-1229161186 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.962s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:11:01.921907 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b4b9b5ce-1066-45af-9c5c-1a23c9534869 tempest-VolumesBackupsTest-1229161186 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-46718fc1-de22-4f32-9233-e05f81bf31e3', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '46718fc1-de22-4f32-9233-e05f81bf31e3', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:11:01.946470 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b4b9b5ce-1066-45af-9c5c-1a23c9534869 tempest-VolumesBackupsTest-1229161186 None] Initialize volume connection completed successfully. Feb 19 21:11:04.163654 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b4b9b5ce-1066-45af-9c5c-1a23c9534869 tempest-VolumesBackupsTest-1229161186 None] Terminate volume connection completed successfully. Feb 19 21:11:04.187349 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b4b9b5ce-1066-45af-9c5c-1a23c9534869 tempest-VolumesBackupsTest-1229161186 None] Remove volume export completed successfully. Feb 19 21:11:08.433906 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-4ab344bb-fe64-438e-b52c-7368b3978d80 req-87d73d33-48d8-4d28-aef7-f1d03afa9726 tempest-VolumesBackupsTest-1229161186 None] Terminate volume connection completed successfully. Feb 19 21:11:08.434555 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-4ab344bb-fe64-438e-b52c-7368b3978d80 req-87d73d33-48d8-4d28-aef7-f1d03afa9726 tempest-VolumesBackupsTest-1229161186 None] Deleting attachment 9962b62e-a022-4488-987b-5f000fa98c1c. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:11:14.870663 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-9003fe57-c0a6-4890-aa61-cbd708ba4186 tempest-VolumesBackupsTest-1229161186 None] Lock "b'cinder-46718fc1-de22-4f32-9233-e05f81bf31e3-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:11:14.922280 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9003fe57-c0a6-4890-aa61-cbd708ba4186 tempest-VolumesBackupsTest-1229161186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:15.157705 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9003fe57-c0a6-4890-aa61-cbd708ba4186 tempest-VolumesBackupsTest-1229161186 None] Volume volume-46718fc1-de22-4f32-9233-e05f81bf31e3 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:11:15.180163 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9003fe57-c0a6-4890-aa61-cbd708ba4186 tempest-VolumesBackupsTest-1229161186 None] deleting rbd volume volume-46718fc1-de22-4f32-9233-e05f81bf31e3 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:11:15.619688 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-9003fe57-c0a6-4890-aa61-cbd708ba4186 tempest-VolumesBackupsTest-1229161186 None] Created reservations ['9c5f3b28-9d09-48ad-a7ab-183fc3b257f2', 'a4d1dfcf-b417-48eb-ad93-41d7dd562f40', '411d48d9-d1c0-46d1-9df4-b8fb91b80dae', '0e5b2f06-163e-452c-ac72-ec0dc0887cab'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:11:15.675360 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9003fe57-c0a6-4890-aa61-cbd708ba4186 tempest-VolumesBackupsTest-1229161186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:15.742625 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9003fe57-c0a6-4890-aa61-cbd708ba4186 tempest-VolumesBackupsTest-1229161186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:15.827955 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-9003fe57-c0a6-4890-aa61-cbd708ba4186 tempest-VolumesBackupsTest-1229161186 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:11:15.834692 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-9003fe57-c0a6-4890-aa61-cbd708ba4186 tempest-VolumesBackupsTest-1229161186 None] Deleted volume successfully. Feb 19 21:11:15.860229 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-9003fe57-c0a6-4890-aa61-cbd708ba4186 tempest-VolumesBackupsTest-1229161186 None] Lock "b'cinder-46718fc1-de22-4f32-9233-e05f81bf31e3-delete_volume'" released by "delete_volume" :: held 0.990s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:11:16.982628 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:11:17.005565 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:11:17.006947 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:11:17.042459 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Flow 'volume_create_manager' (e5ecd8b3-51c3-47ed-894c-74afb5934a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:11:17.050783 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed10479d-05d8-4b16-9d74-19cf6b1640ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:17.059652 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:11:17.082165 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed10479d-05d8-4b16-9d74-19cf6b1640ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1799630322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=da39e370-fdb6-4ef1-a986-ad5655c11ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='463a97fa588d4fc2bb01401ca0fcb8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:11:17Z,use_quota=True,user_id='52c7a837477849768d5a90636fddf7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:17.091393 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2724a32e-f0aa-4630-8017-d3c2c9e1fd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:17.096677 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2724a32e-f0aa-4630-8017-d3c2c9e1fd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:17.106745 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f4a4c2-6b7f-41c0-91cd-8a997b0a7c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:17.239440 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f4a4c2-6b7f-41c0-91cd-8a997b0a7c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da39e370-fdb6-4ef1-a986-ad5655c11ff7', 'volume_name': 'volume-da39e370-fdb6-4ef1-a986-ad5655c11ff7', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:17.251958 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc24387-0f62-4f1a-a327-03e1aeb648df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:17.257405 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc24387-0f62-4f1a-a327-03e1aeb648df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:17.263061 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab67aa0-75a0-46ab-ab88-faa1e8d83b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:17.264991 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Volume da39e370-fdb6-4ef1-a986-ad5655c11ff7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da39e370-fdb6-4ef1-a986-ad5655c11ff7', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 21:11:17.265640 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Cloning da39e370-fdb6-4ef1-a986-ad5655c11ff7 from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 21:11:17.280121 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:11:17.303856 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 11, 17, 287975)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:11:17.304542 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:11:17.305008 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Found cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 19 21:11:17.312028 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 0.032s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:11:17.313395 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 21:11:17.327905 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 11, 17, 321985)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:11:17.328384 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:11:17.328822 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Creating from source image-volume d609c16c-1e31-4237-8163-d85a8fcc768b {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 19 21:11:17.369042 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:17.508111 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] creating snapshot='volume-da39e370-fdb6-4ef1-a986-ad5655c11ff7.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:11:18.285292 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] cloning 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b@volume-da39e370-fdb6-4ef1-a986-ad5655c11ff7.clone_snap' to 'volume-da39e370-fdb6-4ef1-a986-ad5655c11ff7' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:11:18.548421 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71.deleted is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:11:18.549593 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:11:18.550020 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:11:18.590911 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:11:18.592104 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Marking volume da39e370-fdb6-4ef1-a986-ad5655c11ff7 as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:11:18.604293 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to da39e370-fdb6-4ef1-a986-ad5655c11ff7. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 21:11:18.605080 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Creating volume glance metadata for volume da39e370-fdb6-4ef1-a986-ad5655c11ff7 backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 21:11:18.677150 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab67aa0-75a0-46ab-ab88-faa1e8d83b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da39e370-fdb6-4ef1-a986-ad5655c11ff7', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:18.683035 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b40c278-2d69-440f-a692-36b42e609c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:18.693920 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Volume volume-da39e370-fdb6-4ef1-a986-ad5655c11ff7 (da39e370-fdb6-4ef1-a986-ad5655c11ff7): created successfully Feb 19 21:11:18.702519 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b40c278-2d69-440f-a692-36b42e609c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:18.710359 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Flow 'volume_create_manager' (e5ecd8b3-51c3-47ed-894c-74afb5934a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:11:18.722684 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-14e30b7e-fe60-4a1e-a46f-7738fdc79b3c tempest-VolumesBackupsTest-1229161186 None] Created volume successfully. Feb 19 21:11:19.160017 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-945b2e74-fec9-4be3-8415-529ca9147cc3 tempest-VolumesBackupsTest-1229161186 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-19T21:11:19Z,data_timestamp=2022-02-19T21:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-2104697020',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=67ef1e43-c3f0-4ae3-9684-383d535bc6fa,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='463a97fa588d4fc2bb01401ca0fcb8aa',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='52c7a837477849768d5a90636fddf7b4',volume_id=da39e370-fdb6-4ef1-a986-ad5655c11ff7) Feb 19 21:11:19.161015 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.backup.rpcapi [None req-945b2e74-fec9-4be3-8415-529ca9147cc3 tempest-VolumesBackupsTest-1229161186 None] continue_backup in rpcapi backup_id 67ef1e43-c3f0-4ae3-9684-383d535bc6fa {{(pid=129319) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 19 21:11:19.369478 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-945b2e74-fec9-4be3-8415-529ca9147cc3 tempest-VolumesBackupsTest-1229161186 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:11:20.357634 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-945b2e74-fec9-4be3-8415-529ca9147cc3 tempest-VolumesBackupsTest-1229161186 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.985s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:11:20.364173 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-945b2e74-fec9-4be3-8415-529ca9147cc3 tempest-VolumesBackupsTest-1229161186 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-da39e370-fdb6-4ef1-a986-ad5655c11ff7', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'da39e370-fdb6-4ef1-a986-ad5655c11ff7', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:11:20.388407 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-945b2e74-fec9-4be3-8415-529ca9147cc3 tempest-VolumesBackupsTest-1229161186 None] Initialize volume connection completed successfully. Feb 19 21:11:22.184194 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:11:22.187195 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:22.279121 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:22.346658 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:11:27.906523 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-6a15859d-638d-46c0-8f5c-a5bcbd758d50 tempest-AttachVolumeShelveTestJSON-322283970 None] Lock "b'cinder-3be2f43d-88e4-40bc-a3e5-285a7855b8e5-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:11:27.982931 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6a15859d-638d-46c0-8f5c-a5bcbd758d50 tempest-AttachVolumeShelveTestJSON-322283970 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:28.293229 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6a15859d-638d-46c0-8f5c-a5bcbd758d50 tempest-AttachVolumeShelveTestJSON-322283970 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:11:28.293665 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6a15859d-638d-46c0-8f5c-a5bcbd758d50 tempest-AttachVolumeShelveTestJSON-322283970 None] Volume volume-3be2f43d-88e4-40bc-a3e5-285a7855b8e5 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:11:28.329824 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6a15859d-638d-46c0-8f5c-a5bcbd758d50 tempest-AttachVolumeShelveTestJSON-322283970 None] deleting rbd volume volume-3be2f43d-88e4-40bc-a3e5-285a7855b8e5 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:11:30.240091 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-6a15859d-638d-46c0-8f5c-a5bcbd758d50 tempest-AttachVolumeShelveTestJSON-322283970 None] Created reservations ['45ed5442-e93c-458a-9709-d03bb0878270', '89b52743-a230-4b99-9567-36d510e9353a', 'da8a9c7f-cc2f-4683-9b8c-d84e65bec507', '09e4dad0-1d03-4e2f-813d-7fe343ebd3a7'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:11:30.316884 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6a15859d-638d-46c0-8f5c-a5bcbd758d50 tempest-AttachVolumeShelveTestJSON-322283970 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:30.411738 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6a15859d-638d-46c0-8f5c-a5bcbd758d50 tempest-AttachVolumeShelveTestJSON-322283970 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:30.473335 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-6a15859d-638d-46c0-8f5c-a5bcbd758d50 tempest-AttachVolumeShelveTestJSON-322283970 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:11:30.481006 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-6a15859d-638d-46c0-8f5c-a5bcbd758d50 tempest-AttachVolumeShelveTestJSON-322283970 None] Deleted volume successfully. Feb 19 21:11:30.502347 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-6a15859d-638d-46c0-8f5c-a5bcbd758d50 tempest-AttachVolumeShelveTestJSON-322283970 None] Lock "b'cinder-3be2f43d-88e4-40bc-a3e5-285a7855b8e5-delete_volume'" released by "delete_volume" :: held 2.596s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:11:31.366332 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-21ad9092-32df-4c6c-a4d0-03db680e4c0b tempest-AttachVolumeShelveTestJSON-322283970 None] Lock "b'cinder-91b63972-f419-40a4-8d4f-37469baee526-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:11:31.426328 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-21ad9092-32df-4c6c-a4d0-03db680e4c0b tempest-AttachVolumeShelveTestJSON-322283970 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:31.489233 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-21ad9092-32df-4c6c-a4d0-03db680e4c0b tempest-AttachVolumeShelveTestJSON-322283970 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:11:31.490032 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-21ad9092-32df-4c6c-a4d0-03db680e4c0b tempest-AttachVolumeShelveTestJSON-322283970 None] Volume volume-91b63972-f419-40a4-8d4f-37469baee526 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:11:31.498346 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-21ad9092-32df-4c6c-a4d0-03db680e4c0b tempest-AttachVolumeShelveTestJSON-322283970 None] deleting rbd volume volume-91b63972-f419-40a4-8d4f-37469baee526 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:11:31.625084 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-945b2e74-fec9-4be3-8415-529ca9147cc3 tempest-VolumesBackupsTest-1229161186 None] Terminate volume connection completed successfully. Feb 19 21:11:31.666990 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-945b2e74-fec9-4be3-8415-529ca9147cc3 tempest-VolumesBackupsTest-1229161186 None] Remove volume export completed successfully. Feb 19 21:11:32.019245 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-21ad9092-32df-4c6c-a4d0-03db680e4c0b tempest-AttachVolumeShelveTestJSON-322283970 None] Created reservations ['62bb4225-0f47-4ce3-b742-f23c9af399d9', '29f839e8-eaf7-46ac-9703-934598a18689', 'e27684bd-4cff-49f1-9ff6-77b01112a7bc', '4748019f-d6d4-42ab-bb9f-e28836a7f20b'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:11:32.095071 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-21ad9092-32df-4c6c-a4d0-03db680e4c0b tempest-AttachVolumeShelveTestJSON-322283970 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:32.141764 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-21ad9092-32df-4c6c-a4d0-03db680e4c0b tempest-AttachVolumeShelveTestJSON-322283970 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:32.190053 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-21ad9092-32df-4c6c-a4d0-03db680e4c0b tempest-AttachVolumeShelveTestJSON-322283970 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:11:32.198383 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-21ad9092-32df-4c6c-a4d0-03db680e4c0b tempest-AttachVolumeShelveTestJSON-322283970 None] Deleted volume successfully. Feb 19 21:11:32.218686 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-21ad9092-32df-4c6c-a4d0-03db680e4c0b tempest-AttachVolumeShelveTestJSON-322283970 None] Lock "b'cinder-91b63972-f419-40a4-8d4f-37469baee526-delete_volume'" released by "delete_volume" :: held 0.852s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:11:33.340647 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:11:33.349020 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:11:33.350288 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:11:33.384972 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Flow 'volume_create_manager' (46b24323-7693-47f9-ac18-30c574b365e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:11:33.394780 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f672c1e2-4360-4e79-aae7-85bf348ca47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:33.408948 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:11:33.446864 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f672c1e2-4360-4e79-aae7-85bf348ca47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:11:33Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_67ef1e43-c3f0-4ae3-9684-383d535bc6fa',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f4f29f8b-297f-4715-abaa-8ec0acbf7a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='463a97fa588d4fc2bb01401ca0fcb8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:11:33Z,use_quota=True,user_id='52c7a837477849768d5a90636fddf7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:33.465453 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afedc7d-eb83-4deb-8004-7f57506a71aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:33.479211 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afedc7d-eb83-4deb-8004-7f57506a71aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:33.493458 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746eb39e-1cc1-4ba4-8fd4-a0d48530a4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:33.499434 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746eb39e-1cc1-4ba4-8fd4-a0d48530a4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4f29f8b-297f-4715-abaa-8ec0acbf7a27', 'volume_name': 'volume-f4f29f8b-297f-4715-abaa-8ec0acbf7a27', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:33.507936 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2f74e3-7b9c-401c-a939-7d9e091fa05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:33.514622 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2f74e3-7b9c-401c-a939-7d9e091fa05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:33.523511 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e205b3a-6e23-4cdc-87d0-69d7e62632e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:33.525297 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Volume f4f29f8b-297f-4715-abaa-8ec0acbf7a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4f29f8b-297f-4715-abaa-8ec0acbf7a27', 'volume_size': 1} Feb 19 21:11:33.525708 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] creating volume 'volume-f4f29f8b-297f-4715-abaa-8ec0acbf7a27' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:11:33.526763 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:33.649085 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:11:33.649761 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:11:33.654619 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e205b3a-6e23-4cdc-87d0-69d7e62632e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4f29f8b-297f-4715-abaa-8ec0acbf7a27', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:33.661793 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b638f67d-abc6-4b93-ae7f-c0b39267e915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:33.677226 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Volume volume-f4f29f8b-297f-4715-abaa-8ec0acbf7a27 (f4f29f8b-297f-4715-abaa-8ec0acbf7a27): created successfully Feb 19 21:11:33.683450 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b638f67d-abc6-4b93-ae7f-c0b39267e915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:33.691387 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Flow 'volume_create_manager' (46b24323-7693-47f9-ac18-30c574b365e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:11:33.704634 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Created volume successfully. Feb 19 21:11:34.570186 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:11:35.583747 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.013s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:11:35.585715 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f4f29f8b-297f-4715-abaa-8ec0acbf7a27', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'f4f29f8b-297f-4715-abaa-8ec0acbf7a27', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:11:35.611357 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Initialize volume connection completed successfully. Feb 19 21:11:42.454235 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Terminate volume connection completed successfully. Feb 19 21:11:42.479303 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-65900320-2e89-4bbd-9551-e1f64383f2ad tempest-VolumesBackupsTest-1229161186 None] Remove volume export completed successfully. Feb 19 21:11:43.053755 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-b725d082-22ac-4417-8bc4-f48e532b734b tempest-VolumesBackupsTest-1229161186 None] Lock "b'cinder-f4f29f8b-297f-4715-abaa-8ec0acbf7a27-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:11:43.122241 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b725d082-22ac-4417-8bc4-f48e532b734b tempest-VolumesBackupsTest-1229161186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:43.978268 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b725d082-22ac-4417-8bc4-f48e532b734b tempest-VolumesBackupsTest-1229161186 None] Volume volume-f4f29f8b-297f-4715-abaa-8ec0acbf7a27 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:11:44.038506 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b725d082-22ac-4417-8bc4-f48e532b734b tempest-VolumesBackupsTest-1229161186 None] deleting rbd volume volume-f4f29f8b-297f-4715-abaa-8ec0acbf7a27 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:11:44.087372 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:11:44.098697 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:11:44.099525 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:11:44.128775 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Flow 'volume_create_manager' (03df681f-e2cc-454a-a5a4-22575c1fa99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:11:44.138256 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a867ee0-6aca-4e0e-b424-683bea6fd5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:44.146146 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:11:44.212460 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a867ee0-6aca-4e0e-b424-683bea6fd5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1204004317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0f3bd27c-8a13-48ab-a47f-0f43117dfdf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adecc012aca243138d03c189f5623f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:11:44Z,use_quota=True,user_id='7132cae4ebd549d491f5d0dcf83394ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:44.223869 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b888b540-ae42-415d-90b1-88984a4b2d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:44.240591 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b888b540-ae42-415d-90b1-88984a4b2d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:44.254206 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86105de4-374b-49be-a58b-7405bcd2d301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:44.261314 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86105de4-374b-49be-a58b-7405bcd2d301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f3bd27c-8a13-48ab-a47f-0f43117dfdf2', 'volume_name': 'volume-0f3bd27c-8a13-48ab-a47f-0f43117dfdf2', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:44.267456 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b4ef24-81c7-4aec-8e93-cde291001530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:44.277729 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b4ef24-81c7-4aec-8e93-cde291001530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:44.287644 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1710339-7fd6-4314-960f-5cc0d5bd6ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:44.291542 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Volume 0f3bd27c-8a13-48ab-a47f-0f43117dfdf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f3bd27c-8a13-48ab-a47f-0f43117dfdf2', 'volume_size': 1} Feb 19 21:11:44.292190 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] creating volume 'volume-0f3bd27c-8a13-48ab-a47f-0f43117dfdf2' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:11:44.293584 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:44.425001 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:11:44.425752 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:11:44.430762 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1710339-7fd6-4314-960f-5cc0d5bd6ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f3bd27c-8a13-48ab-a47f-0f43117dfdf2', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:44.436906 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf865ce-57b1-4281-9621-5694099afd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:44.460796 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Volume volume-0f3bd27c-8a13-48ab-a47f-0f43117dfdf2 (0f3bd27c-8a13-48ab-a47f-0f43117dfdf2): created successfully Feb 19 21:11:44.465257 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf865ce-57b1-4281-9621-5694099afd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:44.475234 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Flow 'volume_create_manager' (03df681f-e2cc-454a-a5a4-22575c1fa99d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:11:44.512467 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-c5d20879-b354-4847-8418-21a77cc5b4d3 tempest-AttachVolumeTestJSON-597381258 None] Created volume successfully. Feb 19 21:11:45.200026 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-b725d082-22ac-4417-8bc4-f48e532b734b tempest-VolumesBackupsTest-1229161186 None] Created reservations ['553b4837-ba7a-4c21-a0da-6e7fdfe3e6ab', 'a40ff9de-f93c-4f62-a36a-76221ef4f8a4', '43f07f9f-ea7f-4569-8178-3af158730e7c', '5ef1caae-3c5a-460d-8e92-047b27a944e3'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:11:45.366363 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b725d082-22ac-4417-8bc4-f48e532b734b tempest-VolumesBackupsTest-1229161186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:45.463481 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b725d082-22ac-4417-8bc4-f48e532b734b tempest-VolumesBackupsTest-1229161186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:45.543839 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-b725d082-22ac-4417-8bc4-f48e532b734b tempest-VolumesBackupsTest-1229161186 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:11:45.564783 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b725d082-22ac-4417-8bc4-f48e532b734b tempest-VolumesBackupsTest-1229161186 None] Deleted volume successfully. Feb 19 21:11:45.567640 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-518971d3-3dbb-4502-9c6b-82c4181b23e1 req-e6df8de2-0b4d-4449-86f4-41b107734574 tempest-AttachVolumeTestJSON-597381258 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:11:45.617521 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-b725d082-22ac-4417-8bc4-f48e532b734b tempest-VolumesBackupsTest-1229161186 None] Lock "b'cinder-f4f29f8b-297f-4715-abaa-8ec0acbf7a27-delete_volume'" released by "delete_volume" :: held 2.567s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:11:46.538488 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-518971d3-3dbb-4502-9c6b-82c4181b23e1 req-e6df8de2-0b4d-4449-86f4-41b107734574 tempest-AttachVolumeTestJSON-597381258 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.971s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:11:46.541951 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-518971d3-3dbb-4502-9c6b-82c4181b23e1 req-e6df8de2-0b4d-4449-86f4-41b107734574 tempest-AttachVolumeTestJSON-597381258 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0f3bd27c-8a13-48ab-a47f-0f43117dfdf2', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '0f3bd27c-8a13-48ab-a47f-0f43117dfdf2', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:11:46.588386 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-518971d3-3dbb-4502-9c6b-82c4181b23e1 req-e6df8de2-0b4d-4449-86f4-41b107734574 tempest-AttachVolumeTestJSON-597381258 None] Connection info returned from driver {'name': 'volumes/volume-0f3bd27c-8a13-48ab-a47f-0f43117dfdf2', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0f3bd27c-8a13-48ab-a47f-0f43117dfdf2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '63bb2ebc-6f73-4979-b947-6bc43d490a58'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:11:46.676322 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:11:46.680581 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:11:46.681076 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:11:46.710122 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Flow 'volume_create_manager' (a33970b8-0101-4c40-92cc-184d48a824fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:11:46.718500 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce50b3b5-370c-4712-afb5-b6d8d9fcb38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:46.741771 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:11:46.766154 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce50b3b5-370c-4712-afb5-b6d8d9fcb38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-706880872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=33f80f39-1b96-40e4-93f6-176f37f7d917,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='afea26862aa14ee295839accbd0eb214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:11:47Z,use_quota=True,user_id='ce0a2626431d46a893675223ae24885a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:46.774011 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c51be76-4ab3-4493-9bca-bdbb440a7963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:46.782179 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c51be76-4ab3-4493-9bca-bdbb440a7963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:46.788976 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313baea0-5c76-40af-8316-ce8f82fcb3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:46.794652 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313baea0-5c76-40af-8316-ce8f82fcb3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33f80f39-1b96-40e4-93f6-176f37f7d917', 'volume_name': 'volume-33f80f39-1b96-40e4-93f6-176f37f7d917', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:46.801453 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7197d965-bb53-4430-9a44-2426b5cb2cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:46.808678 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7197d965-bb53-4430-9a44-2426b5cb2cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:46.813184 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76da2730-3097-45cd-b7cd-6fe4b452a4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:46.814511 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Volume 33f80f39-1b96-40e4-93f6-176f37f7d917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33f80f39-1b96-40e4-93f6-176f37f7d917', 'volume_size': 1} Feb 19 21:11:46.815270 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] creating volume 'volume-33f80f39-1b96-40e4-93f6-176f37f7d917' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:11:46.817208 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:46.868665 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-518971d3-3dbb-4502-9c6b-82c4181b23e1 req-e6df8de2-0b4d-4449-86f4-41b107734574 tempest-AttachVolumeTestJSON-597381258 None] attachment_update completed successfully. Feb 19 21:11:46.922973 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:11:46.923359 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:11:46.927853 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76da2730-3097-45cd-b7cd-6fe4b452a4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33f80f39-1b96-40e4-93f6-176f37f7d917', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:46.933558 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23427015-b2e8-458d-bb48-fc071b56cbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:46.946231 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Volume volume-33f80f39-1b96-40e4-93f6-176f37f7d917 (33f80f39-1b96-40e4-93f6-176f37f7d917): created successfully Feb 19 21:11:46.951081 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23427015-b2e8-458d-bb48-fc071b56cbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:46.958706 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Flow 'volume_create_manager' (a33970b8-0101-4c40-92cc-184d48a824fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:11:46.971682 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 req-bf8e7205-2601-40f8-9121-13b5f61381fb tempest-VolumesGetTestJSON-1507485463 None] Created volume successfully. Feb 19 21:11:47.766902 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3890a254-3f6e-4c22-be39-b0114c453e32 tempest-VolumesBackupsTest-1229161186 None] Lock "b'cinder-da39e370-fdb6-4ef1-a986-ad5655c11ff7-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:11:47.809819 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3890a254-3f6e-4c22-be39-b0114c453e32 tempest-VolumesBackupsTest-1229161186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:48.067626 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3890a254-3f6e-4c22-be39-b0114c453e32 tempest-VolumesBackupsTest-1229161186 None] deleting rbd volume volume-da39e370-fdb6-4ef1-a986-ad5655c11ff7 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:11:48.097607 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-e5dd18f9-c295-41e5-a859-aa7415c86b2e req-d0cc8b0c-414b-4bf6-92de-8603cedb4616 tempest-VolumesGetTestJSON-1507485463 None] Lock "b'cinder-33f80f39-1b96-40e4-93f6-176f37f7d917-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:11:48.150211 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-e5dd18f9-c295-41e5-a859-aa7415c86b2e req-d0cc8b0c-414b-4bf6-92de-8603cedb4616 tempest-VolumesGetTestJSON-1507485463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:48.220982 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-e5dd18f9-c295-41e5-a859-aa7415c86b2e req-d0cc8b0c-414b-4bf6-92de-8603cedb4616 tempest-VolumesGetTestJSON-1507485463 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:11:48.221583 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-e5dd18f9-c295-41e5-a859-aa7415c86b2e req-d0cc8b0c-414b-4bf6-92de-8603cedb4616 tempest-VolumesGetTestJSON-1507485463 None] Volume volume-33f80f39-1b96-40e4-93f6-176f37f7d917 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:11:48.232283 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-e5dd18f9-c295-41e5-a859-aa7415c86b2e req-d0cc8b0c-414b-4bf6-92de-8603cedb4616 tempest-VolumesGetTestJSON-1507485463 None] deleting rbd volume volume-33f80f39-1b96-40e4-93f6-176f37f7d917 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:11:48.370483 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3890a254-3f6e-4c22-be39-b0114c453e32 tempest-VolumesBackupsTest-1229161186 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:11:48.413771 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3890a254-3f6e-4c22-be39-b0114c453e32 tempest-VolumesBackupsTest-1229161186 None] deleting parent snapshot volume-da39e370-fdb6-4ef1-a986-ad5655c11ff7.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:11:49.231431 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-3890a254-3f6e-4c22-be39-b0114c453e32 tempest-VolumesBackupsTest-1229161186 None] Created reservations ['112cb695-c53c-4a2f-a068-517431533114', 'c3dc3194-8ad5-4f0e-8aad-1e74a7dd70da', 'b4f24987-237b-4ded-b919-12b6be2a2ccd', 'e1d0b0b1-fe06-4f49-ab0d-e2a4c98a20cb'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:11:49.257207 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [req-e5dd18f9-c295-41e5-a859-aa7415c86b2e req-d0cc8b0c-414b-4bf6-92de-8603cedb4616 tempest-VolumesGetTestJSON-1507485463 None] Created reservations ['1d0d835d-769d-4ae9-a02a-17fe7470b34e', 'e5c0a718-c9a2-4bc7-8b1e-5bf5c27f2e21', '161e3da3-3585-4fbe-8d39-bca654d38dc7', '1c3bc3c8-fcd8-45e9-903f-c257d70d41fc'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:11:49.309107 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3890a254-3f6e-4c22-be39-b0114c453e32 tempest-VolumesBackupsTest-1229161186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:49.342702 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3890a254-3f6e-4c22-be39-b0114c453e32 tempest-VolumesBackupsTest-1229161186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:49.410394 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3890a254-3f6e-4c22-be39-b0114c453e32 tempest-VolumesBackupsTest-1229161186 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:11:49.430285 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3890a254-3f6e-4c22-be39-b0114c453e32 tempest-VolumesBackupsTest-1229161186 None] Deleted volume successfully. Feb 19 21:11:49.451230 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:11:49.459248 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:11:49.459663 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:11:49.480444 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Flow 'volume_create_manager' (e66ebaca-e0c8-497a-bc15-839bd083732d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:11:49.487257 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d1c95d-8c87-490e-a180-2b098c4fb215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:49.503950 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3890a254-3f6e-4c22-be39-b0114c453e32 tempest-VolumesBackupsTest-1229161186 None] Lock "b'cinder-da39e370-fdb6-4ef1-a986-ad5655c11ff7-delete_volume'" released by "delete_volume" :: held 1.737s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:11:49.505716 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:11:49.532706 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d1c95d-8c87-490e-a180-2b098c4fb215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1081674899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9cee237d-58ba-4236-9933-9466b75876a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adecc012aca243138d03c189f5623f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:11:49Z,use_quota=True,user_id='7132cae4ebd549d491f5d0dcf83394ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:49.539279 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87ac7c3-ba16-43c2-a89e-73ce4ce7165f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:49.543542 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87ac7c3-ba16-43c2-a89e-73ce4ce7165f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:49.549025 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1af2984-ef5c-4b71-a311-6dedd6dba483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:49.553984 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1af2984-ef5c-4b71-a311-6dedd6dba483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cee237d-58ba-4236-9933-9466b75876a7', 'volume_name': 'volume-9cee237d-58ba-4236-9933-9466b75876a7', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:49.558613 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2477c444-a2b0-4e23-8ec7-da4c642593dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:49.563543 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2477c444-a2b0-4e23-8ec7-da4c642593dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:49.569033 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf271261-8d08-413d-9c5d-ae8b184f9111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:49.570143 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Volume 9cee237d-58ba-4236-9933-9466b75876a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cee237d-58ba-4236-9933-9466b75876a7', 'volume_size': 1} Feb 19 21:11:49.570536 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] creating volume 'volume-9cee237d-58ba-4236-9933-9466b75876a7' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:11:49.571565 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:49.620201 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-e5dd18f9-c295-41e5-a859-aa7415c86b2e req-d0cc8b0c-414b-4bf6-92de-8603cedb4616 tempest-VolumesGetTestJSON-1507485463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:49.671533 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-e5dd18f9-c295-41e5-a859-aa7415c86b2e req-d0cc8b0c-414b-4bf6-92de-8603cedb4616 tempest-VolumesGetTestJSON-1507485463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:11:49.723679 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [req-e5dd18f9-c295-41e5-a859-aa7415c86b2e req-d0cc8b0c-414b-4bf6-92de-8603cedb4616 tempest-VolumesGetTestJSON-1507485463 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:11:49.730246 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:11:49.731130 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:11:49.736647 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf271261-8d08-413d-9c5d-ae8b184f9111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cee237d-58ba-4236-9933-9466b75876a7', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:49.741914 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1035ddd8-78f3-4490-a735-c0111048c6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:11:49.749532 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-e5dd18f9-c295-41e5-a859-aa7415c86b2e req-d0cc8b0c-414b-4bf6-92de-8603cedb4616 tempest-VolumesGetTestJSON-1507485463 None] Deleted volume successfully. Feb 19 21:11:49.760424 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Volume volume-9cee237d-58ba-4236-9933-9466b75876a7 (9cee237d-58ba-4236-9933-9466b75876a7): created successfully Feb 19 21:11:49.764909 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1035ddd8-78f3-4490-a735-c0111048c6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:11:49.771710 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Flow 'volume_create_manager' (e66ebaca-e0c8-497a-bc15-839bd083732d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:11:49.782797 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-e5dd18f9-c295-41e5-a859-aa7415c86b2e req-d0cc8b0c-414b-4bf6-92de-8603cedb4616 tempest-VolumesGetTestJSON-1507485463 None] Lock "b'cinder-33f80f39-1b96-40e4-93f6-176f37f7d917-delete_volume'" released by "delete_volume" :: held 1.685s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:11:49.784840 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-777c9270-fcc6-49e4-bd36-9d6185d53d02 tempest-AttachVolumeTestJSON-597381258 None] Created volume successfully. Feb 19 21:11:51.368455 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-22f32107-77dc-47a3-9ca5-238f82e18807 req-0fb2a568-a33f-43b5-9aca-9af45caa7c93 tempest-AttachVolumeTestJSON-597381258 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:11:52.801412 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-22f32107-77dc-47a3-9ca5-238f82e18807 req-0fb2a568-a33f-43b5-9aca-9af45caa7c93 tempest-AttachVolumeTestJSON-597381258 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.431s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:11:52.802546 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-22f32107-77dc-47a3-9ca5-238f82e18807 req-0fb2a568-a33f-43b5-9aca-9af45caa7c93 tempest-AttachVolumeTestJSON-597381258 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9cee237d-58ba-4236-9933-9466b75876a7', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '9cee237d-58ba-4236-9933-9466b75876a7', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:11:52.841768 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-22f32107-77dc-47a3-9ca5-238f82e18807 req-0fb2a568-a33f-43b5-9aca-9af45caa7c93 tempest-AttachVolumeTestJSON-597381258 None] Connection info returned from driver {'name': 'volumes/volume-9cee237d-58ba-4236-9933-9466b75876a7', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9cee237d-58ba-4236-9933-9466b75876a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f2af1f00-e0aa-4504-960b-962615154c2b'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:11:52.926105 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-22f32107-77dc-47a3-9ca5-238f82e18807 req-0fb2a568-a33f-43b5-9aca-9af45caa7c93 tempest-AttachVolumeTestJSON-597381258 None] attachment_update completed successfully. Feb 19 21:12:22.184421 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:12:22.186446 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:12:22.332394 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:12:22.441429 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:12:39.397154 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-41e466d0-431f-4257-a167-c006fdc0de6b req-6410c3d9-8b87-4634-aa08-3632e74ffc1a tempest-TaggedBootDevicesTest-1240914161 None] Terminate volume connection completed successfully. Feb 19 21:12:39.397912 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-41e466d0-431f-4257-a167-c006fdc0de6b req-6410c3d9-8b87-4634-aa08-3632e74ffc1a tempest-TaggedBootDevicesTest-1240914161 None] Deleting attachment d2871cbc-9edc-4f5d-94ff-4386fbaa55f7. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:12:39.629639 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-41e466d0-431f-4257-a167-c006fdc0de6b req-f5282a41-fb00-4ed6-9254-cadbd7ec8dd1 tempest-TaggedBootDevicesTest-1240914161 None] Terminate volume connection completed successfully. Feb 19 21:12:39.630059 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-41e466d0-431f-4257-a167-c006fdc0de6b req-f5282a41-fb00-4ed6-9254-cadbd7ec8dd1 tempest-TaggedBootDevicesTest-1240914161 None] Deleting attachment 6376ef83-fc84-414f-b6e7-22b2241ab8c6. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:12:39.820540 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-41e466d0-431f-4257-a167-c006fdc0de6b req-f96540d3-5205-47bd-a8b9-d8e635500c2c tempest-TaggedBootDevicesTest-1240914161 None] Terminate volume connection completed successfully. Feb 19 21:12:39.820961 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-41e466d0-431f-4257-a167-c006fdc0de6b req-f96540d3-5205-47bd-a8b9-d8e635500c2c tempest-TaggedBootDevicesTest-1240914161 None] Deleting attachment 0f668150-e1ff-40a4-a5a0-bff25c228a9b. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:12:50.330563 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-41ec491b-f3ec-4400-8162-ee3428839c1c tempest-TaggedBootDevicesTest-1240914161 None] Lock "b'cinder-fd491209-be3e-4e2f-b5ae-a327e5f6dc9b-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:12:50.395133 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-41ec491b-f3ec-4400-8162-ee3428839c1c tempest-TaggedBootDevicesTest-1240914161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:12:50.483600 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-41ec491b-f3ec-4400-8162-ee3428839c1c tempest-TaggedBootDevicesTest-1240914161 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:12:50.484048 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-41ec491b-f3ec-4400-8162-ee3428839c1c tempest-TaggedBootDevicesTest-1240914161 None] Volume volume-fd491209-be3e-4e2f-b5ae-a327e5f6dc9b is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:12:50.495254 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-41ec491b-f3ec-4400-8162-ee3428839c1c tempest-TaggedBootDevicesTest-1240914161 None] deleting rbd volume volume-fd491209-be3e-4e2f-b5ae-a327e5f6dc9b {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:12:51.104157 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-41ec491b-f3ec-4400-8162-ee3428839c1c tempest-TaggedBootDevicesTest-1240914161 None] Created reservations ['1ef76759-af72-4cc5-9024-d87349c6dc0a', 'ff56f4e6-1f15-41be-a4e9-df1554cd3084', '59ab7e1d-4f1b-4397-a6f5-be0550d194f9', '1bb8e329-6cee-4a9f-8b4d-995043c0b597'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:12:51.241580 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-41ec491b-f3ec-4400-8162-ee3428839c1c tempest-TaggedBootDevicesTest-1240914161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:12:51.305169 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-41ec491b-f3ec-4400-8162-ee3428839c1c tempest-TaggedBootDevicesTest-1240914161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:12:51.395328 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-41ec491b-f3ec-4400-8162-ee3428839c1c tempest-TaggedBootDevicesTest-1240914161 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:12:51.400483 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-41ec491b-f3ec-4400-8162-ee3428839c1c tempest-TaggedBootDevicesTest-1240914161 None] Deleted volume successfully. Feb 19 21:12:51.421317 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-41ec491b-f3ec-4400-8162-ee3428839c1c tempest-TaggedBootDevicesTest-1240914161 None] Lock "b'cinder-fd491209-be3e-4e2f-b5ae-a327e5f6dc9b-delete_volume'" released by "delete_volume" :: held 1.090s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:12:51.677803 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-28aa4cfc-00bf-4d56-a913-7dc1998eaf91 tempest-TaggedBootDevicesTest-1240914161 None] Lock "b'cinder-56aed238-dfe7-4409-a1cc-1d5aee658c06-delete_volume'" acquired by "delete_volume" :: waited 0.040s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:12:51.815003 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-28aa4cfc-00bf-4d56-a913-7dc1998eaf91 tempest-TaggedBootDevicesTest-1240914161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:12:51.940997 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-28aa4cfc-00bf-4d56-a913-7dc1998eaf91 tempest-TaggedBootDevicesTest-1240914161 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:12:51.941851 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-28aa4cfc-00bf-4d56-a913-7dc1998eaf91 tempest-TaggedBootDevicesTest-1240914161 None] Volume volume-56aed238-dfe7-4409-a1cc-1d5aee658c06 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:12:51.958778 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-28aa4cfc-00bf-4d56-a913-7dc1998eaf91 tempest-TaggedBootDevicesTest-1240914161 None] deleting rbd volume volume-56aed238-dfe7-4409-a1cc-1d5aee658c06 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:12:52.675803 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-28aa4cfc-00bf-4d56-a913-7dc1998eaf91 tempest-TaggedBootDevicesTest-1240914161 None] Created reservations ['738b14ce-074e-490f-befc-1d3d98a5f28e', '4e715448-6db2-4040-881e-543e3ef00141', 'fa9605ce-809e-4be7-ae32-37e066137282', '459eb302-085c-4591-bb9f-9ea1e9b299d0'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:12:52.826828 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-28aa4cfc-00bf-4d56-a913-7dc1998eaf91 tempest-TaggedBootDevicesTest-1240914161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:12:52.913678 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-28aa4cfc-00bf-4d56-a913-7dc1998eaf91 tempest-TaggedBootDevicesTest-1240914161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:12:52.993506 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-28aa4cfc-00bf-4d56-a913-7dc1998eaf91 tempest-TaggedBootDevicesTest-1240914161 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:12:53.033238 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-28aa4cfc-00bf-4d56-a913-7dc1998eaf91 tempest-TaggedBootDevicesTest-1240914161 None] Deleted volume successfully. Feb 19 21:12:53.091886 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-2b845c6a-6349-4c7b-a866-6fecec984a5c tempest-TaggedBootDevicesTest-1240914161 None] Lock "b'cinder-3ff6b310-d818-4d76-b66a-68ab83434270-delete_volume'" acquired by "delete_volume" :: waited 0.078s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:12:53.144232 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-28aa4cfc-00bf-4d56-a913-7dc1998eaf91 tempest-TaggedBootDevicesTest-1240914161 None] Lock "b'cinder-56aed238-dfe7-4409-a1cc-1d5aee658c06-delete_volume'" released by "delete_volume" :: held 1.468s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:12:53.196623 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2b845c6a-6349-4c7b-a866-6fecec984a5c tempest-TaggedBootDevicesTest-1240914161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:12:53.357565 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2b845c6a-6349-4c7b-a866-6fecec984a5c tempest-TaggedBootDevicesTest-1240914161 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:12:53.381325 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2b845c6a-6349-4c7b-a866-6fecec984a5c tempest-TaggedBootDevicesTest-1240914161 None] deleting rbd volume volume-3ff6b310-d818-4d76-b66a-68ab83434270 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:12:54.112371 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2b845c6a-6349-4c7b-a866-6fecec984a5c tempest-TaggedBootDevicesTest-1240914161 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:12:54.172593 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2b845c6a-6349-4c7b-a866-6fecec984a5c tempest-TaggedBootDevicesTest-1240914161 None] deleting parent snapshot volume-3ff6b310-d818-4d76-b66a-68ab83434270.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:12:55.348036 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-2b845c6a-6349-4c7b-a866-6fecec984a5c tempest-TaggedBootDevicesTest-1240914161 None] Created reservations ['312a0b5b-359b-4952-b32a-32af74d7ff77', '3bcda165-ae61-4956-9667-cac99c450bc7', 'c846309f-a2a1-4472-9bb9-577cda6ca62f', 'c0387b87-ebf2-43cd-a42e-407ef7abd8c2'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:12:55.471744 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2b845c6a-6349-4c7b-a866-6fecec984a5c tempest-TaggedBootDevicesTest-1240914161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:12:55.538602 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2b845c6a-6349-4c7b-a866-6fecec984a5c tempest-TaggedBootDevicesTest-1240914161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:12:55.584055 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-2b845c6a-6349-4c7b-a866-6fecec984a5c tempest-TaggedBootDevicesTest-1240914161 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:12:55.589900 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-2b845c6a-6349-4c7b-a866-6fecec984a5c tempest-TaggedBootDevicesTest-1240914161 None] Deleted volume successfully. Feb 19 21:12:55.608987 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-2b845c6a-6349-4c7b-a866-6fecec984a5c tempest-TaggedBootDevicesTest-1240914161 None] Lock "b'cinder-3ff6b310-d818-4d76-b66a-68ab83434270-delete_volume'" released by "delete_volume" :: held 2.516s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:12:57.478779 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-72b0c6fe-ad9f-4f2f-a7bf-2a39dc129319 req-e8bd0376-8100-46d4-aca2-545ecc068cb0 tempest-AttachVolumeTestJSON-597381258 None] Terminate volume connection completed successfully. Feb 19 21:12:57.480797 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-72b0c6fe-ad9f-4f2f-a7bf-2a39dc129319 req-e8bd0376-8100-46d4-aca2-545ecc068cb0 tempest-AttachVolumeTestJSON-597381258 None] Deleting attachment 63bb2ebc-6f73-4979-b947-6bc43d490a58. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:12:58.884526 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-fba6f35e-d2e5-49d4-8d53-f12d8b71b604 req-6978c90e-92da-4aa1-9fad-9e2d7d0c5ea2 tempest-AttachVolumeTestJSON-597381258 None] Terminate volume connection completed successfully. Feb 19 21:12:58.885750 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-fba6f35e-d2e5-49d4-8d53-f12d8b71b604 req-6978c90e-92da-4aa1-9fad-9e2d7d0c5ea2 tempest-AttachVolumeTestJSON-597381258 None] Deleting attachment f2af1f00-e0aa-4504-960b-962615154c2b. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:13:11.620182 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a012a541-e427-465f-980a-affa20ab0d15 tempest-AttachVolumeTestJSON-597381258 None] Lock "b'cinder-9cee237d-58ba-4236-9933-9466b75876a7-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:13:11.715010 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a012a541-e427-465f-980a-affa20ab0d15 tempest-AttachVolumeTestJSON-597381258 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:13:11.817105 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a012a541-e427-465f-980a-affa20ab0d15 tempest-AttachVolumeTestJSON-597381258 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:13:11.817698 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a012a541-e427-465f-980a-affa20ab0d15 tempest-AttachVolumeTestJSON-597381258 None] Volume volume-9cee237d-58ba-4236-9933-9466b75876a7 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:13:11.827823 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a012a541-e427-465f-980a-affa20ab0d15 tempest-AttachVolumeTestJSON-597381258 None] deleting rbd volume volume-9cee237d-58ba-4236-9933-9466b75876a7 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:13:12.437632 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-a012a541-e427-465f-980a-affa20ab0d15 tempest-AttachVolumeTestJSON-597381258 None] Created reservations ['066e4d03-0c23-4ac4-9924-ad6fd7a20950', '44ad67e1-cb94-452b-b170-0fcfb23c6272', '7bbf7533-80e9-4f26-bc21-27c7ea4caaed', '5b3b8767-5bfc-4b36-b3f1-1fb0dbf357dc'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:13:12.510271 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a012a541-e427-465f-980a-affa20ab0d15 tempest-AttachVolumeTestJSON-597381258 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:13:12.576690 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a012a541-e427-465f-980a-affa20ab0d15 tempest-AttachVolumeTestJSON-597381258 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:13:12.658083 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-a012a541-e427-465f-980a-affa20ab0d15 tempest-AttachVolumeTestJSON-597381258 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:13:12.662865 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a012a541-e427-465f-980a-affa20ab0d15 tempest-AttachVolumeTestJSON-597381258 None] Deleted volume successfully. Feb 19 21:13:12.708746 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a012a541-e427-465f-980a-affa20ab0d15 tempest-AttachVolumeTestJSON-597381258 None] Lock "b'cinder-9cee237d-58ba-4236-9933-9466b75876a7-delete_volume'" released by "delete_volume" :: held 1.087s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:13:12.859203 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-1e5e59e7-f379-43e5-884a-24658e42f27f tempest-AttachVolumeTestJSON-597381258 None] Lock "b'cinder-0f3bd27c-8a13-48ab-a47f-0f43117dfdf2-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:13:12.929075 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1e5e59e7-f379-43e5-884a-24658e42f27f tempest-AttachVolumeTestJSON-597381258 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:13:13.007308 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1e5e59e7-f379-43e5-884a-24658e42f27f tempest-AttachVolumeTestJSON-597381258 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:13:13.009011 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1e5e59e7-f379-43e5-884a-24658e42f27f tempest-AttachVolumeTestJSON-597381258 None] Volume volume-0f3bd27c-8a13-48ab-a47f-0f43117dfdf2 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:13:13.021332 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1e5e59e7-f379-43e5-884a-24658e42f27f tempest-AttachVolumeTestJSON-597381258 None] deleting rbd volume volume-0f3bd27c-8a13-48ab-a47f-0f43117dfdf2 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:13:13.512160 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-1e5e59e7-f379-43e5-884a-24658e42f27f tempest-AttachVolumeTestJSON-597381258 None] Created reservations ['7615c8b7-3ca1-4a0f-974c-5d4726c8568c', '848f6232-d5f8-4028-99b6-bf4a68aa062b', 'd244c9ba-3bdc-45c2-ae62-2b2ab84a94ae', 'd75f63e0-b860-4261-8e98-72b3bd234bfc'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:13:13.560627 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1e5e59e7-f379-43e5-884a-24658e42f27f tempest-AttachVolumeTestJSON-597381258 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:13:13.616469 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1e5e59e7-f379-43e5-884a-24658e42f27f tempest-AttachVolumeTestJSON-597381258 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:13:13.671966 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-1e5e59e7-f379-43e5-884a-24658e42f27f tempest-AttachVolumeTestJSON-597381258 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:13:13.680089 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-1e5e59e7-f379-43e5-884a-24658e42f27f tempest-AttachVolumeTestJSON-597381258 None] Deleted volume successfully. Feb 19 21:13:13.706325 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-1e5e59e7-f379-43e5-884a-24658e42f27f tempest-AttachVolumeTestJSON-597381258 None] Lock "b'cinder-0f3bd27c-8a13-48ab-a47f-0f43117dfdf2-delete_volume'" released by "delete_volume" :: held 0.845s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:13:14.140827 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-4ffbc7f5-c7f2-4991-9a30-c3dd6023dd26 tempest-AttachVolumeTestJSON-597381258 None] Lock "b'cinder-15fd35a7-de5b-44ee-af9e-26318f1c9422-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:13:14.201485 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4ffbc7f5-c7f2-4991-9a30-c3dd6023dd26 tempest-AttachVolumeTestJSON-597381258 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:13:14.300664 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4ffbc7f5-c7f2-4991-9a30-c3dd6023dd26 tempest-AttachVolumeTestJSON-597381258 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:13:14.300871 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4ffbc7f5-c7f2-4991-9a30-c3dd6023dd26 tempest-AttachVolumeTestJSON-597381258 None] Volume volume-15fd35a7-de5b-44ee-af9e-26318f1c9422 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:13:14.308407 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4ffbc7f5-c7f2-4991-9a30-c3dd6023dd26 tempest-AttachVolumeTestJSON-597381258 None] deleting rbd volume volume-15fd35a7-de5b-44ee-af9e-26318f1c9422 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:13:14.738240 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-4ffbc7f5-c7f2-4991-9a30-c3dd6023dd26 tempest-AttachVolumeTestJSON-597381258 None] Created reservations ['4d56e585-6b53-47e2-8f92-7f094ddba761', '29b4e4c8-896a-402e-949c-7e6930319fae', '0187461d-603a-45c6-a2c6-5e395a4bdf03', '6ca7e8ac-fb2c-471b-84ba-7bc5f61437ea'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:13:14.813214 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4ffbc7f5-c7f2-4991-9a30-c3dd6023dd26 tempest-AttachVolumeTestJSON-597381258 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:13:14.880579 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4ffbc7f5-c7f2-4991-9a30-c3dd6023dd26 tempest-AttachVolumeTestJSON-597381258 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:13:14.947311 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-4ffbc7f5-c7f2-4991-9a30-c3dd6023dd26 tempest-AttachVolumeTestJSON-597381258 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:13:14.951666 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-4ffbc7f5-c7f2-4991-9a30-c3dd6023dd26 tempest-AttachVolumeTestJSON-597381258 None] Deleted volume successfully. Feb 19 21:13:14.967755 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-4ffbc7f5-c7f2-4991-9a30-c3dd6023dd26 tempest-AttachVolumeTestJSON-597381258 None] Lock "b'cinder-15fd35a7-de5b-44ee-af9e-26318f1c9422-delete_volume'" released by "delete_volume" :: held 0.826s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:13:22.181063 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:13:22.183849 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:13:22.227800 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:13:22.296419 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:13:49.428204 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:13:49.434744 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:13:49.435806 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:13:49.472947 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Flow 'volume_create_manager' (a3f4d3f3-6cc6-414e-8f5c-3060837532a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:13:49.486699 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a7cb48-2856-406a-b558-6a2924047262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:13:49.497778 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:13:49.529910 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a7cb48-2856-406a-b558-6a2924047262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-87987692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=986bcdbd-6541-4e97-a01a-c58fbdba9f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7a8678732a40b383cedd20600e102e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:13:49Z,use_quota=True,user_id='5e825e0ef42743238263e6758e53e28c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:13:49.543219 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e7175a-677b-4b83-a172-15f901cb08dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:13:49.549920 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e7175a-677b-4b83-a172-15f901cb08dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:13:49.556220 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da5b15e-2967-4388-97c5-515c8caa53f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:13:49.561948 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da5b15e-2967-4388-97c5-515c8caa53f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '986bcdbd-6541-4e97-a01a-c58fbdba9f3c', 'volume_name': 'volume-986bcdbd-6541-4e97-a01a-c58fbdba9f3c', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:13:49.568198 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2317ec-0419-4d09-b3c1-5ee68993e988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:13:49.572963 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2317ec-0419-4d09-b3c1-5ee68993e988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:13:49.582409 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ec8c15-b34d-4366-beff-2f7132d7b8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:13:49.583839 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Volume 986bcdbd-6541-4e97-a01a-c58fbdba9f3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-986bcdbd-6541-4e97-a01a-c58fbdba9f3c', 'volume_size': 1} Feb 19 21:13:49.584237 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] creating volume 'volume-986bcdbd-6541-4e97-a01a-c58fbdba9f3c' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:13:49.585446 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:13:49.718622 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:13:49.719575 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:13:49.727323 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ec8c15-b34d-4366-beff-2f7132d7b8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-986bcdbd-6541-4e97-a01a-c58fbdba9f3c', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:13:49.764624 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb22680-1aea-4e10-9c06-b94a8c66a184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:13:49.785101 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Volume volume-986bcdbd-6541-4e97-a01a-c58fbdba9f3c (986bcdbd-6541-4e97-a01a-c58fbdba9f3c): created successfully Feb 19 21:13:49.790448 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb22680-1aea-4e10-9c06-b94a8c66a184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:13:49.806303 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Flow 'volume_create_manager' (a3f4d3f3-6cc6-414e-8f5c-3060837532a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:13:49.818493 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-f07fde6b-7f25-4be4-a0da-b497fd52cdee tempest-AttachVolumeNegativeTest-1367384515 None] Created volume successfully. Feb 19 21:13:51.281735 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-2565ac70-cb4c-41f8-acb2-71ebced09170 req-594ff5f9-d1dc-4b6d-b0c3-401862488636 tempest-AttachVolumeNegativeTest-1367384515 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:13:52.400549 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-2565ac70-cb4c-41f8-acb2-71ebced09170 req-594ff5f9-d1dc-4b6d-b0c3-401862488636 tempest-AttachVolumeNegativeTest-1367384515 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.119s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:13:52.401376 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-2565ac70-cb4c-41f8-acb2-71ebced09170 req-594ff5f9-d1dc-4b6d-b0c3-401862488636 tempest-AttachVolumeNegativeTest-1367384515 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-986bcdbd-6541-4e97-a01a-c58fbdba9f3c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '986bcdbd-6541-4e97-a01a-c58fbdba9f3c', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:13:52.478895 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-2565ac70-cb4c-41f8-acb2-71ebced09170 req-594ff5f9-d1dc-4b6d-b0c3-401862488636 tempest-AttachVolumeNegativeTest-1367384515 None] Connection info returned from driver {'name': 'volumes/volume-986bcdbd-6541-4e97-a01a-c58fbdba9f3c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '986bcdbd-6541-4e97-a01a-c58fbdba9f3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5a818744-fce9-4823-bc38-0d697b55cf18'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:13:52.624763 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-2565ac70-cb4c-41f8-acb2-71ebced09170 req-594ff5f9-d1dc-4b6d-b0c3-401862488636 tempest-AttachVolumeNegativeTest-1367384515 None] attachment_update completed successfully. Feb 19 21:14:15.373244 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-9e611b59-e1a6-41c8-9328-39b29db4a072 req-f09c07e9-618d-42e6-b01a-5a71479fac14 tempest-AttachVolumeNegativeTest-1367384515 None] Terminate volume connection completed successfully. Feb 19 21:14:15.373907 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-9e611b59-e1a6-41c8-9328-39b29db4a072 req-f09c07e9-618d-42e6-b01a-5a71479fac14 tempest-AttachVolumeNegativeTest-1367384515 None] Deleting attachment 5a818744-fce9-4823-bc38-0d697b55cf18. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:14:22.183618 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:14:22.186619 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:14:22.244351 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:14:22.307219 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:14:38.557103 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:14:38.561633 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:14:38.562850 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:14:38.586714 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Flow 'volume_create_manager' (700debe9-240d-4b3c-a639-1c2b9bff240c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:14:38.595607 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7509cc-2570-4237-9aea-69e209a30db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:14:38.603807 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:14:38.622681 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7509cc-2570-4237-9aea-69e209a30db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1672258540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=279e111c-6c3e-4e53-a347-c4612e7ecea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7a8678732a40b383cedd20600e102e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:14:39Z,use_quota=True,user_id='5e825e0ef42743238263e6758e53e28c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:14:38.629466 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d08738-17d0-4d01-99f8-a75833448e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:14:38.634560 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d08738-17d0-4d01-99f8-a75833448e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:14:38.640871 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bf700e-0c7a-4e35-90b8-f24ea5668869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:14:38.646781 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bf700e-0c7a-4e35-90b8-f24ea5668869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279e111c-6c3e-4e53-a347-c4612e7ecea6', 'volume_name': 'volume-279e111c-6c3e-4e53-a347-c4612e7ecea6', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:14:38.652840 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72035f24-1d59-45b2-8ee5-1619a53d5f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:14:38.658579 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72035f24-1d59-45b2-8ee5-1619a53d5f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:14:38.664600 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b2f1a9-342f-428c-960d-282b19784a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:14:38.666417 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Volume 279e111c-6c3e-4e53-a347-c4612e7ecea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279e111c-6c3e-4e53-a347-c4612e7ecea6', 'volume_size': 1} Feb 19 21:14:38.667206 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] creating volume 'volume-279e111c-6c3e-4e53-a347-c4612e7ecea6' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:14:38.668663 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:14:38.760309 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:14:38.761308 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:14:38.767188 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b2f1a9-342f-428c-960d-282b19784a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279e111c-6c3e-4e53-a347-c4612e7ecea6', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:14:38.773904 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920ed8ac-3fbf-48e6-9c11-aa27f2e77ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:14:38.784504 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Volume volume-279e111c-6c3e-4e53-a347-c4612e7ecea6 (279e111c-6c3e-4e53-a347-c4612e7ecea6): created successfully Feb 19 21:14:38.790207 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920ed8ac-3fbf-48e6-9c11-aa27f2e77ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:14:38.798173 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Flow 'volume_create_manager' (700debe9-240d-4b3c-a639-1c2b9bff240c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:14:38.810041 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-2c806807-e988-4455-94d0-a2690462731f tempest-AttachVolumeNegativeTest-1367384515 None] Created volume successfully. Feb 19 21:14:40.301053 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-938f1f0b-5983-40d8-8473-9f210565f33c req-c91db016-de85-4bf6-9729-a114c4b34079 tempest-AttachVolumeNegativeTest-1367384515 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:14:41.537640 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-938f1f0b-5983-40d8-8473-9f210565f33c req-c91db016-de85-4bf6-9729-a114c4b34079 tempest-AttachVolumeNegativeTest-1367384515 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.235s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:14:41.538857 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-938f1f0b-5983-40d8-8473-9f210565f33c req-c91db016-de85-4bf6-9729-a114c4b34079 tempest-AttachVolumeNegativeTest-1367384515 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-279e111c-6c3e-4e53-a347-c4612e7ecea6', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '279e111c-6c3e-4e53-a347-c4612e7ecea6', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:14:41.580476 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-938f1f0b-5983-40d8-8473-9f210565f33c req-c91db016-de85-4bf6-9729-a114c4b34079 tempest-AttachVolumeNegativeTest-1367384515 None] Connection info returned from driver {'name': 'volumes/volume-279e111c-6c3e-4e53-a347-c4612e7ecea6', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '279e111c-6c3e-4e53-a347-c4612e7ecea6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'feac802c-b39f-4f81-85de-d99182c90ff6'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:14:41.633232 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-938f1f0b-5983-40d8-8473-9f210565f33c req-c91db016-de85-4bf6-9729-a114c4b34079 tempest-AttachVolumeNegativeTest-1367384515 None] attachment_update completed successfully. Feb 19 21:14:44.741232 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-be273ec4-a749-4252-accf-880ad258396e req-b24dc14c-cba7-446c-9c5b-1a757a074547 tempest-AttachVolumeNegativeTest-1367384515 None] Terminate volume connection completed successfully. Feb 19 21:14:44.742371 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-be273ec4-a749-4252-accf-880ad258396e req-b24dc14c-cba7-446c-9c5b-1a757a074547 tempest-AttachVolumeNegativeTest-1367384515 None] Deleting attachment feac802c-b39f-4f81-85de-d99182c90ff6. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:15:06.630827 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:15:06.636243 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:15:06.636243 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:15:06.662106 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Flow 'volume_create_manager' (67be8713-83b4-45f3-9990-02a3dca2ae87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:15:06.668907 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5aac723-e173-402b-aff7-a90b5c63ecda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:15:06.678457 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:15:06.696918 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5aac723-e173-402b-aff7-a90b5c63ecda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1108574352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=85d7e961-c212-4d16-b876-da38ded42947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7a8678732a40b383cedd20600e102e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:15:07Z,use_quota=True,user_id='5e825e0ef42743238263e6758e53e28c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:15:06.703196 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e877bf4e-654c-44e8-bedf-6f6a56a763ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:15:06.707605 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e877bf4e-654c-44e8-bedf-6f6a56a763ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:15:06.712894 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44caadeb-6a21-4b07-8d60-f9f8ab6ce14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:15:06.718094 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44caadeb-6a21-4b07-8d60-f9f8ab6ce14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85d7e961-c212-4d16-b876-da38ded42947', 'volume_name': 'volume-85d7e961-c212-4d16-b876-da38ded42947', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:15:06.725870 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1efa020-b8fe-4849-806f-c42de3bed728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:15:06.730293 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1efa020-b8fe-4849-806f-c42de3bed728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:15:06.735511 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93d729c-9012-46a9-8f0c-a7d380b8cdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:15:06.737389 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Volume 85d7e961-c212-4d16-b876-da38ded42947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85d7e961-c212-4d16-b876-da38ded42947', 'volume_size': 1} Feb 19 21:15:06.737969 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] creating volume 'volume-85d7e961-c212-4d16-b876-da38ded42947' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:15:06.739727 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:06.812611 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:15:06.813010 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:15:06.817235 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93d729c-9012-46a9-8f0c-a7d380b8cdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85d7e961-c212-4d16-b876-da38ded42947', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:15:06.822695 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce20273-7176-4c29-b1a4-63e483b76ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:15:06.837687 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Volume volume-85d7e961-c212-4d16-b876-da38ded42947 (85d7e961-c212-4d16-b876-da38ded42947): created successfully Feb 19 21:15:06.841901 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce20273-7176-4c29-b1a4-63e483b76ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:15:06.849262 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Flow 'volume_create_manager' (67be8713-83b4-45f3-9990-02a3dca2ae87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:15:06.864715 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-446383df-39e4-49ab-83b4-925858e7be92 tempest-AttachVolumeNegativeTest-1367384515 None] Created volume successfully. Feb 19 21:15:08.248358 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-6021867b-8707-4f8d-8c57-52acc37bcdb6 req-20b93dd7-5091-470c-97a4-30d1e36f2832 tempest-AttachVolumeNegativeTest-1367384515 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:15:09.155235 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-6021867b-8707-4f8d-8c57-52acc37bcdb6 req-20b93dd7-5091-470c-97a4-30d1e36f2832 tempest-AttachVolumeNegativeTest-1367384515 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.907s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:15:09.156958 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-6021867b-8707-4f8d-8c57-52acc37bcdb6 req-20b93dd7-5091-470c-97a4-30d1e36f2832 tempest-AttachVolumeNegativeTest-1367384515 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-85d7e961-c212-4d16-b876-da38ded42947', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '85d7e961-c212-4d16-b876-da38ded42947', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:15:09.185944 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-6021867b-8707-4f8d-8c57-52acc37bcdb6 req-20b93dd7-5091-470c-97a4-30d1e36f2832 tempest-AttachVolumeNegativeTest-1367384515 None] Connection info returned from driver {'name': 'volumes/volume-85d7e961-c212-4d16-b876-da38ded42947', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '85d7e961-c212-4d16-b876-da38ded42947', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8621bad9-46a9-4661-80be-9e7365454b45'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:15:09.264670 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-6021867b-8707-4f8d-8c57-52acc37bcdb6 req-20b93dd7-5091-470c-97a4-30d1e36f2832 tempest-AttachVolumeNegativeTest-1367384515 None] attachment_update completed successfully. Feb 19 21:15:13.346797 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-c82b6a05-f5d0-4d38-b559-cafbc6c93e59 req-fbe7126c-283d-4ea1-8b31-5bfdb671b47e tempest-AttachVolumeNegativeTest-1367384515 None] Terminate volume connection completed successfully. Feb 19 21:15:13.348206 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-c82b6a05-f5d0-4d38-b559-cafbc6c93e59 req-fbe7126c-283d-4ea1-8b31-5bfdb671b47e tempest-AttachVolumeNegativeTest-1367384515 None] Deleting attachment 8621bad9-46a9-4661-80be-9e7365454b45. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:15:13.903523 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-b7d3ed28-3f6a-4d72-944a-88d6c38d834a tempest-AttachVolumeNegativeTest-1367384515 None] Lock "b'cinder-85d7e961-c212-4d16-b876-da38ded42947-delete_volume'" acquired by "delete_volume" :: waited 0.054s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:15:13.995469 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b7d3ed28-3f6a-4d72-944a-88d6c38d834a tempest-AttachVolumeNegativeTest-1367384515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:14.063736 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b7d3ed28-3f6a-4d72-944a-88d6c38d834a tempest-AttachVolumeNegativeTest-1367384515 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:15:14.064386 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b7d3ed28-3f6a-4d72-944a-88d6c38d834a tempest-AttachVolumeNegativeTest-1367384515 None] Volume volume-85d7e961-c212-4d16-b876-da38ded42947 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:15:14.077291 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b7d3ed28-3f6a-4d72-944a-88d6c38d834a tempest-AttachVolumeNegativeTest-1367384515 None] deleting rbd volume volume-85d7e961-c212-4d16-b876-da38ded42947 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:15:14.639982 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-b7d3ed28-3f6a-4d72-944a-88d6c38d834a tempest-AttachVolumeNegativeTest-1367384515 None] Created reservations ['ff700895-771e-4930-929b-257cf9a54e85', 'b05f9c39-603a-4197-9c57-014b5a0f55b4', 'c4979350-ec7d-4dcb-82bb-53e801aee893', '683434f3-b6fe-4f38-b060-b797b5ec477b'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:15:14.713420 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b7d3ed28-3f6a-4d72-944a-88d6c38d834a tempest-AttachVolumeNegativeTest-1367384515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:14.749783 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b7d3ed28-3f6a-4d72-944a-88d6c38d834a tempest-AttachVolumeNegativeTest-1367384515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:14.797226 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-b7d3ed28-3f6a-4d72-944a-88d6c38d834a tempest-AttachVolumeNegativeTest-1367384515 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:15:14.803447 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b7d3ed28-3f6a-4d72-944a-88d6c38d834a tempest-AttachVolumeNegativeTest-1367384515 None] Deleted volume successfully. Feb 19 21:15:14.821912 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-b7d3ed28-3f6a-4d72-944a-88d6c38d834a tempest-AttachVolumeNegativeTest-1367384515 None] Lock "b'cinder-85d7e961-c212-4d16-b876-da38ded42947-delete_volume'" released by "delete_volume" :: held 0.919s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:15:21.635506 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-c65ed3f7-f81d-4fbb-a479-af71ed65d19c tempest-AttachVolumeNegativeTest-1367384515 None] Lock "b'cinder-279e111c-6c3e-4e53-a347-c4612e7ecea6-delete_volume'" acquired by "delete_volume" :: waited 0.046s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:15:21.765980 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c65ed3f7-f81d-4fbb-a479-af71ed65d19c tempest-AttachVolumeNegativeTest-1367384515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:21.876185 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c65ed3f7-f81d-4fbb-a479-af71ed65d19c tempest-AttachVolumeNegativeTest-1367384515 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:15:21.876690 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c65ed3f7-f81d-4fbb-a479-af71ed65d19c tempest-AttachVolumeNegativeTest-1367384515 None] Volume volume-279e111c-6c3e-4e53-a347-c4612e7ecea6 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:15:21.892355 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c65ed3f7-f81d-4fbb-a479-af71ed65d19c tempest-AttachVolumeNegativeTest-1367384515 None] deleting rbd volume volume-279e111c-6c3e-4e53-a347-c4612e7ecea6 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:15:22.182953 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:15:22.184529 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:22.260900 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:22.366291 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:15:22.575232 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-c65ed3f7-f81d-4fbb-a479-af71ed65d19c tempest-AttachVolumeNegativeTest-1367384515 None] Created reservations ['66d6417a-3cb7-4de3-b00a-2feaed08a4af', 'c7ad12f9-bb27-4bb3-a481-9fa2889bd756', 'dbfbf0c9-a5ba-407d-9482-37fc4b72eea1', 'f6c4b145-575c-4cdd-8892-1513570f3a5c'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:15:22.671409 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c65ed3f7-f81d-4fbb-a479-af71ed65d19c tempest-AttachVolumeNegativeTest-1367384515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:22.743640 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c65ed3f7-f81d-4fbb-a479-af71ed65d19c tempest-AttachVolumeNegativeTest-1367384515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:22.797083 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-c65ed3f7-f81d-4fbb-a479-af71ed65d19c tempest-AttachVolumeNegativeTest-1367384515 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:15:22.805996 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-c65ed3f7-f81d-4fbb-a479-af71ed65d19c tempest-AttachVolumeNegativeTest-1367384515 None] Deleted volume successfully. Feb 19 21:15:22.838950 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-c65ed3f7-f81d-4fbb-a479-af71ed65d19c tempest-AttachVolumeNegativeTest-1367384515 None] Lock "b'cinder-279e111c-6c3e-4e53-a347-c4612e7ecea6-delete_volume'" released by "delete_volume" :: held 1.206s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:15:23.862950 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:15:23.872991 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:15:23.873667 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:15:23.904647 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Flow 'volume_create_manager' (620aa1f1-3a6f-443d-a494-576f7bba1e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:15:23.929991 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3930aecb-662e-4708-8ca6-21440b1757ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:15:23.939863 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:15:23.957489 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3930aecb-662e-4708-8ca6-21440b1757ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-454895641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=61a0e112-a4ad-4edc-b4b7-879d9be38ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9780e37cefb40688394abf1793095b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:15:24Z,use_quota=True,user_id='5a8ad5662e6148538fe3905314b9dc62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:15:23.964148 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (813b7a69-83bd-4fab-9b0a-575584f53fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:15:23.969777 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (813b7a69-83bd-4fab-9b0a-575584f53fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:15:23.976209 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f598c4a1-cbd1-4564-8229-bd4229a9c0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:15:23.985534 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f598c4a1-cbd1-4564-8229-bd4229a9c0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a0e112-a4ad-4edc-b4b7-879d9be38ab1', 'volume_name': 'volume-61a0e112-a4ad-4edc-b4b7-879d9be38ab1', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:15:23.990985 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21764a35-e080-44a2-81aa-cf0ca5e0c312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:15:23.996541 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21764a35-e080-44a2-81aa-cf0ca5e0c312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:15:24.002505 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5635067d-c397-44c4-8066-4a75371c011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:15:24.004034 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Volume 61a0e112-a4ad-4edc-b4b7-879d9be38ab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a0e112-a4ad-4edc-b4b7-879d9be38ab1', 'volume_size': 1} Feb 19 21:15:24.004782 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] creating volume 'volume-61a0e112-a4ad-4edc-b4b7-879d9be38ab1' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:15:24.006565 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:24.111166 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:15:24.112136 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:15:24.122106 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5635067d-c397-44c4-8066-4a75371c011f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a0e112-a4ad-4edc-b4b7-879d9be38ab1', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:15:24.132931 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b6ef45-1ce7-4f15-bbd2-a280239acd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:15:24.147408 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Volume volume-61a0e112-a4ad-4edc-b4b7-879d9be38ab1 (61a0e112-a4ad-4edc-b4b7-879d9be38ab1): created successfully Feb 19 21:15:24.154668 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b6ef45-1ce7-4f15-bbd2-a280239acd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:15:24.165363 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Flow 'volume_create_manager' (620aa1f1-3a6f-443d-a494-576f7bba1e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:15:24.178006 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-93e0e7a5-5cc9-43ef-be25-47c84c3d1778 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Created volume successfully. Feb 19 21:15:26.612313 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-fe37f7c1-d16b-44b6-ac72-1b6586cb3e95 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Lock "b'cinder-61a0e112-a4ad-4edc-b4b7-879d9be38ab1-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:15:26.691866 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-fe37f7c1-d16b-44b6-ac72-1b6586cb3e95 tempest-VolumeQuotasNegativeTestJSON-473545182 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:26.799427 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-fe37f7c1-d16b-44b6-ac72-1b6586cb3e95 tempest-VolumeQuotasNegativeTestJSON-473545182 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:15:26.799866 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-fe37f7c1-d16b-44b6-ac72-1b6586cb3e95 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Volume volume-61a0e112-a4ad-4edc-b4b7-879d9be38ab1 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:15:26.814062 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-fe37f7c1-d16b-44b6-ac72-1b6586cb3e95 tempest-VolumeQuotasNegativeTestJSON-473545182 None] deleting rbd volume volume-61a0e112-a4ad-4edc-b4b7-879d9be38ab1 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:15:27.315823 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-fe37f7c1-d16b-44b6-ac72-1b6586cb3e95 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Created reservations ['ac0b5381-b6ce-444a-9bfc-d4a07bae1552', '5370b5e7-d639-47fd-a54d-784f890b6fb0', '5d151c30-c1cc-46ff-b811-679c532dc178', '26423c1b-e617-4cdd-b68a-c974eb097e6b'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:15:27.385720 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-fe37f7c1-d16b-44b6-ac72-1b6586cb3e95 tempest-VolumeQuotasNegativeTestJSON-473545182 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:27.422831 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-fe37f7c1-d16b-44b6-ac72-1b6586cb3e95 tempest-VolumeQuotasNegativeTestJSON-473545182 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:27.459288 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-fe37f7c1-d16b-44b6-ac72-1b6586cb3e95 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:15:27.470660 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-fe37f7c1-d16b-44b6-ac72-1b6586cb3e95 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Deleted volume successfully. Feb 19 21:15:27.485820 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-fe37f7c1-d16b-44b6-ac72-1b6586cb3e95 tempest-VolumeQuotasNegativeTestJSON-473545182 None] Lock "b'cinder-61a0e112-a4ad-4edc-b4b7-879d9be38ab1-delete_volume'" released by "delete_volume" :: held 0.873s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:15:31.645112 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-81ed2381-1a55-470c-b257-7c2b3942e98c tempest-AttachVolumeNegativeTest-1367384515 None] Lock "b'cinder-986bcdbd-6541-4e97-a01a-c58fbdba9f3c-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:15:31.705562 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-81ed2381-1a55-470c-b257-7c2b3942e98c tempest-AttachVolumeNegativeTest-1367384515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:31.792816 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-81ed2381-1a55-470c-b257-7c2b3942e98c tempest-AttachVolumeNegativeTest-1367384515 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:15:31.793472 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-81ed2381-1a55-470c-b257-7c2b3942e98c tempest-AttachVolumeNegativeTest-1367384515 None] Volume volume-986bcdbd-6541-4e97-a01a-c58fbdba9f3c is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:15:31.801737 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-81ed2381-1a55-470c-b257-7c2b3942e98c tempest-AttachVolumeNegativeTest-1367384515 None] deleting rbd volume volume-986bcdbd-6541-4e97-a01a-c58fbdba9f3c {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:15:32.422937 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-81ed2381-1a55-470c-b257-7c2b3942e98c tempest-AttachVolumeNegativeTest-1367384515 None] Created reservations ['ed226c15-db1d-4793-96af-45fb0b432f30', '315c3c04-4f57-4215-97cc-81bc6d372866', '5f2a47f2-3003-4880-b96c-e9c3d4269887', 'c03dbcf7-b33f-4586-b3f1-e1e4be22257c'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:15:32.517543 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-81ed2381-1a55-470c-b257-7c2b3942e98c tempest-AttachVolumeNegativeTest-1367384515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:32.573845 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-81ed2381-1a55-470c-b257-7c2b3942e98c tempest-AttachVolumeNegativeTest-1367384515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:15:32.653147 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-81ed2381-1a55-470c-b257-7c2b3942e98c tempest-AttachVolumeNegativeTest-1367384515 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:15:32.668173 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-81ed2381-1a55-470c-b257-7c2b3942e98c tempest-AttachVolumeNegativeTest-1367384515 None] Deleted volume successfully. Feb 19 21:15:32.709410 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-81ed2381-1a55-470c-b257-7c2b3942e98c tempest-AttachVolumeNegativeTest-1367384515 None] Lock "b'cinder-986bcdbd-6541-4e97-a01a-c58fbdba9f3c-delete_volume'" released by "delete_volume" :: held 1.064s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:16:02.409905 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:16:02.415285 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:16:02.415741 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:16:02.444169 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Flow 'volume_create_manager' (3efd4172-b321-47fb-b1a5-dc433f201dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:02.456570 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc32dfdd-684e-4f30-95f4-1b4a8b13fc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:02.464771 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:16:02.487477 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc32dfdd-684e-4f30-95f4-1b4a8b13fc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-678207245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9a40e792-dd6d-45d3-83d8-ca057a370edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4929d77b858b4d848172346c97160377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:16:02Z,use_quota=True,user_id='ad93f38d6b384bcf9b1b190a9abb27ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:02.496260 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d5ea08-0eba-4bf7-b884-763ebf20ca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:02.503869 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d5ea08-0eba-4bf7-b884-763ebf20ca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:02.511583 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1bb327f-a3f1-489b-a015-4fcb9e2d2952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:02.517305 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1bb327f-a3f1-489b-a015-4fcb9e2d2952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a40e792-dd6d-45d3-83d8-ca057a370edb', 'volume_name': 'volume-9a40e792-dd6d-45d3-83d8-ca057a370edb', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:02.523042 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf4c89e-b907-43ac-987a-6ae520f7cbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:02.537119 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf4c89e-b907-43ac-987a-6ae520f7cbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:02.546933 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e745f5-33a7-4f10-997a-eb43dd396461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:02.548854 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Volume 9a40e792-dd6d-45d3-83d8-ca057a370edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a40e792-dd6d-45d3-83d8-ca057a370edb', 'volume_size': 1} Feb 19 21:16:02.549469 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] creating volume 'volume-9a40e792-dd6d-45d3-83d8-ca057a370edb' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:16:02.551050 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:02.693363 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:16:02.693954 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:16:02.714143 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e745f5-33a7-4f10-997a-eb43dd396461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a40e792-dd6d-45d3-83d8-ca057a370edb', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:02.723583 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc0e5d9-968e-4693-9701-35bc4d08d848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:02.753621 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Volume volume-9a40e792-dd6d-45d3-83d8-ca057a370edb (9a40e792-dd6d-45d3-83d8-ca057a370edb): created successfully Feb 19 21:16:02.766487 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc0e5d9-968e-4693-9701-35bc4d08d848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:02.777543 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Flow 'volume_create_manager' (3efd4172-b321-47fb-b1a5-dc433f201dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:02.804753 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-741914ed-ac98-44ba-8a07-572d1253dece tempest-VolumesActionsTest-1474651639 None] Created volume successfully. Feb 19 21:16:03.319740 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-61a0e550-2de5-4e20-997a-d0e7a77c66fb tempest-VolumesActionsTest-1474651639 None] Lock "b'cinder-9a40e792-dd6d-45d3-83d8-ca057a370edb'" acquired by "attach_volume" :: waited 0.012s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:16:03.389653 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-61a0e550-2de5-4e20-997a-d0e7a77c66fb tempest-VolumesActionsTest-1474651639 None] Attaching volume 9a40e792-dd6d-45d3-83d8-ca057a370edb to instance 00dedc93-b220-4908-8f4f-506d606555be at mountpoint /dev/sdb on host None. Feb 19 21:16:03.475298 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-61a0e550-2de5-4e20-997a-d0e7a77c66fb tempest-VolumesActionsTest-1474651639 None] Attach volume completed successfully. Feb 19 21:16:03.492219 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-61a0e550-2de5-4e20-997a-d0e7a77c66fb tempest-VolumesActionsTest-1474651639 None] Lock "b'cinder-9a40e792-dd6d-45d3-83d8-ca057a370edb'" released by "attach_volume" :: held 0.172s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:16:04.585797 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-54867cf8-891c-41b9-aaca-7a496af24dd5 tempest-VolumesActionsTest-1568047106 None] Terminate volume connection completed successfully. Feb 19 21:16:04.635712 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-54867cf8-891c-41b9-aaca-7a496af24dd5 tempest-VolumesActionsTest-1568047106 None] Lock "b'cinder-9a40e792-dd6d-45d3-83d8-ca057a370edb-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:16:04.652064 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-54867cf8-891c-41b9-aaca-7a496af24dd5 tempest-VolumesActionsTest-1568047106 None] Detaching volume 9a40e792-dd6d-45d3-83d8-ca057a370edb from instance 00dedc93-b220-4908-8f4f-506d606555be. Feb 19 21:16:04.716957 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-54867cf8-891c-41b9-aaca-7a496af24dd5 tempest-VolumesActionsTest-1568047106 None] Detach volume completed successfully. Feb 19 21:16:04.725954 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-54867cf8-891c-41b9-aaca-7a496af24dd5 tempest-VolumesActionsTest-1568047106 None] Lock "b'cinder-9a40e792-dd6d-45d3-83d8-ca057a370edb-detach_volume'" released by "detach_volume" :: held 0.090s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:16:04.963428 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-1393aeba-0a62-4bfd-8a0f-06e369d4b254 tempest-VolumesActionsTest-1474651639 None] Lock "b'cinder-9a40e792-dd6d-45d3-83d8-ca057a370edb-detach_volume'" acquired by "detach_volume" :: waited 0.028s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:16:04.964236 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-1393aeba-0a62-4bfd-8a0f-06e369d4b254 tempest-VolumesActionsTest-1474651639 None] Volume detach called, but volume not attached. Feb 19 21:16:04.985446 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-1393aeba-0a62-4bfd-8a0f-06e369d4b254 tempest-VolumesActionsTest-1474651639 None] Lock "b'cinder-9a40e792-dd6d-45d3-83d8-ca057a370edb-detach_volume'" released by "detach_volume" :: held 0.022s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:16:10.630238 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:16:10.639751 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:16:10.645534 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:16:10.681036 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Flow 'volume_create_manager' (10dacde2-1a5f-4690-b03a-fba5a7a8aa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:10.696722 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0419d101-c5cb-44d6-b90c-71513befa4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:10.713570 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:16:10.733577 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0419d101-c5cb-44d6-b90c-71513befa4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1260757018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=881170ff-c296-4a37-afd2-e408ea863230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4929d77b858b4d848172346c97160377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:16:11Z,use_quota=True,user_id='ad93f38d6b384bcf9b1b190a9abb27ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:10.740815 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f1b1f4-e26d-42e2-a503-46050ecbe5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:10.746378 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f1b1f4-e26d-42e2-a503-46050ecbe5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:10.753585 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54ef90a-6803-4535-84c6-fd834dc4d1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:10.758630 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54ef90a-6803-4535-84c6-fd834dc4d1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '881170ff-c296-4a37-afd2-e408ea863230', 'volume_name': 'volume-881170ff-c296-4a37-afd2-e408ea863230', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:10.765887 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459e14f8-beef-4f2c-aab7-939e02f6927d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:10.771480 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459e14f8-beef-4f2c-aab7-939e02f6927d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:10.778208 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1366cb0f-9f97-4489-b07b-5a9f8c2a28d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:10.781479 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Volume 881170ff-c296-4a37-afd2-e408ea863230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-881170ff-c296-4a37-afd2-e408ea863230', 'volume_size': 1} Feb 19 21:16:10.782567 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] creating volume 'volume-881170ff-c296-4a37-afd2-e408ea863230' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:16:10.784309 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:10.952304 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:16:10.952705 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:16:10.956551 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1366cb0f-9f97-4489-b07b-5a9f8c2a28d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-881170ff-c296-4a37-afd2-e408ea863230', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:10.966215 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6fcdcd-9467-4a34-8765-a991325ea8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:10.985087 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Volume volume-881170ff-c296-4a37-afd2-e408ea863230 (881170ff-c296-4a37-afd2-e408ea863230): created successfully Feb 19 21:16:10.992173 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6fcdcd-9467-4a34-8765-a991325ea8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:10.999529 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Flow 'volume_create_manager' (10dacde2-1a5f-4690-b03a-fba5a7a8aa71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:11.011874 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-6767dcd3-7194-4184-940b-7b10e0c348bc tempest-VolumesActionsTest-1474651639 None] Created volume successfully. Feb 19 21:16:11.863181 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3d345697-3d10-47ac-b9ce-fcc88ba65a0b tempest-VolumesActionsTest-1568047106 None] Lock "b'cinder-881170ff-c296-4a37-afd2-e408ea863230-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:16:11.956136 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3d345697-3d10-47ac-b9ce-fcc88ba65a0b tempest-VolumesActionsTest-1568047106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:12.065905 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3d345697-3d10-47ac-b9ce-fcc88ba65a0b tempest-VolumesActionsTest-1568047106 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:16:12.066330 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3d345697-3d10-47ac-b9ce-fcc88ba65a0b tempest-VolumesActionsTest-1568047106 None] Volume volume-881170ff-c296-4a37-afd2-e408ea863230 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:16:12.088240 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3d345697-3d10-47ac-b9ce-fcc88ba65a0b tempest-VolumesActionsTest-1568047106 None] deleting rbd volume volume-881170ff-c296-4a37-afd2-e408ea863230 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:16:12.784615 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-3d345697-3d10-47ac-b9ce-fcc88ba65a0b tempest-VolumesActionsTest-1568047106 None] Created reservations ['a82d5ca0-3d16-4bfe-bbad-cc2b91b9cab1', '2d09e4ae-0b52-4f0a-a869-2155d1667083', '9d0225b2-d95a-4e27-a0b6-62e3368f0148', '33fe216b-deca-4f0c-b462-f674b165e211'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:16:12.857030 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3d345697-3d10-47ac-b9ce-fcc88ba65a0b tempest-VolumesActionsTest-1568047106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:12.930103 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3d345697-3d10-47ac-b9ce-fcc88ba65a0b tempest-VolumesActionsTest-1568047106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:12.966460 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3d345697-3d10-47ac-b9ce-fcc88ba65a0b tempest-VolumesActionsTest-1568047106 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:16:12.981011 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3d345697-3d10-47ac-b9ce-fcc88ba65a0b tempest-VolumesActionsTest-1568047106 None] Deleted volume successfully. Feb 19 21:16:13.005914 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3d345697-3d10-47ac-b9ce-fcc88ba65a0b tempest-VolumesActionsTest-1568047106 None] Lock "b'cinder-881170ff-c296-4a37-afd2-e408ea863230-delete_volume'" released by "delete_volume" :: held 1.146s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:16:13.593251 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:16:13.598258 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:16:13.598896 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:16:13.649428 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Flow 'volume_create_manager' (5788c862-65f7-440e-8530-2056eb014ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:13.662916 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7907323a-e6b6-400b-8210-5e4a07a7c6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:13.679848 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:16:13.713852 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7907323a-e6b6-400b-8210-5e4a07a7c6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1083786691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6c381773-67ff-46d8-91bd-f95a9a48a78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4929d77b858b4d848172346c97160377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:16:14Z,use_quota=True,user_id='ad93f38d6b384bcf9b1b190a9abb27ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:13.721592 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81650c9f-f535-4361-afa7-93b436525217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:13.729234 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81650c9f-f535-4361-afa7-93b436525217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:13.742896 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752b9063-e1c7-449e-9a8d-6a137555f6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:13.754627 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752b9063-e1c7-449e-9a8d-6a137555f6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c381773-67ff-46d8-91bd-f95a9a48a78e', 'volume_name': 'volume-6c381773-67ff-46d8-91bd-f95a9a48a78e', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:13.768365 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7def41-653d-4243-b969-d77792097fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:13.776927 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7def41-653d-4243-b969-d77792097fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:13.786281 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721c28fc-43fc-4735-b0ff-10a19aec1976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:13.792556 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Volume 6c381773-67ff-46d8-91bd-f95a9a48a78e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c381773-67ff-46d8-91bd-f95a9a48a78e', 'volume_size': 1} Feb 19 21:16:13.798365 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] creating volume 'volume-6c381773-67ff-46d8-91bd-f95a9a48a78e' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:16:13.799614 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:13.958944 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:16:13.959498 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:16:13.971725 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721c28fc-43fc-4735-b0ff-10a19aec1976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c381773-67ff-46d8-91bd-f95a9a48a78e', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:13.980275 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873e4100-e327-4c77-991a-bcc9916e9462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:13.996738 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Volume volume-6c381773-67ff-46d8-91bd-f95a9a48a78e (6c381773-67ff-46d8-91bd-f95a9a48a78e): created successfully Feb 19 21:16:14.008226 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873e4100-e327-4c77-991a-bcc9916e9462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:14.025712 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Flow 'volume_create_manager' (5788c862-65f7-440e-8530-2056eb014ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:14.045024 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-da75d99a-58e5-46bc-b5e7-8c7ffa9fc1e9 tempest-VolumesActionsTest-1474651639 None] Created volume successfully. Feb 19 21:16:14.892243 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3f816d34-1e62-4596-847a-6dba4e2f6ab8 tempest-VolumesActionsTest-1568047106 None] Lock "b'cinder-6c381773-67ff-46d8-91bd-f95a9a48a78e-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:16:14.980898 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3f816d34-1e62-4596-847a-6dba4e2f6ab8 tempest-VolumesActionsTest-1568047106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:15.092233 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3f816d34-1e62-4596-847a-6dba4e2f6ab8 tempest-VolumesActionsTest-1568047106 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:16:15.092814 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3f816d34-1e62-4596-847a-6dba4e2f6ab8 tempest-VolumesActionsTest-1568047106 None] Volume volume-6c381773-67ff-46d8-91bd-f95a9a48a78e is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:16:15.117040 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3f816d34-1e62-4596-847a-6dba4e2f6ab8 tempest-VolumesActionsTest-1568047106 None] deleting rbd volume volume-6c381773-67ff-46d8-91bd-f95a9a48a78e {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:16:15.708512 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-3f816d34-1e62-4596-847a-6dba4e2f6ab8 tempest-VolumesActionsTest-1568047106 None] Created reservations ['dbe00715-90b8-4f2d-a74e-27e92af610e9', '8f1257b1-892c-44f5-89e5-4ee14cce1470', '595902c9-1aff-4d12-8255-e4337a1faa5f', '87b33a2c-5ee0-4775-95bf-e95e1cd43ac7'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:16:15.766087 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3f816d34-1e62-4596-847a-6dba4e2f6ab8 tempest-VolumesActionsTest-1568047106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:15.824962 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3f816d34-1e62-4596-847a-6dba4e2f6ab8 tempest-VolumesActionsTest-1568047106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:15.917595 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3f816d34-1e62-4596-847a-6dba4e2f6ab8 tempest-VolumesActionsTest-1568047106 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:16:15.925500 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3f816d34-1e62-4596-847a-6dba4e2f6ab8 tempest-VolumesActionsTest-1568047106 None] Deleted volume successfully. Feb 19 21:16:15.954240 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3f816d34-1e62-4596-847a-6dba4e2f6ab8 tempest-VolumesActionsTest-1568047106 None] Lock "b'cinder-6c381773-67ff-46d8-91bd-f95a9a48a78e-delete_volume'" released by "delete_volume" :: held 1.062s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:16:16.606987 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:16:16.615879 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:16:16.617373 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:16:16.651073 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Flow 'volume_create_manager' (6f73e2bb-5d5e-4cbd-9e2b-2312cdc76a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:16.662915 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e57cbe-ba10-4cfd-8a25-46c9df86790b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:16.670213 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:16:16.697818 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e57cbe-ba10-4cfd-8a25-46c9df86790b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1814758538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c353f4af-eb22-4c95-b94b-a53c049bd395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4929d77b858b4d848172346c97160377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:16:17Z,use_quota=True,user_id='ad93f38d6b384bcf9b1b190a9abb27ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:16.705850 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65826e48-7e6e-4893-ae18-1791a0afd302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:16.713510 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65826e48-7e6e-4893-ae18-1791a0afd302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:16.720401 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1451827-c11d-4723-8a5e-2cca5a2a4c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:16.726106 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1451827-c11d-4723-8a5e-2cca5a2a4c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c353f4af-eb22-4c95-b94b-a53c049bd395', 'volume_name': 'volume-c353f4af-eb22-4c95-b94b-a53c049bd395', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:16.736928 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750c6c4d-4652-4e7f-b4cc-e288a646e235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:16.741353 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750c6c4d-4652-4e7f-b4cc-e288a646e235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:16.746901 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71c171f-244a-4942-ad3d-a16d644ab8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:16.748774 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Volume c353f4af-eb22-4c95-b94b-a53c049bd395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c353f4af-eb22-4c95-b94b-a53c049bd395', 'volume_size': 1} Feb 19 21:16:16.749461 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] creating volume 'volume-c353f4af-eb22-4c95-b94b-a53c049bd395' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:16:16.750635 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:16.876601 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:16:16.877065 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:16:16.881864 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71c171f-244a-4942-ad3d-a16d644ab8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c353f4af-eb22-4c95-b94b-a53c049bd395', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:16.893021 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512df564-28e8-4071-9e47-8a5822661627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:16.907427 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Volume volume-c353f4af-eb22-4c95-b94b-a53c049bd395 (c353f4af-eb22-4c95-b94b-a53c049bd395): created successfully Feb 19 21:16:16.911681 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512df564-28e8-4071-9e47-8a5822661627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:16.929751 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Flow 'volume_create_manager' (6f73e2bb-5d5e-4cbd-9e2b-2312cdc76a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:16.950699 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-30cb5436-67bd-41cf-8ed7-34c4791a1d68 tempest-VolumesActionsTest-1474651639 None] Created volume successfully. Feb 19 21:16:17.971067 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-4afed12a-7931-4408-9659-18f3690b62d6 tempest-VolumesActionsTest-1568047106 None] Lock "b'cinder-c353f4af-eb22-4c95-b94b-a53c049bd395-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:16:18.052481 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4afed12a-7931-4408-9659-18f3690b62d6 tempest-VolumesActionsTest-1568047106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:18.132165 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4afed12a-7931-4408-9659-18f3690b62d6 tempest-VolumesActionsTest-1568047106 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:16:18.133072 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4afed12a-7931-4408-9659-18f3690b62d6 tempest-VolumesActionsTest-1568047106 None] Volume volume-c353f4af-eb22-4c95-b94b-a53c049bd395 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:16:18.149210 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4afed12a-7931-4408-9659-18f3690b62d6 tempest-VolumesActionsTest-1568047106 None] deleting rbd volume volume-c353f4af-eb22-4c95-b94b-a53c049bd395 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:16:18.665451 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-4afed12a-7931-4408-9659-18f3690b62d6 tempest-VolumesActionsTest-1568047106 None] Created reservations ['a5c95886-311a-49f0-b7fe-1aede6f1cdb3', '6ca96a1c-d52a-49c4-8ac6-7e493970c4a0', '01b00c97-0cff-4f85-8ced-36e5652164d2', '8c77a615-2db4-43b0-86be-463d209c62a0'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:16:18.751514 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4afed12a-7931-4408-9659-18f3690b62d6 tempest-VolumesActionsTest-1568047106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:18.817305 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4afed12a-7931-4408-9659-18f3690b62d6 tempest-VolumesActionsTest-1568047106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:18.883548 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-4afed12a-7931-4408-9659-18f3690b62d6 tempest-VolumesActionsTest-1568047106 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:16:18.888664 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-4afed12a-7931-4408-9659-18f3690b62d6 tempest-VolumesActionsTest-1568047106 None] Deleted volume successfully. Feb 19 21:16:18.915280 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-4afed12a-7931-4408-9659-18f3690b62d6 tempest-VolumesActionsTest-1568047106 None] Lock "b'cinder-c353f4af-eb22-4c95-b94b-a53c049bd395-delete_volume'" released by "delete_volume" :: held 0.944s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:16:19.641080 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:16:19.646924 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:16:19.647687 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:16:19.678214 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Flow 'volume_create_manager' (d18a1ce1-4798-4861-8529-d96871a09f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:19.686430 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f739eb-8b13-47ec-a6c6-c6fea74ea462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:19.693610 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:16:19.709532 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f739eb-8b13-47ec-a6c6-c6fea74ea462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1791859497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1f80dd7a-4b28-456d-afbb-2063f8d0ed93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4929d77b858b4d848172346c97160377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:16:20Z,use_quota=True,user_id='ad93f38d6b384bcf9b1b190a9abb27ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:19.715686 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec058c1-7898-4b50-87ec-b184067df9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:19.720462 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec058c1-7898-4b50-87ec-b184067df9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:19.726200 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fde5c2-c80c-4d80-81ac-1b54a0cb2982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:19.730447 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fde5c2-c80c-4d80-81ac-1b54a0cb2982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f80dd7a-4b28-456d-afbb-2063f8d0ed93', 'volume_name': 'volume-1f80dd7a-4b28-456d-afbb-2063f8d0ed93', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:19.740090 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1070911c-4644-4e4b-af96-c9f71695e60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:19.744897 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1070911c-4644-4e4b-af96-c9f71695e60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:19.750301 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5893dd-0975-466c-aca8-05625ca400c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:19.751654 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Volume 1f80dd7a-4b28-456d-afbb-2063f8d0ed93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f80dd7a-4b28-456d-afbb-2063f8d0ed93', 'volume_size': 1} Feb 19 21:16:19.752117 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] creating volume 'volume-1f80dd7a-4b28-456d-afbb-2063f8d0ed93' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:16:19.753251 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:19.858319 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:16:19.858837 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:16:19.864782 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5893dd-0975-466c-aca8-05625ca400c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f80dd7a-4b28-456d-afbb-2063f8d0ed93', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:19.881160 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b55f5cf-69c0-4970-a03b-47cf732de86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:19.902098 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Volume volume-1f80dd7a-4b28-456d-afbb-2063f8d0ed93 (1f80dd7a-4b28-456d-afbb-2063f8d0ed93): created successfully Feb 19 21:16:19.906639 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b55f5cf-69c0-4970-a03b-47cf732de86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:19.923017 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Flow 'volume_create_manager' (d18a1ce1-4798-4861-8529-d96871a09f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:19.937646 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-132c5577-d8dd-4d07-92d0-dfc87026f5c7 tempest-VolumesActionsTest-1474651639 None] Created volume successfully. Feb 19 21:16:20.978836 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3e042ee0-d5bc-4c5b-8120-12bdeca70879 tempest-VolumesActionsTest-1568047106 None] Lock "b'cinder-1f80dd7a-4b28-456d-afbb-2063f8d0ed93-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:16:21.032057 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3e042ee0-d5bc-4c5b-8120-12bdeca70879 tempest-VolumesActionsTest-1568047106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:21.148465 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3e042ee0-d5bc-4c5b-8120-12bdeca70879 tempest-VolumesActionsTest-1568047106 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:16:21.149132 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3e042ee0-d5bc-4c5b-8120-12bdeca70879 tempest-VolumesActionsTest-1568047106 None] Volume volume-1f80dd7a-4b28-456d-afbb-2063f8d0ed93 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:16:21.169422 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3e042ee0-d5bc-4c5b-8120-12bdeca70879 tempest-VolumesActionsTest-1568047106 None] deleting rbd volume volume-1f80dd7a-4b28-456d-afbb-2063f8d0ed93 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:16:21.636185 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-3e042ee0-d5bc-4c5b-8120-12bdeca70879 tempest-VolumesActionsTest-1568047106 None] Created reservations ['078e2aba-a66b-4420-be73-931c26444b0a', '14771ced-c2c7-4446-9711-978be37d8d22', 'c3ff08b2-e731-4fc6-80e6-cab6dea03acc', '566408de-466d-4e35-99e0-e5d95aa21637'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:16:21.753337 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3e042ee0-d5bc-4c5b-8120-12bdeca70879 tempest-VolumesActionsTest-1568047106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:21.823998 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3e042ee0-d5bc-4c5b-8120-12bdeca70879 tempest-VolumesActionsTest-1568047106 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:21.927621 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3e042ee0-d5bc-4c5b-8120-12bdeca70879 tempest-VolumesActionsTest-1568047106 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:16:21.938115 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3e042ee0-d5bc-4c5b-8120-12bdeca70879 tempest-VolumesActionsTest-1568047106 None] Deleted volume successfully. Feb 19 21:16:21.954680 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3e042ee0-d5bc-4c5b-8120-12bdeca70879 tempest-VolumesActionsTest-1568047106 None] Lock "b'cinder-1f80dd7a-4b28-456d-afbb-2063f8d0ed93-delete_volume'" released by "delete_volume" :: held 0.978s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:16:22.184003 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:16:22.184774 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:22.267529 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:22.368163 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:16:22.651506 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:16:22.664162 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:16:22.674557 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:16:22.699200 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Flow 'volume_create_manager' (1dcf4a55-af12-494d-ae09-cf81b5a5db5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:22.709714 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69c09db-7ccf-49f3-b8da-39c2fae5e0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:22.717789 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:16:22.744764 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69c09db-7ccf-49f3-b8da-39c2fae5e0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1010417874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1699b2d0-16ce-4d4b-9cb5-29ff7597c6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4929d77b858b4d848172346c97160377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:16:23Z,use_quota=True,user_id='ad93f38d6b384bcf9b1b190a9abb27ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:22.752399 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec01f772-6291-48b0-ac9d-23ab4c4c4fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:22.757668 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec01f772-6291-48b0-ac9d-23ab4c4c4fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:22.768375 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5cad90-929e-419b-b36f-cee7c8e30364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:22.775326 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5cad90-929e-419b-b36f-cee7c8e30364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1699b2d0-16ce-4d4b-9cb5-29ff7597c6d8', 'volume_name': 'volume-1699b2d0-16ce-4d4b-9cb5-29ff7597c6d8', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:22.780625 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3971fa36-6e20-438a-b3af-601804790643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:22.785251 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3971fa36-6e20-438a-b3af-601804790643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:22.790148 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b721c0f-25d5-4b6f-8edb-35866f1734b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:22.791907 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Volume 1699b2d0-16ce-4d4b-9cb5-29ff7597c6d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1699b2d0-16ce-4d4b-9cb5-29ff7597c6d8', 'volume_size': 1} Feb 19 21:16:22.793003 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] creating volume 'volume-1699b2d0-16ce-4d4b-9cb5-29ff7597c6d8' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:16:22.794264 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:22.948298 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:16:22.948581 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:16:22.953833 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b721c0f-25d5-4b6f-8edb-35866f1734b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1699b2d0-16ce-4d4b-9cb5-29ff7597c6d8', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:22.964239 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ee39ca-6eef-4ff1-a971-0186358b20f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:22.990409 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Volume volume-1699b2d0-16ce-4d4b-9cb5-29ff7597c6d8 (1699b2d0-16ce-4d4b-9cb5-29ff7597c6d8): created successfully Feb 19 21:16:22.994821 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ee39ca-6eef-4ff1-a971-0186358b20f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:23.005336 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Flow 'volume_create_manager' (1dcf4a55-af12-494d-ae09-cf81b5a5db5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:23.021672 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ba7da81d-c39d-48b2-b407-580e906e86f5 tempest-VolumesActionsTest-1474651639 None] Created volume successfully. Feb 19 21:16:24.677062 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-8e8f4c8e-4c8b-4435-865c-d3c1a3c9a37e tempest-VolumesActionsTest-1474651639 None] Lock "b'cinder-1699b2d0-16ce-4d4b-9cb5-29ff7597c6d8-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:16:24.723701 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8e8f4c8e-4c8b-4435-865c-d3c1a3c9a37e tempest-VolumesActionsTest-1474651639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:24.820389 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8e8f4c8e-4c8b-4435-865c-d3c1a3c9a37e tempest-VolumesActionsTest-1474651639 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:16:24.820842 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8e8f4c8e-4c8b-4435-865c-d3c1a3c9a37e tempest-VolumesActionsTest-1474651639 None] Volume volume-1699b2d0-16ce-4d4b-9cb5-29ff7597c6d8 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:16:24.829763 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8e8f4c8e-4c8b-4435-865c-d3c1a3c9a37e tempest-VolumesActionsTest-1474651639 None] deleting rbd volume volume-1699b2d0-16ce-4d4b-9cb5-29ff7597c6d8 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:16:25.351434 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-8e8f4c8e-4c8b-4435-865c-d3c1a3c9a37e tempest-VolumesActionsTest-1474651639 None] Created reservations ['3457ab63-6c2d-42a5-938c-3bf268fe3298', '5c480b1c-6c13-4b8c-aa25-3f7d44c78deb', 'b9a0f660-e49b-4fd3-8340-360ac12d5a7b', '70b32821-3702-43af-b0dc-86dfcadd813d'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:16:25.483291 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8e8f4c8e-4c8b-4435-865c-d3c1a3c9a37e tempest-VolumesActionsTest-1474651639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:25.582493 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8e8f4c8e-4c8b-4435-865c-d3c1a3c9a37e tempest-VolumesActionsTest-1474651639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:25.653528 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-8e8f4c8e-4c8b-4435-865c-d3c1a3c9a37e tempest-VolumesActionsTest-1474651639 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:16:25.677826 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8e8f4c8e-4c8b-4435-865c-d3c1a3c9a37e tempest-VolumesActionsTest-1474651639 None] Deleted volume successfully. Feb 19 21:16:25.712547 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-8e8f4c8e-4c8b-4435-865c-d3c1a3c9a37e tempest-VolumesActionsTest-1474651639 None] Lock "b'cinder-1699b2d0-16ce-4d4b-9cb5-29ff7597c6d8-delete_volume'" released by "delete_volume" :: held 1.035s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:16:26.339557 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-dbd624f6-7fcb-4d9f-90fc-12831d0ff1b8 tempest-VolumesActionsTest-1474651639 None] Lock "b'cinder-9a40e792-dd6d-45d3-83d8-ca057a370edb-delete_volume'" acquired by "delete_volume" :: waited 0.058s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:16:26.527327 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dbd624f6-7fcb-4d9f-90fc-12831d0ff1b8 tempest-VolumesActionsTest-1474651639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:26.736750 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dbd624f6-7fcb-4d9f-90fc-12831d0ff1b8 tempest-VolumesActionsTest-1474651639 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:16:26.738684 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dbd624f6-7fcb-4d9f-90fc-12831d0ff1b8 tempest-VolumesActionsTest-1474651639 None] Volume volume-9a40e792-dd6d-45d3-83d8-ca057a370edb is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:16:26.745071 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dbd624f6-7fcb-4d9f-90fc-12831d0ff1b8 tempest-VolumesActionsTest-1474651639 None] deleting rbd volume volume-9a40e792-dd6d-45d3-83d8-ca057a370edb {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:16:27.277838 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-dbd624f6-7fcb-4d9f-90fc-12831d0ff1b8 tempest-VolumesActionsTest-1474651639 None] Created reservations ['e49de423-bc95-4d8f-b5b9-ed931b05ff2f', 'f2b9fdd9-667b-41b4-90a8-5282a6f2fd1c', '3f59e8a1-b4ed-41ea-9b0d-39ddc6eabcae', 'cb49508b-cc41-47dd-aefd-628bd3a4b570'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:16:27.382829 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dbd624f6-7fcb-4d9f-90fc-12831d0ff1b8 tempest-VolumesActionsTest-1474651639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:27.484267 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dbd624f6-7fcb-4d9f-90fc-12831d0ff1b8 tempest-VolumesActionsTest-1474651639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:27.602234 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-dbd624f6-7fcb-4d9f-90fc-12831d0ff1b8 tempest-VolumesActionsTest-1474651639 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:16:27.617415 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-dbd624f6-7fcb-4d9f-90fc-12831d0ff1b8 tempest-VolumesActionsTest-1474651639 None] Deleted volume successfully. Feb 19 21:16:27.637026 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-dbd624f6-7fcb-4d9f-90fc-12831d0ff1b8 tempest-VolumesActionsTest-1474651639 None] Lock "b'cinder-9a40e792-dd6d-45d3-83d8-ca057a370edb-delete_volume'" released by "delete_volume" :: held 1.298s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:16:39.505674 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:16:39.512438 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:16:39.513332 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:16:39.544274 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Flow 'volume_create_manager' (b553186e-6370-4d89-b45d-c4c047653900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:39.560825 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a299d4-a027-4b89-b0fe-da09660fd664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:39.569159 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:16:39.590123 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a299d4-a027-4b89-b0fe-da09660fd664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-2000743921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7b79b82a-e264-4ba9-85ff-025343a3ea6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485f24939ca34525a63e45e52f4d8cfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:16:39Z,use_quota=True,user_id='73abd5e75b5e4f549e59660ee17226c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:39.601750 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8220ce9-1682-43e5-a336-35bfddaf2b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:39.609941 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8220ce9-1682-43e5-a336-35bfddaf2b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:39.617161 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cae6030-d7a4-4f35-9ad8-e013458741d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:39.630510 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cae6030-d7a4-4f35-9ad8-e013458741d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b79b82a-e264-4ba9-85ff-025343a3ea6d', 'volume_name': 'volume-7b79b82a-e264-4ba9-85ff-025343a3ea6d', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:39.638111 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4964523-91e1-4218-beee-fc3bfa3be622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:39.645931 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4964523-91e1-4218-beee-fc3bfa3be622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:39.652822 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893934e6-ec57-46a7-8541-ab9b942b6485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:39.655112 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Volume 7b79b82a-e264-4ba9-85ff-025343a3ea6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b79b82a-e264-4ba9-85ff-025343a3ea6d', 'volume_size': 1} Feb 19 21:16:39.655732 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] creating volume 'volume-7b79b82a-e264-4ba9-85ff-025343a3ea6d' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:16:39.657421 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:39.846958 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:16:39.847319 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:16:39.851969 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893934e6-ec57-46a7-8541-ab9b942b6485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b79b82a-e264-4ba9-85ff-025343a3ea6d', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:39.867009 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5d6733-4ef2-44ca-a5b0-f3360b5421c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:39.901114 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Volume volume-7b79b82a-e264-4ba9-85ff-025343a3ea6d (7b79b82a-e264-4ba9-85ff-025343a3ea6d): created successfully Feb 19 21:16:39.911448 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5d6733-4ef2-44ca-a5b0-f3360b5421c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:39.922936 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Flow 'volume_create_manager' (b553186e-6370-4d89-b45d-c4c047653900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:39.938592 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-05a33718-4662-4bcf-9c4f-08fc796390b5 tempest-VolumesBackupsAdminTest-588090949 None] Created volume successfully. Feb 19 21:16:40.985655 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-176f1edc-3ecb-4ec6-bc60-fe848c4dd00b tempest-VolumesBackupsAdminTest-588090949 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-19T21:16:40Z,data_timestamp=2022-02-19T21:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1271261638',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=3f130c1c-0507-4751-9f60-5b0e437ac9ba,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='485f24939ca34525a63e45e52f4d8cfa',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='73abd5e75b5e4f549e59660ee17226c4',volume_id=7b79b82a-e264-4ba9-85ff-025343a3ea6d) Feb 19 21:16:40.987274 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.backup.rpcapi [None req-176f1edc-3ecb-4ec6-bc60-fe848c4dd00b tempest-VolumesBackupsAdminTest-588090949 None] continue_backup in rpcapi backup_id 3f130c1c-0507-4751-9f60-5b0e437ac9ba {{(pid=129319) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 19 21:16:41.228259 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-176f1edc-3ecb-4ec6-bc60-fe848c4dd00b tempest-VolumesBackupsAdminTest-588090949 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:16:42.485674 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-176f1edc-3ecb-4ec6-bc60-fe848c4dd00b tempest-VolumesBackupsAdminTest-588090949 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.257s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:16:42.486721 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-176f1edc-3ecb-4ec6-bc60-fe848c4dd00b tempest-VolumesBackupsAdminTest-588090949 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7b79b82a-e264-4ba9-85ff-025343a3ea6d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '7b79b82a-e264-4ba9-85ff-025343a3ea6d', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:16:42.514596 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-176f1edc-3ecb-4ec6-bc60-fe848c4dd00b tempest-VolumesBackupsAdminTest-588090949 None] Initialize volume connection completed successfully. Feb 19 21:16:45.014882 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-176f1edc-3ecb-4ec6-bc60-fe848c4dd00b tempest-VolumesBackupsAdminTest-588090949 None] Terminate volume connection completed successfully. Feb 19 21:16:45.063817 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-176f1edc-3ecb-4ec6-bc60-fe848c4dd00b tempest-VolumesBackupsAdminTest-588090949 None] Remove volume export completed successfully. Feb 19 21:16:48.447180 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:16:48.471740 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:16:48.472918 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:16:48.554449 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Flow 'volume_create_manager' (935f6fad-c0f3-4cc9-a73b-8b6b39871b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:48.569228 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd841c3a-fe06-436d-9cd4-e4a249e93f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:48.587530 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:16:48.610850 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd841c3a-fe06-436d-9cd4-e4a249e93f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:16:48Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_3f130c1c-0507-4751-9f60-5b0e437ac9ba',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4d42190d-741e-4833-8730-d3d6028bd7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485f24939ca34525a63e45e52f4d8cfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:16:48Z,use_quota=True,user_id='73abd5e75b5e4f549e59660ee17226c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:48.632699 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3cf31c-c55d-429e-8566-0ac744afe164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:48.645721 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3cf31c-c55d-429e-8566-0ac744afe164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:48.657748 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f3c0ef-8dff-4393-9320-e0f070890a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:48.675094 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f3c0ef-8dff-4393-9320-e0f070890a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d42190d-741e-4833-8730-d3d6028bd7d3', 'volume_name': 'volume-4d42190d-741e-4833-8730-d3d6028bd7d3', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:48.690361 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171a3b80-c1fb-456f-beaa-ee807b684765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:48.699547 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171a3b80-c1fb-456f-beaa-ee807b684765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:48.715476 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d008bb1-c2e5-43eb-8216-e25c530ffd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:48.718786 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Volume 4d42190d-741e-4833-8730-d3d6028bd7d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d42190d-741e-4833-8730-d3d6028bd7d3', 'volume_size': 1} Feb 19 21:16:48.719196 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] creating volume 'volume-4d42190d-741e-4833-8730-d3d6028bd7d3' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:16:48.723044 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:48.843374 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:16:48.844457 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:16:48.850980 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d008bb1-c2e5-43eb-8216-e25c530ffd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d42190d-741e-4833-8730-d3d6028bd7d3', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:48.873800 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e76e23-efad-4ce8-8b13-95a050aebf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:48.898835 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Volume volume-4d42190d-741e-4833-8730-d3d6028bd7d3 (4d42190d-741e-4833-8730-d3d6028bd7d3): created successfully Feb 19 21:16:48.907071 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e76e23-efad-4ce8-8b13-95a050aebf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:48.929074 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Flow 'volume_create_manager' (935f6fad-c0f3-4cc9-a73b-8b6b39871b14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:48.956086 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Created volume successfully. Feb 19 21:16:49.567786 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:16:50.612148 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.044s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:16:50.613145 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4d42190d-741e-4833-8730-d3d6028bd7d3', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '4d42190d-741e-4833-8730-d3d6028bd7d3', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:16:50.645209 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Initialize volume connection completed successfully. Feb 19 21:16:52.058971 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Terminate volume connection completed successfully. Feb 19 21:16:52.130131 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ed168719-b98a-4db1-8c3d-ea0b13f7ae98 tempest-VolumesBackupsAdminTest-588090949 None] Remove volume export completed successfully. Feb 19 21:16:52.984025 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-e283c7b2-40de-49a0-8dc6-95f116fa25be tempest-VolumesBackupsAdminTest-588090949 None] Lock "b'cinder-4d42190d-741e-4833-8730-d3d6028bd7d3-delete_volume'" acquired by "delete_volume" :: waited 0.105s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:16:53.077455 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e283c7b2-40de-49a0-8dc6-95f116fa25be tempest-VolumesBackupsAdminTest-588090949 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:53.693628 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e283c7b2-40de-49a0-8dc6-95f116fa25be tempest-VolumesBackupsAdminTest-588090949 None] Volume volume-4d42190d-741e-4833-8730-d3d6028bd7d3 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:16:53.717398 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e283c7b2-40de-49a0-8dc6-95f116fa25be tempest-VolumesBackupsAdminTest-588090949 None] deleting rbd volume volume-4d42190d-741e-4833-8730-d3d6028bd7d3 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:16:54.131122 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-e283c7b2-40de-49a0-8dc6-95f116fa25be tempest-VolumesBackupsAdminTest-588090949 None] Created reservations ['dd4a2ae8-7333-4943-8a5d-4c130e8f07a0', '0ad5e6d6-7873-41df-a973-8e47659fc986', '4015e0f8-8640-4d4a-b08c-13c2e404c178', '8312053f-8c1f-4c31-9516-a44fdb9808e5'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:16:54.257513 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e283c7b2-40de-49a0-8dc6-95f116fa25be tempest-VolumesBackupsAdminTest-588090949 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:54.344080 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e283c7b2-40de-49a0-8dc6-95f116fa25be tempest-VolumesBackupsAdminTest-588090949 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:54.411133 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-e283c7b2-40de-49a0-8dc6-95f116fa25be tempest-VolumesBackupsAdminTest-588090949 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:16:54.420581 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-e283c7b2-40de-49a0-8dc6-95f116fa25be tempest-VolumesBackupsAdminTest-588090949 None] Deleted volume successfully. Feb 19 21:16:54.439503 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-e283c7b2-40de-49a0-8dc6-95f116fa25be tempest-VolumesBackupsAdminTest-588090949 None] Lock "b'cinder-4d42190d-741e-4833-8730-d3d6028bd7d3-delete_volume'" released by "delete_volume" :: held 1.456s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:16:56.903895 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:16:56.909692 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:16:56.910574 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:16:56.937597 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Flow 'volume_create_manager' (54fd5fe1-fbb0-442c-8005-15bb610ed95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:56.945980 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f038ebd0-8b5c-4831-be27-01079642c8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:56.957902 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:16:56.980104 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f038ebd0-8b5c-4831-be27-01079642c8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-50328159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ff8d82f1-155e-46d0-80f9-d03d972d6568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485f24939ca34525a63e45e52f4d8cfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:16:57Z,use_quota=True,user_id='73abd5e75b5e4f549e59660ee17226c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:56.990490 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71def4d8-a2e0-408a-ab8b-530ffe90c7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:56.999929 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71def4d8-a2e0-408a-ab8b-530ffe90c7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:57.007783 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f817c411-81e3-4e02-bbf0-0bdb7616c3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:57.014060 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f817c411-81e3-4e02-bbf0-0bdb7616c3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff8d82f1-155e-46d0-80f9-d03d972d6568', 'volume_name': 'volume-ff8d82f1-155e-46d0-80f9-d03d972d6568', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:57.020344 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68da258f-b935-4ccc-b336-85e8ad9f631a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:57.025760 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68da258f-b935-4ccc-b336-85e8ad9f631a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:57.031752 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b7cb7e-7f8d-44de-b166-98fd87157444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:57.033190 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Volume ff8d82f1-155e-46d0-80f9-d03d972d6568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff8d82f1-155e-46d0-80f9-d03d972d6568', 'volume_size': 1} Feb 19 21:16:57.033761 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] creating volume 'volume-ff8d82f1-155e-46d0-80f9-d03d972d6568' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:16:57.035291 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:16:57.226029 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:16:57.226622 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:16:57.230707 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b7cb7e-7f8d-44de-b166-98fd87157444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff8d82f1-155e-46d0-80f9-d03d972d6568', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:57.240933 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65163411-9342-4013-b8b0-f502806de377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:16:57.259266 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Volume volume-ff8d82f1-155e-46d0-80f9-d03d972d6568 (ff8d82f1-155e-46d0-80f9-d03d972d6568): created successfully Feb 19 21:16:57.263170 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65163411-9342-4013-b8b0-f502806de377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:16:57.274179 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Flow 'volume_create_manager' (54fd5fe1-fbb0-442c-8005-15bb610ed95f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:16:57.293759 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-4cf21a30-f157-4025-9831-77bc73d58f09 tempest-VolumesBackupsAdminTest-588090949 None] Created volume successfully. Feb 19 21:16:58.333544 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d1cda4db-4c5f-4c16-aef0-f7affabcefe2 tempest-VolumesBackupsAdminTest-588090949 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-19T21:16:58Z,data_timestamp=2022-02-19T21:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-977686304',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=ce63ae77-dd24-45b6-a29a-042128e43237,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='485f24939ca34525a63e45e52f4d8cfa',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='73abd5e75b5e4f549e59660ee17226c4',volume_id=ff8d82f1-155e-46d0-80f9-d03d972d6568) Feb 19 21:16:58.334365 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.backup.rpcapi [None req-d1cda4db-4c5f-4c16-aef0-f7affabcefe2 tempest-VolumesBackupsAdminTest-588090949 None] continue_backup in rpcapi backup_id ce63ae77-dd24-45b6-a29a-042128e43237 {{(pid=129319) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 19 21:16:58.657681 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-d1cda4db-4c5f-4c16-aef0-f7affabcefe2 tempest-VolumesBackupsAdminTest-588090949 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:16:59.913820 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-d1cda4db-4c5f-4c16-aef0-f7affabcefe2 tempest-VolumesBackupsAdminTest-588090949 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.256s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:16:59.914844 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d1cda4db-4c5f-4c16-aef0-f7affabcefe2 tempest-VolumesBackupsAdminTest-588090949 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ff8d82f1-155e-46d0-80f9-d03d972d6568', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'ff8d82f1-155e-46d0-80f9-d03d972d6568', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:16:59.959839 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d1cda4db-4c5f-4c16-aef0-f7affabcefe2 tempest-VolumesBackupsAdminTest-588090949 None] Initialize volume connection completed successfully. Feb 19 21:17:01.810152 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d1cda4db-4c5f-4c16-aef0-f7affabcefe2 tempest-VolumesBackupsAdminTest-588090949 None] Terminate volume connection completed successfully. Feb 19 21:17:01.863544 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d1cda4db-4c5f-4c16-aef0-f7affabcefe2 tempest-VolumesBackupsAdminTest-588090949 None] Remove volume export completed successfully. Feb 19 21:17:05.021879 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-b8b97266-1e4c-45cb-a309-d76f455e8eb2 tempest-VolumesBackupsAdminTest-588090949 None] Lock "b'cinder-ff8d82f1-155e-46d0-80f9-d03d972d6568-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:17:05.105946 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b8b97266-1e4c-45cb-a309-d76f455e8eb2 tempest-VolumesBackupsAdminTest-588090949 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:06.312984 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b8b97266-1e4c-45cb-a309-d76f455e8eb2 tempest-VolumesBackupsAdminTest-588090949 None] Volume volume-ff8d82f1-155e-46d0-80f9-d03d972d6568 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:17:06.343041 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b8b97266-1e4c-45cb-a309-d76f455e8eb2 tempest-VolumesBackupsAdminTest-588090949 None] deleting rbd volume volume-ff8d82f1-155e-46d0-80f9-d03d972d6568 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:17:06.887007 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-b8b97266-1e4c-45cb-a309-d76f455e8eb2 tempest-VolumesBackupsAdminTest-588090949 None] Created reservations ['7b1e97c5-26f5-46ad-8c66-c8b93be15d09', '572966aa-5bb2-4d3d-a321-e5ef94476ee4', '95526ac1-8a18-4068-84c5-d21d89bf228a', '41b387fc-3f54-4c2b-baab-d2a037b50e15'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:17:06.970131 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b8b97266-1e4c-45cb-a309-d76f455e8eb2 tempest-VolumesBackupsAdminTest-588090949 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:07.039309 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b8b97266-1e4c-45cb-a309-d76f455e8eb2 tempest-VolumesBackupsAdminTest-588090949 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:07.098568 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-b8b97266-1e4c-45cb-a309-d76f455e8eb2 tempest-VolumesBackupsAdminTest-588090949 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:17:07.103411 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b8b97266-1e4c-45cb-a309-d76f455e8eb2 tempest-VolumesBackupsAdminTest-588090949 None] Deleted volume successfully. Feb 19 21:17:07.123782 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-b8b97266-1e4c-45cb-a309-d76f455e8eb2 tempest-VolumesBackupsAdminTest-588090949 None] Lock "b'cinder-ff8d82f1-155e-46d0-80f9-d03d972d6568-delete_volume'" released by "delete_volume" :: held 2.101s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:17:07.370888 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-dc49e085-1b36-48a3-bd6c-4a41706e67ca tempest-VolumesBackupsAdminTest-588090949 None] Lock "b'cinder-7b79b82a-e264-4ba9-85ff-025343a3ea6d-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:17:07.455225 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dc49e085-1b36-48a3-bd6c-4a41706e67ca tempest-VolumesBackupsAdminTest-588090949 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:08.601268 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dc49e085-1b36-48a3-bd6c-4a41706e67ca tempest-VolumesBackupsAdminTest-588090949 None] Volume volume-7b79b82a-e264-4ba9-85ff-025343a3ea6d is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:17:08.648387 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dc49e085-1b36-48a3-bd6c-4a41706e67ca tempest-VolumesBackupsAdminTest-588090949 None] deleting rbd volume volume-7b79b82a-e264-4ba9-85ff-025343a3ea6d {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:17:09.085890 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-dc49e085-1b36-48a3-bd6c-4a41706e67ca tempest-VolumesBackupsAdminTest-588090949 None] Created reservations ['8c00875d-7a65-434d-b979-774d24d994a0', 'd478627e-eb21-434a-bdd5-442d0c3e2a20', 'b21ffd29-f055-4e91-9ad4-307dd224b82d', 'b06e001a-62a3-4fa0-82bf-2966faa2b18f'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:17:09.155338 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dc49e085-1b36-48a3-bd6c-4a41706e67ca tempest-VolumesBackupsAdminTest-588090949 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:09.227838 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dc49e085-1b36-48a3-bd6c-4a41706e67ca tempest-VolumesBackupsAdminTest-588090949 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:09.297660 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-dc49e085-1b36-48a3-bd6c-4a41706e67ca tempest-VolumesBackupsAdminTest-588090949 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:17:09.302376 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-dc49e085-1b36-48a3-bd6c-4a41706e67ca tempest-VolumesBackupsAdminTest-588090949 None] Deleted volume successfully. Feb 19 21:17:09.330801 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-dc49e085-1b36-48a3-bd6c-4a41706e67ca tempest-VolumesBackupsAdminTest-588090949 None] Lock "b'cinder-7b79b82a-e264-4ba9-85ff-025343a3ea6d-delete_volume'" released by "delete_volume" :: held 1.959s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:17:21.615297 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:17:21.625877 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:17:21.626838 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:17:21.659660 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Flow 'volume_create_manager' (0d027a68-5e56-4599-9707-82a5934558e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:17:21.666444 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6cfdb4-ae10-422d-9764-47d20e67e3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:21.674227 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:17:21.692828 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6cfdb4-ae10-422d-9764-47d20e67e3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1588531879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=128ec065-f9bf-4822-9077-922aa7db4786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33e2b5cc01d46e0aaf008fe66c51942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:17:22Z,use_quota=True,user_id='97f800f04d0b4857accfe52c51edf4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:21.700425 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3d3c8f-6af1-4982-8d93-a01f9bdcf6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:21.705526 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3d3c8f-6af1-4982-8d93-a01f9bdcf6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:21.710830 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f731a49-ac6e-40ea-a609-4162494ee79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:21.718681 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f731a49-ac6e-40ea-a609-4162494ee79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '128ec065-f9bf-4822-9077-922aa7db4786', 'volume_name': 'volume-128ec065-f9bf-4822-9077-922aa7db4786', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:21.723884 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f5bc80-8898-4663-a3d0-b72e539639bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:21.728159 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f5bc80-8898-4663-a3d0-b72e539639bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:21.733706 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc5014f-1f11-4aec-b36c-c65bde334353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:21.735075 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Volume 128ec065-f9bf-4822-9077-922aa7db4786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-128ec065-f9bf-4822-9077-922aa7db4786', 'volume_size': 1} Feb 19 21:17:21.735685 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] creating volume 'volume-128ec065-f9bf-4822-9077-922aa7db4786' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:17:21.736909 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:21.861945 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:17:21.862644 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:17:21.866547 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc5014f-1f11-4aec-b36c-c65bde334353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-128ec065-f9bf-4822-9077-922aa7db4786', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:21.879907 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e41ff17-ffd4-48a3-9473-488ae07dfc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:21.904711 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Volume volume-128ec065-f9bf-4822-9077-922aa7db4786 (128ec065-f9bf-4822-9077-922aa7db4786): created successfully Feb 19 21:17:21.908913 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e41ff17-ffd4-48a3-9473-488ae07dfc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:21.914671 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Flow 'volume_create_manager' (0d027a68-5e56-4599-9707-82a5934558e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:17:21.943625 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-31446135-3bd3-45db-907a-63e640d9d0ed tempest-VolumesDeleteCascade-39421755 None] Created volume successfully. Feb 19 21:17:22.183225 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:17:22.184507 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:22.255630 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:22.323818 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:17:23.132121 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-217de52b-3baa-45b3-8303-ea97085c0301 tempest-VolumesDeleteCascade-39421755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:23.691127 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-217de52b-3baa-45b3-8303-ea97085c0301 tempest-VolumesDeleteCascade-39421755 None] Create snapshot completed successfully Feb 19 21:17:24.599888 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-43ad0ac6-5fd5-43ea-ae1b-762a48f87353 tempest-VolumesDeleteCascade-39421755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:25.785563 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-43ad0ac6-5fd5-43ea-ae1b-762a48f87353 tempest-VolumesDeleteCascade-39421755 None] Create snapshot completed successfully Feb 19 21:17:26.791637 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Lock "b'cinder-128ec065-f9bf-4822-9077-922aa7db4786-delete_volume'" acquired by "delete_volume" :: waited 0.042s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:17:26.858251 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Performing cascade delete. {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/manager.py:959}} Feb 19 21:17:26.883061 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Lock "b'cinder-01fad682-6b0d-400e-a4d4-e989db56d41e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:17:26.896699 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:27.861054 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Created reservations ['d0e711c4-2621-49e7-a05d-9a9d250c2503', '9667a5d0-9440-4ae5-850f-360aba43145c', '2a60d5d8-bffd-4941-920b-fc8b6ab48cf3', '040fd04e-c7f7-488b-a0f8-f404aaa72e50'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:17:27.950243 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Delete snapshot completed successfully. Feb 19 21:17:27.960050 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Lock "b'cinder-01fad682-6b0d-400e-a4d4-e989db56d41e-delete_snapshot'" released by "delete_snapshot" :: held 1.076s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:17:27.986732 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Lock "b'cinder-5f0a792b-2523-45b6-85ef-f371e75e0a25-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.024s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:17:28.009719 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:28.892203 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Created reservations ['e529b16b-f0d4-4051-ad0e-079fa2aa73f9', '5b7cc2f8-90f9-42ce-9ccd-131a2f5eaead', 'e0f71c3f-6b65-42e2-9dd3-7110af94534a', 'b0e03d54-fb0d-441c-8ebd-bcfe15d893e5'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:17:28.981414 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Delete snapshot completed successfully. Feb 19 21:17:28.993566 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Lock "b'cinder-5f0a792b-2523-45b6-85ef-f371e75e0a25-delete_snapshot'" released by "delete_snapshot" :: held 1.007s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:17:28.994260 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Snapshots deleted, issuing volume delete {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/manager.py:974}} Feb 19 21:17:28.996227 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:29.101959 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:17:29.104717 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Volume volume-128ec065-f9bf-4822-9077-922aa7db4786 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:17:29.122773 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] deleting rbd volume volume-128ec065-f9bf-4822-9077-922aa7db4786 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:17:29.756053 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Created reservations ['f37d27d2-59bf-48b6-957b-7d8e04d460c9', '259b6078-277f-48fa-87d2-9781528a9da1', 'd0bd7081-9401-47c4-a7be-b68eb33f31ad', '4779d8da-8fb3-4117-9d9e-53c0ce4c0ac8'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:17:29.911445 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:29.987676 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:30.054058 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:17:30.077284 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Deleted volume successfully. Feb 19 21:17:30.109093 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-97e24cf8-2c39-42fe-8952-08d1d6ffbe2d tempest-VolumesDeleteCascade-39421755 None] Lock "b'cinder-128ec065-f9bf-4822-9077-922aa7db4786-delete_volume'" released by "delete_volume" :: held 3.317s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:17:34.395787 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:17:34.399589 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:17:34.400040 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:17:34.438749 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Flow 'volume_create_manager' (2ecd5006-a853-4fc7-b289-31c7dbf6ac90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:17:34.447647 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb4607b-1a12-462d-911d-93048199df75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:34.462985 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:17:34.500121 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb4607b-1a12-462d-911d-93048199df75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1516743756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e37b0553-5a9a-4534-8912-efaf08311012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e95d3ca072e4ac99e011676d8376673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:17:34Z,use_quota=True,user_id='84aa8d234d4f476093aaa1367703886d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:34.508854 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa274106-6293-4c6e-9acb-ba15f4c19f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:34.524853 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa274106-6293-4c6e-9acb-ba15f4c19f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:34.532777 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6105eddf-34c2-4130-9e11-59e483b62df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:34.694357 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6105eddf-34c2-4130-9e11-59e483b62df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e37b0553-5a9a-4534-8912-efaf08311012', 'volume_name': 'volume-e37b0553-5a9a-4534-8912-efaf08311012', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:34.701428 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8a7b32-da98-418f-9bdf-efc19468b016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:34.707590 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8a7b32-da98-418f-9bdf-efc19468b016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:34.713035 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db28dfc1-d55d-4bf7-a419-e289a8ec2c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:34.714464 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Volume e37b0553-5a9a-4534-8912-efaf08311012: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e37b0553-5a9a-4534-8912-efaf08311012', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 21:17:34.715272 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Cloning e37b0553-5a9a-4534-8912-efaf08311012 from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 21:17:34.734273 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.018s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:17:34.760594 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 17, 34, 742126)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:17:34.761392 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:17:34.762008 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Found cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 19 21:17:34.768070 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 0.034s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:17:34.769642 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 21:17:34.776385 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 17, 34, 773805)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:17:34.777273 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:17:34.778061 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Creating from source image-volume d609c16c-1e31-4237-8163-d85a8fcc768b {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 19 21:17:34.793295 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:34.955755 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] creating snapshot='volume-e37b0553-5a9a-4534-8912-efaf08311012.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:17:35.710422 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] cloning 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b@volume-e37b0553-5a9a-4534-8912-efaf08311012.clone_snap' to 'volume-e37b0553-5a9a-4534-8912-efaf08311012' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:17:35.982962 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71.deleted is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:17:35.984266 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:17:35.985618 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:17:36.034873 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:17:36.035806 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Marking volume e37b0553-5a9a-4534-8912-efaf08311012 as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:17:36.057253 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to e37b0553-5a9a-4534-8912-efaf08311012. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 21:17:36.058046 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Creating volume glance metadata for volume e37b0553-5a9a-4534-8912-efaf08311012 backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 21:17:36.237802 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db28dfc1-d55d-4bf7-a419-e289a8ec2c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37b0553-5a9a-4534-8912-efaf08311012', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:36.261492 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c786732-c64b-4309-b24c-18156234776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:36.291976 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Volume volume-e37b0553-5a9a-4534-8912-efaf08311012 (e37b0553-5a9a-4534-8912-efaf08311012): created successfully Feb 19 21:17:36.311520 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c786732-c64b-4309-b24c-18156234776d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:36.323696 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Flow 'volume_create_manager' (2ecd5006-a853-4fc7-b289-31c7dbf6ac90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:17:36.369389 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-4cde8f74-d032-4a44-98c0-fbe64c973d10 tempest-VolumesExtendTest-535254909 None] Created volume successfully. Feb 19 21:17:36.815017 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-936bf144-e58d-4b4a-b4bc-121aa980b6fb tempest-VolumesExtendTest-535254909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:37.072578 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-936bf144-e58d-4b4a-b4bc-121aa980b6fb tempest-VolumesExtendTest-535254909 None] Extend volume from 1 GB to 2 GB. {{(pid=129319) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Feb 19 21:17:37.125167 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-936bf144-e58d-4b4a-b4bc-121aa980b6fb tempest-VolumesExtendTest-535254909 None] Extend volume completed successfully. Feb 19 21:17:38.799255 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:17:38.811004 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:17:38.811604 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:17:38.848299 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Flow 'volume_create_manager' (375781a6-9853-44e5-8f7a-26fbdd4ae39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:17:38.858262 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3688e5d4-3a80-4013-95b4-c1b333868cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:38.867885 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:17:38.889968 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3688e5d4-3a80-4013-95b4-c1b333868cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-436968729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=358f1d36-c5e0-446a-8a66-9fd194132ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e95d3ca072e4ac99e011676d8376673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:17:39Z,use_quota=True,user_id='84aa8d234d4f476093aaa1367703886d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:38.899424 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60355137-f3c9-42e6-bd7d-bdec33685d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:38.906005 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60355137-f3c9-42e6-bd7d-bdec33685d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:38.913730 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32143278-3c0a-4834-873f-e030a8734474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:38.919713 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32143278-3c0a-4834-873f-e030a8734474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '358f1d36-c5e0-446a-8a66-9fd194132ccb', 'volume_name': 'volume-358f1d36-c5e0-446a-8a66-9fd194132ccb', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:38.925881 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f26e31-384d-4c09-9d68-dc78adb304a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:38.931904 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f26e31-384d-4c09-9d68-dc78adb304a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:38.940658 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c50863e-9dcc-4ff1-ab3a-653104812780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:38.942092 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Volume 358f1d36-c5e0-446a-8a66-9fd194132ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-358f1d36-c5e0-446a-8a66-9fd194132ccb', 'volume_size': 1} Feb 19 21:17:38.942637 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] creating volume 'volume-358f1d36-c5e0-446a-8a66-9fd194132ccb' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:17:38.944627 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:39.059018 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:17:39.059938 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:17:39.065218 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c50863e-9dcc-4ff1-ab3a-653104812780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-358f1d36-c5e0-446a-8a66-9fd194132ccb', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:39.074288 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb0a1bb-c7af-4e42-b65c-435cb652d997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:17:39.089964 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Volume volume-358f1d36-c5e0-446a-8a66-9fd194132ccb (358f1d36-c5e0-446a-8a66-9fd194132ccb): created successfully Feb 19 21:17:39.098889 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb0a1bb-c7af-4e42-b65c-435cb652d997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:17:39.106138 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Flow 'volume_create_manager' (375781a6-9853-44e5-8f7a-26fbdd4ae39c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:17:39.121682 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-91d6a781-93b7-4979-9c66-95c663a822da tempest-VolumesExtendTest-535254909 None] Created volume successfully. Feb 19 21:17:40.185669 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7efe1513-f274-4f99-af83-bf64c38ff8cb tempest-VolumesExtendTest-535254909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:41.441269 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-7efe1513-f274-4f99-af83-bf64c38ff8cb tempest-VolumesExtendTest-535254909 None] Create snapshot completed successfully Feb 19 21:17:42.523896 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-fe2048f6-c295-46eb-89bb-b6b356738df4 tempest-VolumesExtendTest-535254909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:42.785660 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-fe2048f6-c295-46eb-89bb-b6b356738df4 tempest-VolumesExtendTest-535254909 None] Extend volume from 1 GB to 2 GB. {{(pid=129319) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Feb 19 21:17:42.839497 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-fe2048f6-c295-46eb-89bb-b6b356738df4 tempest-VolumesExtendTest-535254909 None] Extend volume completed successfully. Feb 19 21:17:43.834360 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-0e162828-ace9-4dff-9b6d-98d34f129ccf tempest-VolumesExtendTest-535254909 None] Lock "b'cinder-f53f6919-7e92-45ce-8189-1e0041e84bbe-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:17:43.843111 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-0e162828-ace9-4dff-9b6d-98d34f129ccf tempest-VolumesExtendTest-535254909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:44.471379 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-0e162828-ace9-4dff-9b6d-98d34f129ccf tempest-VolumesExtendTest-535254909 None] Created reservations ['cddf9a93-0038-45ae-8032-f9724306dba4', '78762a84-1ac7-40fc-b1a5-0669352748b0', 'eff88aef-886b-4f32-8dc1-252e1be9c31a', '9aa498be-675a-4c26-ba93-6b1a7876c67c'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:17:44.550546 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-0e162828-ace9-4dff-9b6d-98d34f129ccf tempest-VolumesExtendTest-535254909 None] Delete snapshot completed successfully. Feb 19 21:17:44.575954 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-0e162828-ace9-4dff-9b6d-98d34f129ccf tempest-VolumesExtendTest-535254909 None] Lock "b'cinder-f53f6919-7e92-45ce-8189-1e0041e84bbe-delete_snapshot'" released by "delete_snapshot" :: held 0.744s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:17:44.995788 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-206c52de-6bc8-4482-b00c-a0849937260a tempest-VolumesExtendTest-535254909 None] Lock "b'cinder-358f1d36-c5e0-446a-8a66-9fd194132ccb-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:17:45.074416 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-206c52de-6bc8-4482-b00c-a0849937260a tempest-VolumesExtendTest-535254909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:45.147269 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-206c52de-6bc8-4482-b00c-a0849937260a tempest-VolumesExtendTest-535254909 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:17:45.147854 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-206c52de-6bc8-4482-b00c-a0849937260a tempest-VolumesExtendTest-535254909 None] Volume volume-358f1d36-c5e0-446a-8a66-9fd194132ccb is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:17:45.172133 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-206c52de-6bc8-4482-b00c-a0849937260a tempest-VolumesExtendTest-535254909 None] deleting rbd volume volume-358f1d36-c5e0-446a-8a66-9fd194132ccb {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:17:45.821020 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-206c52de-6bc8-4482-b00c-a0849937260a tempest-VolumesExtendTest-535254909 None] Created reservations ['ff233721-3819-4ab6-94de-3f6e9391d579', 'fec55f29-5153-476a-ad6f-c26ec9b46f5b', '22064fba-070f-4c99-a5b6-917d1d7a10ac', '197444f7-32c1-4c52-978e-107788e0b4a5'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:17:45.988782 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-206c52de-6bc8-4482-b00c-a0849937260a tempest-VolumesExtendTest-535254909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:46.068581 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-206c52de-6bc8-4482-b00c-a0849937260a tempest-VolumesExtendTest-535254909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:46.161407 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-206c52de-6bc8-4482-b00c-a0849937260a tempest-VolumesExtendTest-535254909 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:17:46.175189 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-206c52de-6bc8-4482-b00c-a0849937260a tempest-VolumesExtendTest-535254909 None] Deleted volume successfully. Feb 19 21:17:46.194407 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-206c52de-6bc8-4482-b00c-a0849937260a tempest-VolumesExtendTest-535254909 None] Lock "b'cinder-358f1d36-c5e0-446a-8a66-9fd194132ccb-delete_volume'" released by "delete_volume" :: held 1.199s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:17:46.269528 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-d430110f-facc-424c-8099-176efe6dbe95 tempest-VolumesExtendTest-535254909 None] Lock "b'cinder-e37b0553-5a9a-4534-8912-efaf08311012-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:17:46.351065 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d430110f-facc-424c-8099-176efe6dbe95 tempest-VolumesExtendTest-535254909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:46.484891 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d430110f-facc-424c-8099-176efe6dbe95 tempest-VolumesExtendTest-535254909 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:17:46.495228 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d430110f-facc-424c-8099-176efe6dbe95 tempest-VolumesExtendTest-535254909 None] deleting rbd volume volume-e37b0553-5a9a-4534-8912-efaf08311012 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:17:47.079151 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d430110f-facc-424c-8099-176efe6dbe95 tempest-VolumesExtendTest-535254909 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:17:47.164757 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d430110f-facc-424c-8099-176efe6dbe95 tempest-VolumesExtendTest-535254909 None] deleting parent snapshot volume-e37b0553-5a9a-4534-8912-efaf08311012.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:17:47.827987 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-d430110f-facc-424c-8099-176efe6dbe95 tempest-VolumesExtendTest-535254909 None] Created reservations ['3bcb39fb-d06e-435f-86e1-388cdf37896a', '665f7378-787f-4d37-89dd-27980ee72fe6', '1bc777f4-6cce-4bc9-a263-b0c70e1dfdbf', '6fb522bf-10dc-4d51-8b86-8d7b64d30b25'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:17:47.923524 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d430110f-facc-424c-8099-176efe6dbe95 tempest-VolumesExtendTest-535254909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:48.040377 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d430110f-facc-424c-8099-176efe6dbe95 tempest-VolumesExtendTest-535254909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:17:48.109388 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-d430110f-facc-424c-8099-176efe6dbe95 tempest-VolumesExtendTest-535254909 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:17:48.113944 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d430110f-facc-424c-8099-176efe6dbe95 tempest-VolumesExtendTest-535254909 None] Deleted volume successfully. Feb 19 21:17:48.135856 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-d430110f-facc-424c-8099-176efe6dbe95 tempest-VolumesExtendTest-535254909 None] Lock "b'cinder-e37b0553-5a9a-4534-8912-efaf08311012-delete_volume'" released by "delete_volume" :: held 1.866s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:18:22.180879 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:18:22.181778 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:18:22.231998 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:18:22.281272 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:07.416294 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b8135e5d-e9a3-4807-a44b-897db95c4b86 tempest-GroupsV320Test-1542716151 None] Group tempest-GroupsV320Test-Group-1566344399: creating Feb 19 21:19:07.456095 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b8135e5d-e9a3-4807-a44b-897db95c4b86 tempest-GroupsV320Test-1542716151 None] Group tempest-GroupsV320Test-Group-1566344399: created successfully Feb 19 21:19:07.477270 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b8135e5d-e9a3-4807-a44b-897db95c4b86 tempest-GroupsV320Test-1542716151 None] Create group completed successfully. Feb 19 21:19:07.974327 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-588f7410-1ca7-4e4c-a6a8-2b8fc4e49426 tempest-GroupSnapshotsV319Test-191809393 None] Group tempest-GroupSnapshotsV319Test-Group-664801270: creating Feb 19 21:19:08.008679 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-588f7410-1ca7-4e4c-a6a8-2b8fc4e49426 tempest-GroupSnapshotsV319Test-191809393 None] Group tempest-GroupSnapshotsV319Test-Group-664801270: created successfully Feb 19 21:19:08.019065 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-588f7410-1ca7-4e4c-a6a8-2b8fc4e49426 tempest-GroupSnapshotsV319Test-191809393 None] Create group completed successfully. Feb 19 21:19:09.059600 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-08a93f20-3293-4d31-a8ed-d9508e0ff655 tempest-GroupsV320Test-1542716151 None] Created reservations ['9fb22307-ae2e-4e8d-adb1-b9c10ab798c7'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:09.127663 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-08a93f20-3293-4d31-a8ed-d9508e0ff655 tempest-GroupsV320Test-1542716151 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:09.224462 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-08a93f20-3293-4d31-a8ed-d9508e0ff655 tempest-GroupsV320Test-1542716151 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:09.334307 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-08a93f20-3293-4d31-a8ed-d9508e0ff655 tempest-GroupsV320Test-1542716151 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:09.338944 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-08a93f20-3293-4d31-a8ed-d9508e0ff655 tempest-GroupsV320Test-1542716151 None] Delete group completed successfully. Feb 19 21:19:09.797734 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:09.802244 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:09.802890 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:09.852484 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Flow 'volume_create_manager' (5aaeb8ff-9983-40b2-a589-f7a128dd1e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:09.863987 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c119af48-9bfb-48c0-9f77-21dc564d0036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:09.873129 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:09.903531 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c119af48-9bfb-48c0-9f77-21dc564d0036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-1823348397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a07174f5-c1d8-41d9-8df5-c146224a08c8,host='ncdv-master-1@ceph#ceph',id=38c0e3f2-c157-4323-a7a9-b700d4a5dd93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637118d588ee46e5ab20e412e96a9c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:10Z,use_quota=True,user_id='db4a5b6cdc794245accceea56f14567b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39aff1bf-58b0-4396-8bfc-8e83c1203603),volume_type_id=39aff1bf-58b0-4396-8bfc-8e83c1203603)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:09.921320 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1aab5d2-1590-4aed-9121-d24052bade20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:09.934659 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1aab5d2-1590-4aed-9121-d24052bade20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:09.948399 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c38de7a-1194-452f-a742-cc2cf23af9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:09.960891 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c38de7a-1194-452f-a742-cc2cf23af9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38c0e3f2-c157-4323-a7a9-b700d4a5dd93', 'volume_name': 'volume-38c0e3f2-c157-4323-a7a9-b700d4a5dd93', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:09.977183 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9965ef-1e26-44e9-a72e-ef4d317d5c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:10.002009 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9965ef-1e26-44e9-a72e-ef4d317d5c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:10.009641 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab23e7a-89d7-4f9e-ab11-9db501ddeb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:10.012877 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Volume 38c0e3f2-c157-4323-a7a9-b700d4a5dd93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38c0e3f2-c157-4323-a7a9-b700d4a5dd93', 'volume_size': 1} Feb 19 21:19:10.013835 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] creating volume 'volume-38c0e3f2-c157-4323-a7a9-b700d4a5dd93' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:19:10.015291 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:10.171855 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] extra_specs: {} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:10.172590 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] extra_specs: {} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:10.176497 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab23e7a-89d7-4f9e-ab11-9db501ddeb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c0e3f2-c157-4323-a7a9-b700d4a5dd93', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:10.186472 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77943dc-9216-47f7-b7da-4a5fbe0eefcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:10.218056 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Volume volume-38c0e3f2-c157-4323-a7a9-b700d4a5dd93 (38c0e3f2-c157-4323-a7a9-b700d4a5dd93): created successfully Feb 19 21:19:10.228012 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77943dc-9216-47f7-b7da-4a5fbe0eefcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:10.247090 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Flow 'volume_create_manager' (5aaeb8ff-9983-40b2-a589-f7a128dd1e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:10.276178 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-afdb247e-4ec0-4b13-98e9-230873cc2385 tempest-GroupSnapshotsV319Test-191809393 None] Created volume successfully. Feb 19 21:19:11.203890 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-fcd14d1a-d309-431b-9573-8789d0ac88e4 tempest-GroupSnapshotsV319Test-191809393 None] GroupSnapshot 2186973f-8796-4551-9094-4b640fa0cf25: creating. Feb 19 21:19:11.232721 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-fcd14d1a-d309-431b-9573-8789d0ac88e4 tempest-GroupSnapshotsV319Test-191809393 None] Group snapshot 2186973f-8796-4551-9094-4b640fa0cf25: creating. {{(pid=129319) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Feb 19 21:19:11.267815 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-fcd14d1a-d309-431b-9573-8789d0ac88e4 tempest-GroupSnapshotsV319Test-191809393 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:12.606539 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-fcd14d1a-d309-431b-9573-8789d0ac88e4 tempest-GroupSnapshotsV319Test-191809393 None] group_snapshot 2186973f-8796-4551-9094-4b640fa0cf25: created successfully Feb 19 21:19:13.848544 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-6a1df067-1f6a-4650-a7b0-5e909743c9c0 tempest-GroupSnapshotsV319Test-191809393 None] group_snapshot 2186973f-8796-4551-9094-4b640fa0cf25: deleting Feb 19 21:19:13.876428 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6a1df067-1f6a-4650-a7b0-5e909743c9c0 tempest-GroupSnapshotsV319Test-191809393 None] group_snapshot 2186973f-8796-4551-9094-4b640fa0cf25: deleting {{(pid=129319) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Feb 19 21:19:13.898496 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6a1df067-1f6a-4650-a7b0-5e909743c9c0 tempest-GroupSnapshotsV319Test-191809393 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:14.619425 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-6a1df067-1f6a-4650-a7b0-5e909743c9c0 tempest-GroupSnapshotsV319Test-191809393 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1784286975 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1784286975, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:19:14.623217 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-6a1df067-1f6a-4650-a7b0-5e909743c9c0 tempest-GroupSnapshotsV319Test-191809393 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1784286975 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1784286975, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:19:14.657505 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-6a1df067-1f6a-4650-a7b0-5e909743c9c0 tempest-GroupSnapshotsV319Test-191809393 None] Created reservations ['36efe749-2225-4c34-ac83-61b87fbea7b4', 'da69312d-31fe-42ea-ad6f-e34ab79b2b94', 'cedd09e5-edd6-4c87-94e4-299025bbefcd', '1769459f-93fd-423d-8bd7-3ef7637d975f'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:14.775282 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-6a1df067-1f6a-4650-a7b0-5e909743c9c0 tempest-GroupSnapshotsV319Test-191809393 None] group_snapshot 2186973f-8796-4551-9094-4b640fa0cf25: deleted successfully Feb 19 21:19:15.623193 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-34302c65-446b-4279-b218-743ddcf03b47 tempest-GroupSnapshotsV319Test-191809393 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:15.775906 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-34302c65-446b-4279-b218-743ddcf03b47 tempest-GroupSnapshotsV319Test-191809393 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:19:15.776832 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-34302c65-446b-4279-b218-743ddcf03b47 tempest-GroupSnapshotsV319Test-191809393 None] Volume volume-38c0e3f2-c157-4323-a7a9-b700d4a5dd93 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:15.802856 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-34302c65-446b-4279-b218-743ddcf03b47 tempest-GroupSnapshotsV319Test-191809393 None] deleting rbd volume volume-38c0e3f2-c157-4323-a7a9-b700d4a5dd93 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:19:16.584782 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-34302c65-446b-4279-b218-743ddcf03b47 tempest-GroupSnapshotsV319Test-191809393 None] Created reservations ['76160388-9468-4ea3-b5de-8f3d4f58aec9'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:16.653128 ncdv-master-1 cinder-volume[129319]: WARNING cinder.quota [None req-34302c65-446b-4279-b218-743ddcf03b47 tempest-GroupSnapshotsV319Test-191809393 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1784286975 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1784286975, it is now deprecated. Please use the default quota class for default quota. Feb 19 21:19:16.686266 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-34302c65-446b-4279-b218-743ddcf03b47 tempest-GroupSnapshotsV319Test-191809393 None] Created reservations ['214c6dda-42fc-45a9-8655-c749c95719d6', 'f5769509-cdb6-4245-a1b8-717c5f772a5d', 'e98cffb2-3d37-4c34-8402-8043a2abe108', '83355665-7e31-4226-a277-17a4311cc2e5'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:16.945064 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:16.953310 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:16.954293 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:16.988514 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Flow 'volume_create_manager' (b7f38b37-7cac-4d8a-a79c-ccdcd00637ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:16.997405 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ad27a2-ebb1-41f7-b280-f0fac09212eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:17.008460 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:17.044882 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ad27a2-ebb1-41f7-b280-f0fac09212eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-344332760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=af0bbc9f-a444-4594-8e05-761b270ad0df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3ac6e5295f46929a6ec974f83f62e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:17Z,use_quota=True,user_id='7e4927177d744a38bbaa6194d806dffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:17.051687 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f40f74b-5d4b-41b1-8595-4c9fd3e024c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:17.057466 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f40f74b-5d4b-41b1-8595-4c9fd3e024c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:17.067832 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62040d7d-c539-4bf8-bd35-562823901dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:17.075015 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62040d7d-c539-4bf8-bd35-562823901dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0bbc9f-a444-4594-8e05-761b270ad0df', 'volume_name': 'volume-af0bbc9f-a444-4594-8e05-761b270ad0df', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:17.081652 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f07a42-def4-4c16-aeea-65f324ecfa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:17.089485 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f07a42-def4-4c16-aeea-65f324ecfa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:17.097093 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0cedae-e902-4c2e-a15d-d9282c27fb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:17.103333 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Volume af0bbc9f-a444-4594-8e05-761b270ad0df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0bbc9f-a444-4594-8e05-761b270ad0df', 'volume_size': 1} Feb 19 21:19:17.103333 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] creating volume 'volume-af0bbc9f-a444-4594-8e05-761b270ad0df' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:19:17.103333 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:17.156860 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-34302c65-446b-4279-b218-743ddcf03b47 tempest-GroupSnapshotsV319Test-191809393 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:17.263824 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-34302c65-446b-4279-b218-743ddcf03b47 tempest-GroupSnapshotsV319Test-191809393 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:17.319037 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-34302c65-446b-4279-b218-743ddcf03b47 tempest-GroupSnapshotsV319Test-191809393 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:17.327907 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:17.328299 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:17.332102 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0cedae-e902-4c2e-a15d-d9282c27fb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0bbc9f-a444-4594-8e05-761b270ad0df', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:17.336962 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11a4087-8328-4a1d-b026-1766aa6d0c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:17.343961 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-34302c65-446b-4279-b218-743ddcf03b47 tempest-GroupSnapshotsV319Test-191809393 None] Delete group completed successfully. Feb 19 21:19:17.351801 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Volume volume-af0bbc9f-a444-4594-8e05-761b270ad0df (af0bbc9f-a444-4594-8e05-761b270ad0df): created successfully Feb 19 21:19:17.358001 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11a4087-8328-4a1d-b026-1766aa6d0c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:17.365755 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Flow 'volume_create_manager' (b7f38b37-7cac-4d8a-a79c-ccdcd00637ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:17.386786 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b833fa74-f9f5-426a-a1a9-34202b5ea593 tempest-VolumeQuotasAdminTestJSON-148412251 None] Created volume successfully. Feb 19 21:19:18.195945 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-5796d845-f0e9-4622-b5c7-10bffa46d892 tempest-VolumeQuotasAdminTestJSON-148412251 None] Lock "b'cinder-af0bbc9f-a444-4594-8e05-761b270ad0df-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:18.292139 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5796d845-f0e9-4622-b5c7-10bffa46d892 tempest-VolumeQuotasAdminTestJSON-148412251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:18.405448 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5796d845-f0e9-4622-b5c7-10bffa46d892 tempest-VolumeQuotasAdminTestJSON-148412251 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:19:18.406455 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5796d845-f0e9-4622-b5c7-10bffa46d892 tempest-VolumeQuotasAdminTestJSON-148412251 None] Volume volume-af0bbc9f-a444-4594-8e05-761b270ad0df is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:18.423624 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5796d845-f0e9-4622-b5c7-10bffa46d892 tempest-VolumeQuotasAdminTestJSON-148412251 None] deleting rbd volume volume-af0bbc9f-a444-4594-8e05-761b270ad0df {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:19:19.013030 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-5796d845-f0e9-4622-b5c7-10bffa46d892 tempest-VolumeQuotasAdminTestJSON-148412251 None] Created reservations ['51f1384e-0d91-413a-b0b3-e776863ff51b', 'f70a8315-b0b8-414d-a4c5-f80218b2f843', '79816668-6789-4526-9435-07fb6be1a94c', 'd361ea5c-45e4-4e50-876b-f74e1df127f3'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:19.098472 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5796d845-f0e9-4622-b5c7-10bffa46d892 tempest-VolumeQuotasAdminTestJSON-148412251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:19.196011 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5796d845-f0e9-4622-b5c7-10bffa46d892 tempest-VolumeQuotasAdminTestJSON-148412251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:19.276718 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-5796d845-f0e9-4622-b5c7-10bffa46d892 tempest-VolumeQuotasAdminTestJSON-148412251 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:19.281493 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-5796d845-f0e9-4622-b5c7-10bffa46d892 tempest-VolumeQuotasAdminTestJSON-148412251 None] Deleted volume successfully. Feb 19 21:19:19.315733 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-5796d845-f0e9-4622-b5c7-10bffa46d892 tempest-VolumeQuotasAdminTestJSON-148412251 None] Lock "b'cinder-af0bbc9f-a444-4594-8e05-761b270ad0df-delete_volume'" released by "delete_volume" :: held 1.122s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:20.195284 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:20.203699 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:20.204915 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:20.228193 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Flow 'volume_create_manager' (c7a81ae8-863d-4968-8789-c1b934cf516e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:20.243845 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79e2bab-1f28-46ca-abc5-9f2d174c7576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:20.270880 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:20.290670 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79e2bab-1f28-46ca-abc5-9f2d174c7576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-361808284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e5f04e4d-7d1a-4dfb-846a-d53ff2e3089a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3ac6e5295f46929a6ec974f83f62e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:20Z,use_quota=True,user_id='7e4927177d744a38bbaa6194d806dffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:20.300555 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03febc3-d677-44a0-83f9-f9d8b0b58812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:20.309808 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03febc3-d677-44a0-83f9-f9d8b0b58812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:20.316030 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70ed247-9890-468c-8eb1-24902b6a0d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:20.321812 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70ed247-9890-468c-8eb1-24902b6a0d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f04e4d-7d1a-4dfb-846a-d53ff2e3089a', 'volume_name': 'volume-e5f04e4d-7d1a-4dfb-846a-d53ff2e3089a', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:20.329113 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a13a8a5-fdad-4827-a3dd-250e4ddcc068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:20.334158 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a13a8a5-fdad-4827-a3dd-250e4ddcc068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:20.341523 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd38cc20-d67b-4684-b4ea-6ab49d3c8d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:20.343232 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Volume e5f04e4d-7d1a-4dfb-846a-d53ff2e3089a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f04e4d-7d1a-4dfb-846a-d53ff2e3089a', 'volume_size': 1} Feb 19 21:19:20.344061 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] creating volume 'volume-e5f04e4d-7d1a-4dfb-846a-d53ff2e3089a' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:19:20.346010 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:20.448286 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:20.449502 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:20.453664 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd38cc20-d67b-4684-b4ea-6ab49d3c8d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f04e4d-7d1a-4dfb-846a-d53ff2e3089a', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:20.461735 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408b9833-b654-4847-a95b-e11779fddd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:20.482233 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Volume volume-e5f04e4d-7d1a-4dfb-846a-d53ff2e3089a (e5f04e4d-7d1a-4dfb-846a-d53ff2e3089a): created successfully Feb 19 21:19:20.486248 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408b9833-b654-4847-a95b-e11779fddd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:20.504887 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Flow 'volume_create_manager' (c7a81ae8-863d-4968-8789-c1b934cf516e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:20.518033 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-1b52d7ab-dc9e-416e-816d-621026b303aa tempest-VolumeQuotasAdminTestJSON-148412251 None] Created volume successfully. Feb 19 21:19:22.182240 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:19:22.183913 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:22.284075 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:22.362061 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:22.435498 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-4ea3b334-9ae0-4f97-aded-7881dcf1ebb8 tempest-VolumeQuotasAdminTestJSON-266432209 None] Transfer volume completed successfully. Feb 19 21:19:23.048285 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-589429b0-d42d-4145-8f64-535fa216d2d3 tempest-VolumeQuotasAdminTestJSON-1307982273 None] Lock "b'cinder-e5f04e4d-7d1a-4dfb-846a-d53ff2e3089a-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:23.125646 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-589429b0-d42d-4145-8f64-535fa216d2d3 tempest-VolumeQuotasAdminTestJSON-1307982273 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:23.251676 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-589429b0-d42d-4145-8f64-535fa216d2d3 tempest-VolumeQuotasAdminTestJSON-1307982273 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:19:23.253243 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-589429b0-d42d-4145-8f64-535fa216d2d3 tempest-VolumeQuotasAdminTestJSON-1307982273 None] Volume volume-e5f04e4d-7d1a-4dfb-846a-d53ff2e3089a is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:23.275712 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-589429b0-d42d-4145-8f64-535fa216d2d3 tempest-VolumeQuotasAdminTestJSON-1307982273 None] deleting rbd volume volume-e5f04e4d-7d1a-4dfb-846a-d53ff2e3089a {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:19:23.877430 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-589429b0-d42d-4145-8f64-535fa216d2d3 tempest-VolumeQuotasAdminTestJSON-1307982273 None] Created reservations ['24ad34eb-43de-4b73-b944-a6090e61c153', 'bbd5e751-dc47-41ee-b1fe-6859ade129a2', 'c57d7d38-df34-47b8-bb40-c0a0a76301b2', '3d97551a-f121-4652-8c7b-bb0cc6960b25'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:23.962426 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-589429b0-d42d-4145-8f64-535fa216d2d3 tempest-VolumeQuotasAdminTestJSON-1307982273 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:24.033873 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-589429b0-d42d-4145-8f64-535fa216d2d3 tempest-VolumeQuotasAdminTestJSON-1307982273 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:24.113711 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-589429b0-d42d-4145-8f64-535fa216d2d3 tempest-VolumeQuotasAdminTestJSON-1307982273 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:24.123878 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-589429b0-d42d-4145-8f64-535fa216d2d3 tempest-VolumeQuotasAdminTestJSON-1307982273 None] Deleted volume successfully. Feb 19 21:19:24.154513 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-589429b0-d42d-4145-8f64-535fa216d2d3 tempest-VolumeQuotasAdminTestJSON-1307982273 None] Lock "b'cinder-e5f04e4d-7d1a-4dfb-846a-d53ff2e3089a-delete_volume'" released by "delete_volume" :: held 1.106s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:25.963487 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:25.969179 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:25.970236 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:25.997015 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Flow 'volume_create_manager' (e02fc85e-e77d-433e-a1ce-a19c6c9190c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:26.008982 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16505e60-7f72-46df-81a3-6bdb7f66a0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:26.018850 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:26.065034 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16505e60-7f72-46df-81a3-6bdb7f66a0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1955383838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1b54a708-87b6-4b33-a6cd-3ba1681e1bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3044d6158694119ae81b86a83b29a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:26Z,use_quota=True,user_id='3fbbce5546a04545924043a3bb1c31df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:26.072037 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9495bcde-ac5f-4a47-aafa-48f03cc616e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:26.077357 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9495bcde-ac5f-4a47-aafa-48f03cc616e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:26.086215 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (933f32a0-41e0-4d6a-ad93-7820b5f44ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:26.092828 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (933f32a0-41e0-4d6a-ad93-7820b5f44ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b54a708-87b6-4b33-a6cd-3ba1681e1bf0', 'volume_name': 'volume-1b54a708-87b6-4b33-a6cd-3ba1681e1bf0', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:26.105415 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1965ca9-c3ab-4566-9550-16daaee00642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:26.112717 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1965ca9-c3ab-4566-9550-16daaee00642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:26.118914 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c7cb1f-74a5-47ae-87e7-e480bb165320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:26.121753 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Volume 1b54a708-87b6-4b33-a6cd-3ba1681e1bf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b54a708-87b6-4b33-a6cd-3ba1681e1bf0', 'volume_size': 1} Feb 19 21:19:26.122609 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] creating volume 'volume-1b54a708-87b6-4b33-a6cd-3ba1681e1bf0' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:19:26.125746 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:26.302610 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:26.302999 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:26.307031 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c7cb1f-74a5-47ae-87e7-e480bb165320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b54a708-87b6-4b33-a6cd-3ba1681e1bf0', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:26.312191 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3032533-c7ee-44ca-a3c9-20d6acf4f09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:26.326200 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Volume volume-1b54a708-87b6-4b33-a6cd-3ba1681e1bf0 (1b54a708-87b6-4b33-a6cd-3ba1681e1bf0): created successfully Feb 19 21:19:26.336072 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3032533-c7ee-44ca-a3c9-20d6acf4f09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:26.351472 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Flow 'volume_create_manager' (e02fc85e-e77d-433e-a1ce-a19c6c9190c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:26.374059 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-68bf8d7a-61bc-4247-8dbc-057d8cca7279 tempest-AbsoluteLimitsTests-1880790591 None] Created volume successfully. Feb 19 21:19:27.161344 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3ead4129-d2dd-49d8-92ea-23067d91af95 tempest-AbsoluteLimitsTests-1880790591 None] Lock "b'cinder-1b54a708-87b6-4b33-a6cd-3ba1681e1bf0-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:27.233918 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3ead4129-d2dd-49d8-92ea-23067d91af95 tempest-AbsoluteLimitsTests-1880790591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:27.331548 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3ead4129-d2dd-49d8-92ea-23067d91af95 tempest-AbsoluteLimitsTests-1880790591 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:19:27.332207 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3ead4129-d2dd-49d8-92ea-23067d91af95 tempest-AbsoluteLimitsTests-1880790591 None] Volume volume-1b54a708-87b6-4b33-a6cd-3ba1681e1bf0 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:27.346537 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3ead4129-d2dd-49d8-92ea-23067d91af95 tempest-AbsoluteLimitsTests-1880790591 None] deleting rbd volume volume-1b54a708-87b6-4b33-a6cd-3ba1681e1bf0 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:19:27.987935 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-3ead4129-d2dd-49d8-92ea-23067d91af95 tempest-AbsoluteLimitsTests-1880790591 None] Created reservations ['d287db86-a23b-43a4-904c-51478d3e7814', '8d7e566a-d067-4efd-bdf3-fa74d553e7f9', '23ead2fc-d7a3-4adb-8318-04fd6d01d0e7', '9b14da40-b2a7-4d3e-b157-52901cebc3a4'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:28.067766 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3ead4129-d2dd-49d8-92ea-23067d91af95 tempest-AbsoluteLimitsTests-1880790591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:28.154426 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3ead4129-d2dd-49d8-92ea-23067d91af95 tempest-AbsoluteLimitsTests-1880790591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:28.287308 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3ead4129-d2dd-49d8-92ea-23067d91af95 tempest-AbsoluteLimitsTests-1880790591 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:28.300229 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3ead4129-d2dd-49d8-92ea-23067d91af95 tempest-AbsoluteLimitsTests-1880790591 None] Deleted volume successfully. Feb 19 21:19:28.331502 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3ead4129-d2dd-49d8-92ea-23067d91af95 tempest-AbsoluteLimitsTests-1880790591 None] Lock "b'cinder-1b54a708-87b6-4b33-a6cd-3ba1681e1bf0-delete_volume'" released by "delete_volume" :: held 1.170s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:29.624934 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:29.628278 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:29.628754 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:29.695907 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Flow 'volume_create_manager' (e339ff87-85e3-4b69-bb94-4cbc2aa4f347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:29.718500 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69eb3aad-d271-46de-9fe1-b2a6238d7e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:29.741213 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:29.821692 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69eb3aad-d271-46de-9fe1-b2a6238d7e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1621249661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=000c5608-10fc-4038-a53d-9e2101a06eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88a055c429b4b9e8e86a370c8571785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:30Z,use_quota=True,user_id='2af13ad54ab048d495e5ff0c0453abb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:29.840516 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5208bfe-02a8-4bac-86bd-4372e9619963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:29.849277 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5208bfe-02a8-4bac-86bd-4372e9619963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:29.866183 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2592a206-d544-436e-94e4-dff48ef386ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:30.062814 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2592a206-d544-436e-94e4-dff48ef386ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '000c5608-10fc-4038-a53d-9e2101a06eeb', 'volume_name': 'volume-000c5608-10fc-4038-a53d-9e2101a06eeb', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:30.080418 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9b2db2-4fd5-4e52-b21a-e15d97df5c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:30.099624 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9b2db2-4fd5-4e52-b21a-e15d97df5c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:30.112655 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f353eac-16eb-42ce-ab67-f27938379183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:30.114179 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Volume 000c5608-10fc-4038-a53d-9e2101a06eeb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-000c5608-10fc-4038-a53d-9e2101a06eeb', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 21:19:30.115632 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Cloning 000c5608-10fc-4038-a53d-9e2101a06eeb from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 21:19:30.144577 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.018s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:30.170782 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 19, 30, 156286)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:19:30.171402 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:19:30.172269 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Found cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 19 21:19:30.177342 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 0.033s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:30.178357 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 21:19:30.215845 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 19, 30, 205770)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:19:30.218824 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:19:30.219226 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Creating from source image-volume d609c16c-1e31-4237-8163-d85a8fcc768b {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 19 21:19:30.260834 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:30.433508 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] creating snapshot='volume-000c5608-10fc-4038-a53d-9e2101a06eeb.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:19:31.045489 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] cloning 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b@volume-000c5608-10fc-4038-a53d-9e2101a06eeb.clone_snap' to 'volume-000c5608-10fc-4038-a53d-9e2101a06eeb' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:19:31.325164 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71.deleted is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:31.326309 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:31.326758 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:31.375996 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:19:31.376631 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Marking volume 000c5608-10fc-4038-a53d-9e2101a06eeb as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:19:31.388194 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to 000c5608-10fc-4038-a53d-9e2101a06eeb. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 21:19:31.388732 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Creating volume glance metadata for volume 000c5608-10fc-4038-a53d-9e2101a06eeb backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 21:19:31.457172 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f353eac-16eb-42ce-ab67-f27938379183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-000c5608-10fc-4038-a53d-9e2101a06eeb', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:31.466975 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccaea96-ff7a-476c-a909-51bc5255e5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:31.476795 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Volume volume-000c5608-10fc-4038-a53d-9e2101a06eeb (000c5608-10fc-4038-a53d-9e2101a06eeb): created successfully Feb 19 21:19:31.486030 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccaea96-ff7a-476c-a909-51bc5255e5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:31.500247 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Flow 'volume_create_manager' (e339ff87-85e3-4b69-bb94-4cbc2aa4f347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:31.517925 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8c417d0f-cf59-4364-bafb-ba020d57bacb tempest-TestVolumeBootPattern-1165351049 None] Created volume successfully. Feb 19 21:19:32.977971 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-da2c75dc-ad88-4174-877f-02c1f3b25753 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:33.315599 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-da2c75dc-ad88-4174-877f-02c1f3b25753 tempest-TestVolumeBootPattern-1165351049 None] Create snapshot completed successfully Feb 19 21:19:36.851345 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:36.858538 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:36.859200 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:36.882341 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Flow 'volume_create_manager' (563b5657-1922-4fef-be01-f54add8b773a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:36.890781 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce2fc4d-4e5b-4d65-9d14-675180ae3fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:36.899750 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:36.927949 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce2fc4d-4e5b-4d65-9d14-675180ae3fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1000991014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=491ea0b0-672b-470d-abf0-fafcdeb32cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90cde1934f643fbac57cdafb6b448fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:37Z,use_quota=True,user_id='53f18e5cf7744e6e8e9509ad27525e99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:36.936748 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e96618-b0b5-4046-beb8-830f16d09483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:36.942936 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e96618-b0b5-4046-beb8-830f16d09483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:36.951181 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa803c7-f2a0-4346-aa89-1681322f424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:36.956828 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa803c7-f2a0-4346-aa89-1681322f424f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '491ea0b0-672b-470d-abf0-fafcdeb32cfd', 'volume_name': 'volume-491ea0b0-672b-470d-abf0-fafcdeb32cfd', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:36.983380 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fe3814-3f80-4162-ad3c-3ee1cfd50db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:36.990082 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fe3814-3f80-4162-ad3c-3ee1cfd50db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:36.998250 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bc3d70-0a81-4b12-9dea-b78f24750432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:37.000095 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Volume 491ea0b0-672b-470d-abf0-fafcdeb32cfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-491ea0b0-672b-470d-abf0-fafcdeb32cfd', 'volume_size': 1} Feb 19 21:19:37.000704 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] creating volume 'volume-491ea0b0-672b-470d-abf0-fafcdeb32cfd' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:19:37.004054 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:37.128481 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:37.129297 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:37.135023 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bc3d70-0a81-4b12-9dea-b78f24750432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-491ea0b0-672b-470d-abf0-fafcdeb32cfd', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:37.143871 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b787dfde-2f01-4f6d-95e7-8092ae068d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:37.154648 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Volume volume-491ea0b0-672b-470d-abf0-fafcdeb32cfd (491ea0b0-672b-470d-abf0-fafcdeb32cfd): created successfully Feb 19 21:19:37.158513 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b787dfde-2f01-4f6d-95e7-8092ae068d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:37.164074 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Flow 'volume_create_manager' (563b5657-1922-4fef-be01-f54add8b773a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:37.175566 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-e5a3ce62-648f-4fa4-81fe-e25698936064 tempest-VolumesServicesTestJSON-4820930 None] Created volume successfully. Feb 19 21:19:37.827453 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:37.832302 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:37.833098 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:37.871030 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Flow 'volume_create_manager' (e12bf7d3-99e8-49a0-b6ea-b191e202aed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:37.896502 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78be08d-88c7-4498-8e35-acc02caf9cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:37.926662 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:37.968051 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78be08d-88c7-4498-8e35-acc02caf9cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-54518160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=853916e9-4632-4c1b-98de-197ec88d7eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc0da4addd54a9db8117f8c935e95ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:38Z,use_quota=True,user_id='16cf9ce248b245179934e11c9b45fab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:37.993540 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35458cd-d90b-4b43-9cd2-3aea4de2ed9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:38.012550 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35458cd-d90b-4b43-9cd2-3aea4de2ed9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:38.026581 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f023a15-9343-4434-bc94-a31e7375a122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:38.033568 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f023a15-9343-4434-bc94-a31e7375a122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '853916e9-4632-4c1b-98de-197ec88d7eda', 'volume_name': 'volume-853916e9-4632-4c1b-98de-197ec88d7eda', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:38.070088 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c183e9be-4663-456c-8d60-c802b2dd1b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:38.081524 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c183e9be-4663-456c-8d60-c802b2dd1b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:38.093914 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b255af-a16d-4173-bb7c-335b72428464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:38.096691 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Volume 853916e9-4632-4c1b-98de-197ec88d7eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-853916e9-4632-4c1b-98de-197ec88d7eda', 'volume_size': 1} Feb 19 21:19:38.107324 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] creating volume 'volume-853916e9-4632-4c1b-98de-197ec88d7eda' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:19:38.108658 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:38.180133 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-d47f5208-674a-49fc-a254-2562b47ab39b tempest-VolumesServicesTestJSON-4820930 None] Lock "b'cinder-491ea0b0-672b-470d-abf0-fafcdeb32cfd-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:38.230420 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d47f5208-674a-49fc-a254-2562b47ab39b tempest-VolumesServicesTestJSON-4820930 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:38.338756 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d47f5208-674a-49fc-a254-2562b47ab39b tempest-VolumesServicesTestJSON-4820930 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:19:38.340077 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d47f5208-674a-49fc-a254-2562b47ab39b tempest-VolumesServicesTestJSON-4820930 None] Volume volume-491ea0b0-672b-470d-abf0-fafcdeb32cfd is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:38.365777 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d47f5208-674a-49fc-a254-2562b47ab39b tempest-VolumesServicesTestJSON-4820930 None] deleting rbd volume volume-491ea0b0-672b-470d-abf0-fafcdeb32cfd {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:19:38.379563 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:38.381968 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:38.393219 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b255af-a16d-4173-bb7c-335b72428464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-853916e9-4632-4c1b-98de-197ec88d7eda', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:38.411357 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03257a00-7263-489b-93f3-8481c995c558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:38.435900 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Volume volume-853916e9-4632-4c1b-98de-197ec88d7eda (853916e9-4632-4c1b-98de-197ec88d7eda): created successfully Feb 19 21:19:38.442703 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03257a00-7263-489b-93f3-8481c995c558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:38.453462 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Flow 'volume_create_manager' (e12bf7d3-99e8-49a0-b6ea-b191e202aed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:38.463298 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a1c30c6b-d575-41b9-893c-8c60be6e0f1e tempest-VolumesTransfersV355Test-319572297 None] Created volume successfully. Feb 19 21:19:38.562177 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:38.571182 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:38.571182 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:38.603631 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Flow 'volume_create_manager' (d09a292f-e939-4ee6-8c97-3d11768f14a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:38.611236 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f258de-3e34-49f4-a645-d8952a828822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:38.620854 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:38.641621 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f258de-3e34-49f4-a645-d8952a828822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5e5db658-7e24-489a-865d-cdb5b90212e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88a055c429b4b9e8e86a370c8571785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=240980d9-788e-4e35-be1d-0653777578ac,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:39Z,use_quota=True,user_id='2af13ad54ab048d495e5ff0c0453abb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:38.648657 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a269988-d49d-48e6-8d23-4ec0da4d3447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:38.654734 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a269988-d49d-48e6-8d23-4ec0da4d3447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:38.661305 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c2858c-711c-43a2-9009-15575299a3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:38.668129 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c2858c-711c-43a2-9009-15575299a3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5e5db658-7e24-489a-865d-cdb5b90212e1', 'volume_name': 'volume-5e5db658-7e24-489a-865d-cdb5b90212e1', 'volume_size': 1, 'snapshot_id': '240980d9-788e-4e35-be1d-0653777578ac'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:38.675610 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9cbe33-8e52-4208-83ca-1fe10d9d0956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:38.679978 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9cbe33-8e52-4208-83ca-1fe10d9d0956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:38.687459 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ce480e-fc16-4f72-81b2-28312df51d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:38.688776 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Volume 5e5db658-7e24-489a-865d-cdb5b90212e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5e5db658-7e24-489a-865d-cdb5b90212e1', 'volume_size': 1, 'snapshot_id': '240980d9-788e-4e35-be1d-0653777578ac'} Feb 19 21:19:38.715677 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] cloning volumes/volume-000c5608-10fc-4038-a53d-9e2101a06eeb@snapshot-240980d9-788e-4e35-be1d-0653777578ac to volume-5e5db658-7e24-489a-865d-cdb5b90212e1 {{(pid=129319) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 19 21:19:38.716626 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:38.834237 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:38.991284 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-d47f5208-674a-49fc-a254-2562b47ab39b tempest-VolumesServicesTestJSON-4820930 None] Created reservations ['a42eb082-9b94-4b45-96c7-eba391e6a3c2', 'b039b2ca-ecf8-4089-9b1a-7339be030053', 'a87a3d0c-a65a-4fdd-b93b-5cf58cee4cae', '6fca1f8b-ce9d-4335-9dd8-adf17e36a890'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:39.120581 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d47f5208-674a-49fc-a254-2562b47ab39b tempest-VolumesServicesTestJSON-4820930 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:39.199110 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d47f5208-674a-49fc-a254-2562b47ab39b tempest-VolumesServicesTestJSON-4820930 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:39.290868 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-d47f5208-674a-49fc-a254-2562b47ab39b tempest-VolumesServicesTestJSON-4820930 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:39.300261 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:39.300943 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:39.349433 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d47f5208-674a-49fc-a254-2562b47ab39b tempest-VolumesServicesTestJSON-4820930 None] Deleted volume successfully. Feb 19 21:19:39.363723 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Marking volume 5e5db658-7e24-489a-865d-cdb5b90212e1 as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:19:39.387751 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Copying metadata from snapshot 240980d9-788e-4e35-be1d-0653777578ac to 5e5db658-7e24-489a-865d-cdb5b90212e1. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Feb 19 21:19:39.428135 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-d47f5208-674a-49fc-a254-2562b47ab39b tempest-VolumesServicesTestJSON-4820930 None] Lock "b'cinder-491ea0b0-672b-470d-abf0-fafcdeb32cfd-delete_volume'" released by "delete_volume" :: held 1.249s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:39.466142 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ce480e-fc16-4f72-81b2-28312df51d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5db658-7e24-489a-865d-cdb5b90212e1', 'volume_size': 1, 'snapshot_id': '240980d9-788e-4e35-be1d-0653777578ac'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:39.472533 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7a5b6a-fc8e-4b31-9942-83631dd00591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:39.489769 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Volume volume-5e5db658-7e24-489a-865d-cdb5b90212e1 (5e5db658-7e24-489a-865d-cdb5b90212e1): created successfully Feb 19 21:19:39.495953 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7a5b6a-fc8e-4b31-9942-83631dd00591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:39.504170 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Flow 'volume_create_manager' (d09a292f-e939-4ee6-8c97-3d11768f14a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:39.530833 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-98494b26-803a-4433-8a46-9d862c449d54 tempest-TestVolumeBootPattern-1165351049 None] Created volume successfully. Feb 19 21:19:40.139116 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-e2fab1a7-c6b2-40c2-a60c-72d86a001257 tempest-VolumesTransfersV355Test-157748232 None] Transfer volume completed successfully. Feb 19 21:19:40.902114 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-b47b899a-59f8-490f-8455-0b1618d94023 tempest-VolumesTransfersV355Test-2055506650 None] Lock "b'cinder-853916e9-4632-4c1b-98de-197ec88d7eda-delete_volume'" acquired by "delete_volume" :: waited 0.043s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:40.915681 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:40.924970 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:40.925608 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:40.961485 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Flow 'volume_create_manager' (85d377e7-48fc-4ba4-b7eb-af5ebafca774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:40.968881 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8cf6f9f-844a-46d7-bce6-1be0bf4e8952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:40.982765 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:41.006665 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8cf6f9f-844a-46d7-bce6-1be0bf4e8952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-714118560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=55d6da00-8b8f-4d31-910b-6e158ebbb940,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b206f017e904c07af8dc6c35551790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:41Z,use_quota=True,user_id='f9fb3af08ada44e185561b0e96f5fa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:41.014859 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a4c198-f490-4d2c-a531-b5cae0ef7395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:41.019963 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a4c198-f490-4d2c-a531-b5cae0ef7395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:41.025978 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c09317-636d-4e59-b535-1913465c1619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:41.031473 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c09317-636d-4e59-b535-1913465c1619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d6da00-8b8f-4d31-910b-6e158ebbb940', 'volume_name': 'volume-55d6da00-8b8f-4d31-910b-6e158ebbb940', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:41.037116 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9f808a-6d8b-4b1e-8acc-125136384dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:41.042585 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9f808a-6d8b-4b1e-8acc-125136384dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:41.048032 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb95eea-5f5f-4832-a8e1-32e8375fd2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:41.049521 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Volume 55d6da00-8b8f-4d31-910b-6e158ebbb940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d6da00-8b8f-4d31-910b-6e158ebbb940', 'volume_size': 1} Feb 19 21:19:41.050109 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] creating volume 'volume-55d6da00-8b8f-4d31-910b-6e158ebbb940' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:19:41.051323 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:41.136016 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b47b899a-59f8-490f-8455-0b1618d94023 tempest-VolumesTransfersV355Test-2055506650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:41.241135 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b47b899a-59f8-490f-8455-0b1618d94023 tempest-VolumesTransfersV355Test-2055506650 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:19:41.241892 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b47b899a-59f8-490f-8455-0b1618d94023 tempest-VolumesTransfersV355Test-2055506650 None] Volume volume-853916e9-4632-4c1b-98de-197ec88d7eda is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:41.252506 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b47b899a-59f8-490f-8455-0b1618d94023 tempest-VolumesTransfersV355Test-2055506650 None] deleting rbd volume volume-853916e9-4632-4c1b-98de-197ec88d7eda {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:19:41.263486 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:41.263865 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:41.269283 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb95eea-5f5f-4832-a8e1-32e8375fd2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d6da00-8b8f-4d31-910b-6e158ebbb940', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:41.288217 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294a8b95-2a1d-4622-9458-28add7d40c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:41.315474 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Volume volume-55d6da00-8b8f-4d31-910b-6e158ebbb940 (55d6da00-8b8f-4d31-910b-6e158ebbb940): created successfully Feb 19 21:19:41.322208 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294a8b95-2a1d-4622-9458-28add7d40c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:41.335629 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Flow 'volume_create_manager' (85d377e7-48fc-4ba4-b7eb-af5ebafca774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:41.358062 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-770d1eb5-f823-43dc-add7-c79bd4c0df28 tempest-VolumesGetTest-1903602593 None] Created volume successfully. Feb 19 21:19:41.707982 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-b47b899a-59f8-490f-8455-0b1618d94023 tempest-VolumesTransfersV355Test-2055506650 None] Created reservations ['ca43ccba-c204-46ac-a94c-7d9a9c29e43a', '4efe53a3-98f1-43ca-9e66-b21bef641262', '896a55a2-6ac8-4714-804c-9fc69c8ab6b3', '15b67791-e8df-4f10-ba3c-c1d4b7762dd6'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:41.832650 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b47b899a-59f8-490f-8455-0b1618d94023 tempest-VolumesTransfersV355Test-2055506650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:41.927725 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b47b899a-59f8-490f-8455-0b1618d94023 tempest-VolumesTransfersV355Test-2055506650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:42.004388 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-b47b899a-59f8-490f-8455-0b1618d94023 tempest-VolumesTransfersV355Test-2055506650 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:42.044768 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b47b899a-59f8-490f-8455-0b1618d94023 tempest-VolumesTransfersV355Test-2055506650 None] Deleted volume successfully. Feb 19 21:19:42.197436 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-522ce7f6-54a0-455e-9f0c-b2645c98ee99 tempest-TestVolumeBootPattern-1165351049 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:19:42.254429 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-b47b899a-59f8-490f-8455-0b1618d94023 tempest-VolumesTransfersV355Test-2055506650 None] Lock "b'cinder-853916e9-4632-4c1b-98de-197ec88d7eda-delete_volume'" released by "delete_volume" :: held 1.353s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:42.770138 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:42.777633 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:42.781111 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:42.840157 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Flow 'volume_create_manager' (4741a11f-4b8f-4d41-8be1-87d26b353aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:42.854128 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977cd2ce-3a16-44f9-a3c3-bb644372b3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:42.863064 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:42.883417 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977cd2ce-3a16-44f9-a3c3-bb644372b3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1648557496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=97232317-9095-4d48-9af3-e46fdfbc0e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc0da4addd54a9db8117f8c935e95ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:43Z,use_quota=True,user_id='16cf9ce248b245179934e11c9b45fab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:42.891457 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c733ba2-150b-4635-84ef-ef687bb0eeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:42.896777 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c733ba2-150b-4635-84ef-ef687bb0eeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:42.903449 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63692277-b22c-4559-b66a-6e667a572d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:42.909617 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63692277-b22c-4559-b66a-6e667a572d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97232317-9095-4d48-9af3-e46fdfbc0e48', 'volume_name': 'volume-97232317-9095-4d48-9af3-e46fdfbc0e48', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:42.916201 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47c2359-8a0e-44f4-a9d0-08a8993f4001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:42.921666 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47c2359-8a0e-44f4-a9d0-08a8993f4001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:42.927944 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db9ec610-b321-4b60-93dd-a125409e6033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:42.929436 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Volume 97232317-9095-4d48-9af3-e46fdfbc0e48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97232317-9095-4d48-9af3-e46fdfbc0e48', 'volume_size': 1} Feb 19 21:19:42.930614 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] creating volume 'volume-97232317-9095-4d48-9af3-e46fdfbc0e48' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:19:42.935267 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:43.095484 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:43.095861 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:43.099721 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db9ec610-b321-4b60-93dd-a125409e6033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97232317-9095-4d48-9af3-e46fdfbc0e48', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:43.104470 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697882d0-dda0-46b5-8ff0-e83c7f781f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:43.129248 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Volume volume-97232317-9095-4d48-9af3-e46fdfbc0e48 (97232317-9095-4d48-9af3-e46fdfbc0e48): created successfully Feb 19 21:19:43.134643 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697882d0-dda0-46b5-8ff0-e83c7f781f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:43.155808 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Flow 'volume_create_manager' (4741a11f-4b8f-4d41-8be1-87d26b353aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:43.176796 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-548854b7-e511-4c42-b97f-144ab12325fd tempest-VolumesTransfersV355Test-319572297 None] Created volume successfully. Feb 19 21:19:43.299710 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-522ce7f6-54a0-455e-9f0c-b2645c98ee99 tempest-TestVolumeBootPattern-1165351049 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.102s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:19:43.302835 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-522ce7f6-54a0-455e-9f0c-b2645c98ee99 tempest-TestVolumeBootPattern-1165351049 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5e5db658-7e24-489a-865d-cdb5b90212e1', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '5e5db658-7e24-489a-865d-cdb5b90212e1', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:19:43.357889 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-522ce7f6-54a0-455e-9f0c-b2645c98ee99 tempest-TestVolumeBootPattern-1165351049 None] Connection info returned from driver {'name': 'volumes/volume-5e5db658-7e24-489a-865d-cdb5b90212e1', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5e5db658-7e24-489a-865d-cdb5b90212e1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0c233f00-bffb-40c5-ad77-82e4cfac1dfd'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:19:43.389733 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:43.393072 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:43.393537 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:43.414595 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Flow 'volume_create_manager' (88d9af79-dc32-4efb-ad04-4049007e12a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:43.422007 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4cd300-bcc4-4a04-8739-135600ac358e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:43.433847 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:43.453912 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4cd300-bcc4-4a04-8739-135600ac358e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1127483352',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=94e29b82-a911-4a07-9ef9-8cf88289b88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b206f017e904c07af8dc6c35551790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:43Z,use_quota=True,user_id='f9fb3af08ada44e185561b0e96f5fa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:43.459438 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fbb781-c9bb-4000-8a6a-fba143412566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:43.463660 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fbb781-c9bb-4000-8a6a-fba143412566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:43.469643 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47531384-d520-4172-a8b5-9301aa5cbbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:43.474025 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47531384-d520-4172-a8b5-9301aa5cbbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94e29b82-a911-4a07-9ef9-8cf88289b88d', 'volume_name': 'volume-94e29b82-a911-4a07-9ef9-8cf88289b88d', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:43.479882 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f244704-d1f3-4a61-b923-cc4a2252d309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:43.485536 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f244704-d1f3-4a61-b923-cc4a2252d309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:43.491268 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cf2287-1989-4bfd-9c33-3b95e36f5dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:43.492591 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Volume 94e29b82-a911-4a07-9ef9-8cf88289b88d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94e29b82-a911-4a07-9ef9-8cf88289b88d', 'volume_size': 1} Feb 19 21:19:43.493100 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] creating volume 'volume-94e29b82-a911-4a07-9ef9-8cf88289b88d' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:19:43.496314 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:43.577603 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 req-522ce7f6-54a0-455e-9f0c-b2645c98ee99 tempest-TestVolumeBootPattern-1165351049 None] attachment_update completed successfully. Feb 19 21:19:43.613297 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:43.614083 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:43.618980 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cf2287-1989-4bfd-9c33-3b95e36f5dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94e29b82-a911-4a07-9ef9-8cf88289b88d', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:43.625109 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86131f61-286a-4c91-8040-82445ee92db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:43.637828 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Volume volume-94e29b82-a911-4a07-9ef9-8cf88289b88d (94e29b82-a911-4a07-9ef9-8cf88289b88d): created successfully Feb 19 21:19:43.643301 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86131f61-286a-4c91-8040-82445ee92db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:43.656493 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Flow 'volume_create_manager' (88d9af79-dc32-4efb-ad04-4049007e12a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:43.666273 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3d3afa66-a0ac-428a-a76b-f1d3d8ef34bd tempest-VolumesGetTest-1903602593 None] Created volume successfully. Feb 19 21:19:44.162055 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:44.168004 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:44.168595 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:44.189217 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Flow 'volume_create_manager' (307ef87f-05c7-4a5a-8472-1c6b4b733099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:44.196825 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558ca708-3489-4352-b01c-06a42afbbbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:44.214498 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:44.236187 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558ca708-3489-4352-b01c-06a42afbbbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1893148361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=77fdf0af-736c-4ac4-88a8-0d98a3b0d322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3b741e55b1457db0e9ddd5745c629e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:44Z,use_quota=True,user_id='4f16858532b34d45a505cb1ce5f9dfaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:44.244711 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03608563-2f40-4954-b48b-5993f60ebe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:44.251182 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03608563-2f40-4954-b48b-5993f60ebe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:44.257103 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26a6dfb-5df7-4577-a8fb-ae6fa1842dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:44.262652 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26a6dfb-5df7-4577-a8fb-ae6fa1842dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77fdf0af-736c-4ac4-88a8-0d98a3b0d322', 'volume_name': 'volume-77fdf0af-736c-4ac4-88a8-0d98a3b0d322', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:44.269064 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef9272c-75b1-4caf-9165-fd1dd7f47aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:44.273279 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef9272c-75b1-4caf-9165-fd1dd7f47aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:44.278663 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70abe60a-7691-4dc3-9f2d-3c3c2cbe255e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:44.279762 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Volume 77fdf0af-736c-4ac4-88a8-0d98a3b0d322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77fdf0af-736c-4ac4-88a8-0d98a3b0d322', 'volume_size': 1} Feb 19 21:19:44.280151 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] creating volume 'volume-77fdf0af-736c-4ac4-88a8-0d98a3b0d322' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:19:44.281168 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:44.316701 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-1d5b332d-0764-488c-b3cd-b15f17a63dc2 tempest-VolumesTransfersV355Test-2055506650 None] Lock "b'cinder-97232317-9095-4d48-9af3-e46fdfbc0e48-delete_volume'" acquired by "delete_volume" :: waited 0.088s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:44.356713 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1d5b332d-0764-488c-b3cd-b15f17a63dc2 tempest-VolumesTransfersV355Test-2055506650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:44.434127 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1d5b332d-0764-488c-b3cd-b15f17a63dc2 tempest-VolumesTransfersV355Test-2055506650 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:19:44.434850 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1d5b332d-0764-488c-b3cd-b15f17a63dc2 tempest-VolumesTransfersV355Test-2055506650 None] Volume volume-97232317-9095-4d48-9af3-e46fdfbc0e48 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:44.444114 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1d5b332d-0764-488c-b3cd-b15f17a63dc2 tempest-VolumesTransfersV355Test-2055506650 None] deleting rbd volume volume-97232317-9095-4d48-9af3-e46fdfbc0e48 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:19:44.455536 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:44.456201 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:44.462117 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70abe60a-7691-4dc3-9f2d-3c3c2cbe255e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77fdf0af-736c-4ac4-88a8-0d98a3b0d322', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:44.470103 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364706ef-8a40-4067-a798-6578ea76774c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:44.486261 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Volume volume-77fdf0af-736c-4ac4-88a8-0d98a3b0d322 (77fdf0af-736c-4ac4-88a8-0d98a3b0d322): created successfully Feb 19 21:19:44.491533 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364706ef-8a40-4067-a798-6578ea76774c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:44.513477 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Flow 'volume_create_manager' (307ef87f-05c7-4a5a-8472-1c6b4b733099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:44.537367 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-e0d32624-7c20-4bb4-8ba4-95d606953b73 tempest-SnapshotMetadataTestJSON-961611910 None] Created volume successfully. Feb 19 21:19:44.543170 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-c12ed723-f95d-4785-a292-a2e3c5010ea7 tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-94e29b82-a911-4a07-9ef9-8cf88289b88d-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:44.594864 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c12ed723-f95d-4785-a292-a2e3c5010ea7 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:44.687275 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c12ed723-f95d-4785-a292-a2e3c5010ea7 tempest-VolumesGetTest-1903602593 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:19:44.687829 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c12ed723-f95d-4785-a292-a2e3c5010ea7 tempest-VolumesGetTest-1903602593 None] Volume volume-94e29b82-a911-4a07-9ef9-8cf88289b88d is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:44.695433 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c12ed723-f95d-4785-a292-a2e3c5010ea7 tempest-VolumesGetTest-1903602593 None] deleting rbd volume volume-94e29b82-a911-4a07-9ef9-8cf88289b88d {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:19:44.901945 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-1d5b332d-0764-488c-b3cd-b15f17a63dc2 tempest-VolumesTransfersV355Test-2055506650 None] Created reservations ['ae837614-b93b-4bc5-8927-06db9316a146', '5d623175-42f4-434a-8d20-59ddf6750082', 'c806b680-e1b8-4b2b-b6c6-28c399acad50', '27e5898d-93d9-4cdd-9ab4-87c028129df6'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:44.974498 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1d5b332d-0764-488c-b3cd-b15f17a63dc2 tempest-VolumesTransfersV355Test-2055506650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:45.041156 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-1d5b332d-0764-488c-b3cd-b15f17a63dc2 tempest-VolumesTransfersV355Test-2055506650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:45.094692 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-1d5b332d-0764-488c-b3cd-b15f17a63dc2 tempest-VolumesTransfersV355Test-2055506650 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:45.116863 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-1d5b332d-0764-488c-b3cd-b15f17a63dc2 tempest-VolumesTransfersV355Test-2055506650 None] Deleted volume successfully. Feb 19 21:19:45.154893 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-1d5b332d-0764-488c-b3cd-b15f17a63dc2 tempest-VolumesTransfersV355Test-2055506650 None] Lock "b'cinder-97232317-9095-4d48-9af3-e46fdfbc0e48-delete_volume'" released by "delete_volume" :: held 0.840s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:45.199736 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-c12ed723-f95d-4785-a292-a2e3c5010ea7 tempest-VolumesGetTest-1903602593 None] Created reservations ['cb88e6f0-3dec-4597-8e47-0e50b2347af5', 'b97570b2-3fdd-42e3-9d6e-bd18804e2559', 'c8cdd7bf-f017-4bca-9ba3-7addb5e3f657', '97b7974f-4d62-47f3-b9fd-4741cfecaef6'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:45.340528 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c12ed723-f95d-4785-a292-a2e3c5010ea7 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:45.426521 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c12ed723-f95d-4785-a292-a2e3c5010ea7 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:45.499223 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-c12ed723-f95d-4785-a292-a2e3c5010ea7 tempest-VolumesGetTest-1903602593 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:45.514247 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-c12ed723-f95d-4785-a292-a2e3c5010ea7 tempest-VolumesGetTest-1903602593 None] Deleted volume successfully. Feb 19 21:19:45.553326 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-c12ed723-f95d-4785-a292-a2e3c5010ea7 tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-94e29b82-a911-4a07-9ef9-8cf88289b88d-delete_volume'" released by "delete_volume" :: held 1.011s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:45.585376 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a9230d8-bec1-44ba-bb9b-a7ba7e32e65d tempest-SnapshotMetadataTestJSON-961611910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:45.720938 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-7dbe28f5-7960-4380-966c-17f6f5f20412 tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-55d6da00-8b8f-4d31-910b-6e158ebbb940-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:45.778675 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7dbe28f5-7960-4380-966c-17f6f5f20412 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:45.845748 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7dbe28f5-7960-4380-966c-17f6f5f20412 tempest-VolumesGetTest-1903602593 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:19:45.846274 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7dbe28f5-7960-4380-966c-17f6f5f20412 tempest-VolumesGetTest-1903602593 None] Volume volume-55d6da00-8b8f-4d31-910b-6e158ebbb940 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:45.856794 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7dbe28f5-7960-4380-966c-17f6f5f20412 tempest-VolumesGetTest-1903602593 None] deleting rbd volume volume-55d6da00-8b8f-4d31-910b-6e158ebbb940 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:19:46.229045 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-7dbe28f5-7960-4380-966c-17f6f5f20412 tempest-VolumesGetTest-1903602593 None] Created reservations ['00068c86-8d1b-418a-9fda-6aa81f5470c3', 'ab314e00-4f0f-433f-99cc-7dd980391504', '832b2ac6-751c-4e77-873b-8c95c92658ee', '3fe4f15b-388d-49ce-971e-656af560edae'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:46.304746 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7dbe28f5-7960-4380-966c-17f6f5f20412 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:46.356276 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7dbe28f5-7960-4380-966c-17f6f5f20412 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:46.415248 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-7dbe28f5-7960-4380-966c-17f6f5f20412 tempest-VolumesGetTest-1903602593 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:46.432203 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-7dbe28f5-7960-4380-966c-17f6f5f20412 tempest-VolumesGetTest-1903602593 None] Deleted volume successfully. Feb 19 21:19:46.463593 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-7dbe28f5-7960-4380-966c-17f6f5f20412 tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-55d6da00-8b8f-4d31-910b-6e158ebbb940-delete_volume'" released by "delete_volume" :: held 0.743s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:46.536555 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3a9230d8-bec1-44ba-bb9b-a7ba7e32e65d tempest-SnapshotMetadataTestJSON-961611910 None] Create snapshot completed successfully Feb 19 21:19:47.414941 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:47.420304 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:47.420898 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:47.445196 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Flow 'volume_create_manager' (bac4dd32-c7ec-41c3-84e8-1dbb7e2753b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:47.453542 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb88a135-0fcc-4b49-8583-d35990ca05c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:47.463448 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:47.485150 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb88a135-0fcc-4b49-8583-d35990ca05c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-367171423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2d37ca0a-0f0e-439a-9171-42c9ebc0fa29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b206f017e904c07af8dc6c35551790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:47Z,use_quota=True,user_id='f9fb3af08ada44e185561b0e96f5fa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:47.495508 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9f1acd-5485-4576-919f-8d6b4d60fc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:47.499967 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9f1acd-5485-4576-919f-8d6b4d60fc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:47.507225 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f258e83-2baa-4753-b3ad-ab37b4659a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:47.514302 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f258e83-2baa-4753-b3ad-ab37b4659a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d37ca0a-0f0e-439a-9171-42c9ebc0fa29', 'volume_name': 'volume-2d37ca0a-0f0e-439a-9171-42c9ebc0fa29', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:47.520790 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca4fd67-4205-412e-b67e-38a9f58d9000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:47.525910 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca4fd67-4205-412e-b67e-38a9f58d9000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:47.533189 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc2d912-f945-4a7e-aa82-0e1f09b92e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:47.534632 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Volume 2d37ca0a-0f0e-439a-9171-42c9ebc0fa29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d37ca0a-0f0e-439a-9171-42c9ebc0fa29', 'volume_size': 1} Feb 19 21:19:47.535205 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] creating volume 'volume-2d37ca0a-0f0e-439a-9171-42c9ebc0fa29' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:19:47.536864 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:47.599159 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-664e38a7-a199-439f-aa2d-eb962a87dd66 tempest-SnapshotMetadataTestJSON-961611910 None] Lock "b'cinder-b472450d-f3d8-4724-8090-8945d613900d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.020s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:47.600706 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-664e38a7-a199-439f-aa2d-eb962a87dd66 tempest-SnapshotMetadataTestJSON-961611910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:47.691721 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:47.692089 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:47.697769 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc2d912-f945-4a7e-aa82-0e1f09b92e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d37ca0a-0f0e-439a-9171-42c9ebc0fa29', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:47.709233 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f2b39c-0f91-41e2-9a72-cc853e9ee622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:47.734053 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Volume volume-2d37ca0a-0f0e-439a-9171-42c9ebc0fa29 (2d37ca0a-0f0e-439a-9171-42c9ebc0fa29): created successfully Feb 19 21:19:47.736527 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f2b39c-0f91-41e2-9a72-cc853e9ee622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:47.742631 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Flow 'volume_create_manager' (bac4dd32-c7ec-41c3-84e8-1dbb7e2753b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:47.755917 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-9ce6abfb-1267-4be0-938b-196089399dd0 tempest-VolumesGetTest-1903602593 None] Created volume successfully. Feb 19 21:19:48.910972 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:48.915866 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:48.916354 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:49.016358 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Flow 'volume_create_manager' (c733ff0b-cf84-4086-b97f-656306e360c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:49.030277 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77944c5c-21b5-470b-81e4-5aa314f69b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:49.035491 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-664e38a7-a199-439f-aa2d-eb962a87dd66 tempest-SnapshotMetadataTestJSON-961611910 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:49.069042 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77944c5c-21b5-470b-81e4-5aa314f69b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-350138778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd601846-47b6-4785-a25b-3994138e9c68,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b206f017e904c07af8dc6c35551790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2d37ca0a-0f0e-439a-9171-42c9ebc0fa29,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:49Z,use_quota=True,user_id='f9fb3af08ada44e185561b0e96f5fa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:49.076885 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3aaa6b1-5ea9-4aba-b69d-96545c6aaf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:49.082164 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3aaa6b1-5ea9-4aba-b69d-96545c6aaf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:49.091553 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8153cab5-5b02-446d-b4ca-f99ed18bf450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:49.118247 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8153cab5-5b02-446d-b4ca-f99ed18bf450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cd601846-47b6-4785-a25b-3994138e9c68', 'volume_name': 'volume-cd601846-47b6-4785-a25b-3994138e9c68', 'volume_size': 1, 'source_volid': '2d37ca0a-0f0e-439a-9171-42c9ebc0fa29', 'source_volstatus': 'available'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:49.124811 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bc467d-222a-4f74-8f2a-c09ebf249a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:49.129247 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bc467d-222a-4f74-8f2a-c09ebf249a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:49.138825 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33276a91-ba2b-4cb6-9a28-2453304a0cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:49.140834 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Volume cd601846-47b6-4785-a25b-3994138e9c68: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cd601846-47b6-4785-a25b-3994138e9c68', 'volume_size': 1, 'source_volid': '2d37ca0a-0f0e-439a-9171-42c9ebc0fa29', 'source_volstatus': 'available'} Feb 19 21:19:49.155161 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:49.215855 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] creating snapshot='volume-cd601846-47b6-4785-a25b-3994138e9c68.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:19:49.938018 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] cloning 'volume-2d37ca0a-0f0e-439a-9171-42c9ebc0fa29@volume-cd601846-47b6-4785-a25b-3994138e9c68.clone_snap' to 'volume-cd601846-47b6-4785-a25b-3994138e9c68' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:19:49.975910 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-664e38a7-a199-439f-aa2d-eb962a87dd66 tempest-SnapshotMetadataTestJSON-961611910 None] Created reservations ['4b88be74-5181-4018-9719-9d482680d4d8', 'e278cf3f-8a6e-4417-bb37-87450a409a54', 'cf544019-d75d-4dc5-8f65-1e91cf93dbea', '83fbf787-2c70-4d02-b238-85ebe98b1b2b'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:50.031536 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:50.035805 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:50.036497 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:50.064684 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Flow 'volume_create_manager' (dcfb1be6-2d0f-4559-a626-32a4adebd703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:50.074171 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a58af18-d268-437f-98be-15afe14a1591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:50.094649 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Volume volume-2d37ca0a-0f0e-439a-9171-42c9ebc0fa29 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:50.095868 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:50.096244 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:50.126589 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:19:50.137224 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33276a91-ba2b-4cb6-9a28-2453304a0cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd601846-47b6-4785-a25b-3994138e9c68', 'volume_size': 1, 'source_volid': '2d37ca0a-0f0e-439a-9171-42c9ebc0fa29', 'source_volstatus': 'available'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:50.145712 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7a8361-e0cc-48d2-a1ac-2977d9ad51c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:50.160039 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:50.180452 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-664e38a7-a199-439f-aa2d-eb962a87dd66 tempest-SnapshotMetadataTestJSON-961611910 None] Delete snapshot completed successfully. Feb 19 21:19:50.189437 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a58af18-d268-437f-98be-15afe14a1591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-919159144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0311b7ea-7813-49d0-9380-40c61569e790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4735cc20b18f46a1b0468386b0b7a632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:50Z,use_quota=True,user_id='27dbcebd833d49dbbeca6c661518336f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:50.196034 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d77d10d-dd88-4641-b11f-a9fe3be54fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:50.202455 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d77d10d-dd88-4641-b11f-a9fe3be54fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:50.209187 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83a0a78-3cfa-41b9-a144-0025569a7293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:50.215803 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83a0a78-3cfa-41b9-a144-0025569a7293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0311b7ea-7813-49d0-9380-40c61569e790', 'volume_name': 'volume-0311b7ea-7813-49d0-9380-40c61569e790', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:50.221494 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42348137-666f-405a-bb3b-c745ac110d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:50.226108 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42348137-666f-405a-bb3b-c745ac110d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:50.231224 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690eedb8-af33-4319-9bef-60e2fffef678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:50.232482 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Volume 0311b7ea-7813-49d0-9380-40c61569e790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0311b7ea-7813-49d0-9380-40c61569e790', 'volume_size': 1} Feb 19 21:19:50.232979 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] creating volume 'volume-0311b7ea-7813-49d0-9380-40c61569e790' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:19:50.234590 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:50.294057 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-664e38a7-a199-439f-aa2d-eb962a87dd66 tempest-SnapshotMetadataTestJSON-961611910 None] Lock "b'cinder-b472450d-f3d8-4724-8090-8945d613900d-delete_snapshot'" released by "delete_snapshot" :: held 2.695s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:50.295402 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Volume volume-cd601846-47b6-4785-a25b-3994138e9c68 (cd601846-47b6-4785-a25b-3994138e9c68): created successfully Feb 19 21:19:50.300252 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7a8361-e0cc-48d2-a1ac-2977d9ad51c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:50.306742 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Flow 'volume_create_manager' (c733ff0b-cf84-4086-b97f-656306e360c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:50.332066 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-dd2efc63-4533-46cd-8680-81b32fd03757 tempest-VolumesGetTest-1903602593 None] Created volume successfully. Feb 19 21:19:50.363223 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:50.363702 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:50.368365 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690eedb8-af33-4319-9bef-60e2fffef678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0311b7ea-7813-49d0-9380-40c61569e790', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:50.374589 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e201d860-e6e6-4110-bb9d-80d0e51569e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:50.386666 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Volume volume-0311b7ea-7813-49d0-9380-40c61569e790 (0311b7ea-7813-49d0-9380-40c61569e790): created successfully Feb 19 21:19:50.390998 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e201d860-e6e6-4110-bb9d-80d0e51569e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:50.399836 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Flow 'volume_create_manager' (dcfb1be6-2d0f-4559-a626-32a4adebd703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:50.411023 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-4765dc07-dc25-45aa-8174-0b29d1607279 tempest-VolumesBackupsV39Test-918988790 None] Created volume successfully. Feb 19 21:19:50.757633 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-65e5d62d-8db7-42f6-ab58-d5d72ee92e4b tempest-SnapshotMetadataTestJSON-961611910 None] Lock "b'cinder-77fdf0af-736c-4ac4-88a8-0d98a3b0d322-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:50.799340 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-65e5d62d-8db7-42f6-ab58-d5d72ee92e4b tempest-SnapshotMetadataTestJSON-961611910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:50.881005 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-65e5d62d-8db7-42f6-ab58-d5d72ee92e4b tempest-SnapshotMetadataTestJSON-961611910 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:19:50.881749 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-65e5d62d-8db7-42f6-ab58-d5d72ee92e4b tempest-SnapshotMetadataTestJSON-961611910 None] Volume volume-77fdf0af-736c-4ac4-88a8-0d98a3b0d322 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:50.888774 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-65e5d62d-8db7-42f6-ab58-d5d72ee92e4b tempest-SnapshotMetadataTestJSON-961611910 None] deleting rbd volume volume-77fdf0af-736c-4ac4-88a8-0d98a3b0d322 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:19:51.319635 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-61c65bee-ea8b-4391-a4ef-b1caf66a9ef4 tempest-VolumesBackupsV39Test-918988790 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-19T21:19:51Z,data_timestamp=2022-02-19T21:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-1254871827',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=7548e5b3-fb1e-4200-8c85-0ab573d5c1c3,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='4735cc20b18f46a1b0468386b0b7a632',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='27dbcebd833d49dbbeca6c661518336f',volume_id=0311b7ea-7813-49d0-9380-40c61569e790) Feb 19 21:19:51.320965 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.backup.rpcapi [None req-61c65bee-ea8b-4391-a4ef-b1caf66a9ef4 tempest-VolumesBackupsV39Test-918988790 None] continue_backup in rpcapi backup_id 7548e5b3-fb1e-4200-8c85-0ab573d5c1c3 {{(pid=129319) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 19 21:19:51.398209 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-65e5d62d-8db7-42f6-ab58-d5d72ee92e4b tempest-SnapshotMetadataTestJSON-961611910 None] Created reservations ['aafbebb9-55a2-42f1-bdbb-38be12a3d990', 'd8ee5afd-e4fc-476f-b366-195081d5b349', '4f021d0b-f2e1-4560-b1df-00981820ab23', '0d339950-b426-466e-82bc-b8eee9b425e7'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:51.510012 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-65e5d62d-8db7-42f6-ab58-d5d72ee92e4b tempest-SnapshotMetadataTestJSON-961611910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:51.595072 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-65e5d62d-8db7-42f6-ab58-d5d72ee92e4b tempest-SnapshotMetadataTestJSON-961611910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:51.660136 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-65e5d62d-8db7-42f6-ab58-d5d72ee92e4b tempest-SnapshotMetadataTestJSON-961611910 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:51.672534 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-61c65bee-ea8b-4391-a4ef-b1caf66a9ef4 tempest-VolumesBackupsV39Test-918988790 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:19:51.731237 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-65e5d62d-8db7-42f6-ab58-d5d72ee92e4b tempest-SnapshotMetadataTestJSON-961611910 None] Deleted volume successfully. Feb 19 21:19:51.778150 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-65e5d62d-8db7-42f6-ab58-d5d72ee92e4b tempest-SnapshotMetadataTestJSON-961611910 None] Lock "b'cinder-77fdf0af-736c-4ac4-88a8-0d98a3b0d322-delete_volume'" released by "delete_volume" :: held 1.021s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:52.069075 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:52.072759 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:52.073869 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:52.116186 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Flow 'volume_create_manager' (aacaa768-631e-4170-a040-57fd536a8702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:52.127623 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc502e38-e192-446c-81a2-b5242d51eff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:52.139396 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:52.160660 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc502e38-e192-446c-81a2-b5242d51eff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-270510056',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3923d043-21b9-4531-876f-cebf370fd7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b206f017e904c07af8dc6c35551790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:52Z,use_quota=True,user_id='f9fb3af08ada44e185561b0e96f5fa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:52.172461 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa6cf13-3367-4c99-8d48-82c0a0aa6f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:52.179935 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa6cf13-3367-4c99-8d48-82c0a0aa6f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:52.187509 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6ea37e-9a69-49b0-9104-5e66a580ac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:52.193278 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6ea37e-9a69-49b0-9104-5e66a580ac68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3923d043-21b9-4531-876f-cebf370fd7f1', 'volume_name': 'volume-3923d043-21b9-4531-876f-cebf370fd7f1', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:52.201509 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2081d0f-6a02-4b61-8c2c-b3fc08e33489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:52.206375 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2081d0f-6a02-4b61-8c2c-b3fc08e33489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:52.212353 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a1ef94-4014-48d8-a9c5-178543de865f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:52.213907 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Volume 3923d043-21b9-4531-876f-cebf370fd7f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3923d043-21b9-4531-876f-cebf370fd7f1', 'volume_size': 1} Feb 19 21:19:52.214492 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] creating volume 'volume-3923d043-21b9-4531-876f-cebf370fd7f1' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:19:52.215844 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:52.364972 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:52.365635 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:52.369512 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a1ef94-4014-48d8-a9c5-178543de865f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3923d043-21b9-4531-876f-cebf370fd7f1', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:52.374994 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ac65dc-4e83-400e-8fcb-7502224f0f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:52.389003 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Volume volume-3923d043-21b9-4531-876f-cebf370fd7f1 (3923d043-21b9-4531-876f-cebf370fd7f1): created successfully Feb 19 21:19:52.399678 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ac65dc-4e83-400e-8fcb-7502224f0f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:52.421203 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Flow 'volume_create_manager' (aacaa768-631e-4170-a040-57fd536a8702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:52.448514 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-966b4106-8159-4c83-a064-b99660ad6599 tempest-VolumesGetTest-1903602593 None] Created volume successfully. Feb 19 21:19:52.885277 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-61c65bee-ea8b-4391-a4ef-b1caf66a9ef4 tempest-VolumesBackupsV39Test-918988790 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.213s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:19:52.887090 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-61c65bee-ea8b-4391-a4ef-b1caf66a9ef4 tempest-VolumesBackupsV39Test-918988790 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0311b7ea-7813-49d0-9380-40c61569e790', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '0311b7ea-7813-49d0-9380-40c61569e790', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:19:52.914488 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-61c65bee-ea8b-4391-a4ef-b1caf66a9ef4 tempest-VolumesBackupsV39Test-918988790 None] Initialize volume connection completed successfully. Feb 19 21:19:53.112942 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a9173af9-abd6-4907-8721-caa4a49f21bc tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-3923d043-21b9-4531-876f-cebf370fd7f1-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:53.171498 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a9173af9-abd6-4907-8721-caa4a49f21bc tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:53.249022 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a9173af9-abd6-4907-8721-caa4a49f21bc tempest-VolumesGetTest-1903602593 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:19:53.249462 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a9173af9-abd6-4907-8721-caa4a49f21bc tempest-VolumesGetTest-1903602593 None] Volume volume-3923d043-21b9-4531-876f-cebf370fd7f1 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:53.257890 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a9173af9-abd6-4907-8721-caa4a49f21bc tempest-VolumesGetTest-1903602593 None] deleting rbd volume volume-3923d043-21b9-4531-876f-cebf370fd7f1 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:19:53.782637 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-a9173af9-abd6-4907-8721-caa4a49f21bc tempest-VolumesGetTest-1903602593 None] Created reservations ['c5b60014-0cef-4360-b043-c1b7568743ea', '9189d15b-9df8-423d-8f33-82124ce18415', 'aa486400-ece7-490f-92e9-5828821f001c', 'a585bc49-d30c-45f8-9c53-919ddfb5c397'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:53.872084 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a9173af9-abd6-4907-8721-caa4a49f21bc tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:53.942118 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a9173af9-abd6-4907-8721-caa4a49f21bc tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:54.039093 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-a9173af9-abd6-4907-8721-caa4a49f21bc tempest-VolumesGetTest-1903602593 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:54.053125 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a9173af9-abd6-4907-8721-caa4a49f21bc tempest-VolumesGetTest-1903602593 None] Deleted volume successfully. Feb 19 21:19:54.075254 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a9173af9-abd6-4907-8721-caa4a49f21bc tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-3923d043-21b9-4531-876f-cebf370fd7f1-delete_volume'" released by "delete_volume" :: held 0.962s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:54.344987 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-7f5b1458-b09d-4512-bb96-e94c309b3c62 tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-cd601846-47b6-4785-a25b-3994138e9c68-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:54.445027 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7f5b1458-b09d-4512-bb96-e94c309b3c62 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:54.563597 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7f5b1458-b09d-4512-bb96-e94c309b3c62 tempest-VolumesGetTest-1903602593 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:19:54.617483 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7f5b1458-b09d-4512-bb96-e94c309b3c62 tempest-VolumesGetTest-1903602593 None] deleting rbd volume volume-cd601846-47b6-4785-a25b-3994138e9c68 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:19:54.976679 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7f5b1458-b09d-4512-bb96-e94c309b3c62 tempest-VolumesGetTest-1903602593 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:19:55.021591 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7f5b1458-b09d-4512-bb96-e94c309b3c62 tempest-VolumesGetTest-1903602593 None] Volume volume-2d37ca0a-0f0e-439a-9171-42c9ebc0fa29 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:55.022430 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7f5b1458-b09d-4512-bb96-e94c309b3c62 tempest-VolumesGetTest-1903602593 None] deleting parent snapshot volume-cd601846-47b6-4785-a25b-3994138e9c68.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:19:56.295086 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-61c65bee-ea8b-4391-a4ef-b1caf66a9ef4 tempest-VolumesBackupsV39Test-918988790 None] Terminate volume connection completed successfully. Feb 19 21:19:56.358290 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:56.368635 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:56.369411 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:56.453968 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Flow 'volume_create_manager' (c54d1a81-6973-400a-9e8a-df37c4354b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:56.462261 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73f1f0b-9221-490c-bd27-e968296a33f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:56.480766 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-61c65bee-ea8b-4391-a4ef-b1caf66a9ef4 tempest-VolumesBackupsV39Test-918988790 None] Remove volume export completed successfully. Feb 19 21:19:56.486983 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:56.510175 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73f1f0b-9221-490c-bd27-e968296a33f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-601129662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=79ef619e-5101-4c01-b7d4-3f1d3f1a486c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4460bc7458364067affd49ffa2f6aad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:56Z,use_quota=True,user_id='6eb8aded09954e1088ec589d6d0fdd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:56.518036 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962876b7-9b12-47cd-b14d-eccf1ca87ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:56.537675 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962876b7-9b12-47cd-b14d-eccf1ca87ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:56.565719 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62af939a-26f5-4fc3-864e-f5b2fe7ec964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:56.612905 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-7f5b1458-b09d-4512-bb96-e94c309b3c62 tempest-VolumesGetTest-1903602593 None] Created reservations ['a823b9de-514e-41d0-9337-b1f23dfa63eb', 'b0989942-9363-4b8b-9dee-d59936878525', '2f75786f-1a97-4076-99d4-0f20a5d413c5', '50b2ffef-e18b-442e-9a9b-d0224437e2e3'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:56.771703 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62af939a-26f5-4fc3-864e-f5b2fe7ec964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79ef619e-5101-4c01-b7d4-3f1d3f1a486c', 'volume_name': 'volume-79ef619e-5101-4c01-b7d4-3f1d3f1a486c', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:56.779095 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f11a35-31d3-41b2-836f-d202f89ca470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:56.783309 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f11a35-31d3-41b2-836f-d202f89ca470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:56.798562 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a493a28f-6435-4194-ab02-9f4156554538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:56.800203 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Volume 79ef619e-5101-4c01-b7d4-3f1d3f1a486c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79ef619e-5101-4c01-b7d4-3f1d3f1a486c', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 21:19:56.800840 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Cloning 79ef619e-5101-4c01-b7d4-3f1d3f1a486c from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 21:19:56.827016 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.024s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:56.851058 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 19, 56, 837809)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:19:56.851497 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:19:56.851891 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Found cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 19 21:19:56.861993 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7f5b1458-b09d-4512-bb96-e94c309b3c62 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:56.943318 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7f5b1458-b09d-4512-bb96-e94c309b3c62 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:57.013635 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-7f5b1458-b09d-4512-bb96-e94c309b3c62 tempest-VolumesGetTest-1903602593 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:57.022941 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 0.197s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:57.024962 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 21:19:57.037447 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-7f5b1458-b09d-4512-bb96-e94c309b3c62 tempest-VolumesGetTest-1903602593 None] Deleted volume successfully. Feb 19 21:19:57.059175 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 19, 57, 45413)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:19:57.059824 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:19:57.060505 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Creating from source image-volume d609c16c-1e31-4237-8163-d85a8fcc768b {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 19 21:19:57.079417 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:57.199770 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] creating snapshot='volume-79ef619e-5101-4c01-b7d4-3f1d3f1a486c.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:19:58.106350 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] cloning 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b@volume-79ef619e-5101-4c01-b7d4-3f1d3f1a486c.clone_snap' to 'volume-79ef619e-5101-4c01-b7d4-3f1d3f1a486c' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:19:58.119309 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-7f5b1458-b09d-4512-bb96-e94c309b3c62 tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-cd601846-47b6-4785-a25b-3994138e9c68-delete_volume'" released by "delete_volume" :: held 3.774s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:58.127839 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-b245d362-9474-4740-973e-805390c134a0 req-f19a0457-4b89-45cc-9e4d-94cee4784ed7 tempest-TestVolumeBootPattern-1165351049 None] Terminate volume connection completed successfully. Feb 19 21:19:58.128882 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-b245d362-9474-4740-973e-805390c134a0 req-f19a0457-4b89-45cc-9e4d-94cee4784ed7 tempest-TestVolumeBootPattern-1165351049 None] Deleting attachment 0c233f00-bffb-40c5-ad77-82e4cfac1dfd. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:19:58.345541 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71.deleted is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:58.346656 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:58.347242 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:58.373999 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:19:58.374658 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Marking volume 79ef619e-5101-4c01-b7d4-3f1d3f1a486c as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:19:58.402261 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to 79ef619e-5101-4c01-b7d4-3f1d3f1a486c. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 21:19:58.402996 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Creating volume glance metadata for volume 79ef619e-5101-4c01-b7d4-3f1d3f1a486c backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 21:19:58.412812 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:58.416875 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:58.418127 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:58.441910 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Flow 'volume_create_manager' (152a920a-33a4-4379-8811-5aaacbb8b064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:58.453691 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1247ab27-4ff2-4d0c-bace-2bc1d5d2d12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:58.458341 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-b245d362-9474-4740-973e-805390c134a0 req-3b626270-48b3-4d24-9e20-47d9fdeb9e4b tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-5e5db658-7e24-489a-865d-cdb5b90212e1-delete_volume'" acquired by "delete_volume" :: waited 0.069s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:58.467470 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:58.490136 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1247ab27-4ff2-4d0c-bace-2bc1d5d2d12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-68896603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c1947170-472f-4487-bcc3-919b4ef74b71,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b206f017e904c07af8dc6c35551790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:19:58Z,use_quota=True,user_id='f9fb3af08ada44e185561b0e96f5fa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:58.496607 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48688c3-cc8e-4035-a33c-3deeb5f46848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:58.502564 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48688c3-cc8e-4035-a33c-3deeb5f46848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:58.508894 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bedf4b7f-0d95-417b-9580-b7bfce71d6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:58.574124 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-b245d362-9474-4740-973e-805390c134a0 req-3b626270-48b3-4d24-9e20-47d9fdeb9e4b tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:58.671939 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-b245d362-9474-4740-973e-805390c134a0 req-3b626270-48b3-4d24-9e20-47d9fdeb9e4b tempest-TestVolumeBootPattern-1165351049 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:19:58.680165 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-b245d362-9474-4740-973e-805390c134a0 req-3b626270-48b3-4d24-9e20-47d9fdeb9e4b tempest-TestVolumeBootPattern-1165351049 None] deleting rbd volume volume-5e5db658-7e24-489a-865d-cdb5b90212e1 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:19:58.717244 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a493a28f-6435-4194-ab02-9f4156554538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79ef619e-5101-4c01-b7d4-3f1d3f1a486c', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:58.726509 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001a55ae-bee8-41c4-8c9b-4d6c5127b564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:58.745350 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Volume volume-79ef619e-5101-4c01-b7d4-3f1d3f1a486c (79ef619e-5101-4c01-b7d4-3f1d3f1a486c): created successfully Feb 19 21:19:58.751136 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001a55ae-bee8-41c4-8c9b-4d6c5127b564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:58.762224 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Flow 'volume_create_manager' (c54d1a81-6973-400a-9e8a-df37c4354b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:58.790294 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bedf4b7f-0d95-417b-9580-b7bfce71d6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1947170-472f-4487-bcc3-919b4ef74b71', 'volume_name': 'volume-c1947170-472f-4487-bcc3-919b4ef74b71', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:58.800621 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7dbbff-2ff5-48c9-bb19-54c6111a3e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:58.804901 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7dbbff-2ff5-48c9-bb19-54c6111a3e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:58.810521 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50891fd-cb9a-4d86-a4f3-ac9f8a1e9e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:58.811736 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Volume c1947170-472f-4487-bcc3-919b4ef74b71: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1947170-472f-4487-bcc3-919b4ef74b71', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 21:19:58.812941 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Cloning c1947170-472f-4487-bcc3-919b4ef74b71 from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 21:19:58.828595 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-0f15a306-5f18-414a-89e1-13d2c8145530 tempest-VolumesCloneTest-592035103 None] Created volume successfully. Feb 19 21:19:58.833587 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.020s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:19:58.849303 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 19, 58, 839521)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:19:58.850019 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:19:58.850703 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Found cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 19 21:19:58.855255 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:58.856123 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 21:19:58.864153 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 19, 58, 859956)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:19:58.864603 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:19:58.864997 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Creating from source image-volume d609c16c-1e31-4237-8163-d85a8fcc768b {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 19 21:19:58.884478 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:58.980612 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] creating snapshot='volume-c1947170-472f-4487-bcc3-919b4ef74b71.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:19:59.145905 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] cloning 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b@volume-c1947170-472f-4487-bcc3-919b4ef74b71.clone_snap' to 'volume-c1947170-472f-4487-bcc3-919b4ef74b71' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:19:59.213250 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [req-b245d362-9474-4740-973e-805390c134a0 req-3b626270-48b3-4d24-9e20-47d9fdeb9e4b tempest-TestVolumeBootPattern-1165351049 None] Created reservations ['815ea40a-de61-4111-8777-6fe065f79287', 'fa747e07-f9d7-4ffe-8ce2-6f82994e1bc4', 'fa49a08b-997e-41b0-b3f3-5af04cfc6518', '38a05c4a-4e63-4a48-8b97-ec190e071c42'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:19:59.275828 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-b245d362-9474-4740-973e-805390c134a0 req-3b626270-48b3-4d24-9e20-47d9fdeb9e4b tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:59.346568 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-b245d362-9474-4740-973e-805390c134a0 req-3b626270-48b3-4d24-9e20-47d9fdeb9e4b tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:19:59.419199 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [req-b245d362-9474-4740-973e-805390c134a0 req-3b626270-48b3-4d24-9e20-47d9fdeb9e4b tempest-TestVolumeBootPattern-1165351049 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:19:59.439294 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-b245d362-9474-4740-973e-805390c134a0 req-3b626270-48b3-4d24-9e20-47d9fdeb9e4b tempest-TestVolumeBootPattern-1165351049 None] Deleted volume successfully. Feb 19 21:19:59.535464 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71.deleted is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:19:59.538760 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:19:59.538994 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:19:59.564822 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:19:59.565431 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Marking volume c1947170-472f-4487-bcc3-919b4ef74b71 as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:19:59.595587 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to c1947170-472f-4487-bcc3-919b4ef74b71. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 21:19:59.596066 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Creating volume glance metadata for volume c1947170-472f-4487-bcc3-919b4ef74b71 backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 21:19:59.607000 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-b245d362-9474-4740-973e-805390c134a0 req-3b626270-48b3-4d24-9e20-47d9fdeb9e4b tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-5e5db658-7e24-489a-865d-cdb5b90212e1-delete_volume'" released by "delete_volume" :: held 1.148s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:19:59.694129 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50891fd-cb9a-4d86-a4f3-ac9f8a1e9e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1947170-472f-4487-bcc3-919b4ef74b71', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:59.699537 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9dc29a-fb9e-44a1-b20e-a457827859ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:59.710525 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Volume volume-c1947170-472f-4487-bcc3-919b4ef74b71 (c1947170-472f-4487-bcc3-919b4ef74b71): created successfully Feb 19 21:19:59.715642 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9dc29a-fb9e-44a1-b20e-a457827859ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:59.721531 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Flow 'volume_create_manager' (152a920a-33a4-4379-8811-5aaacbb8b064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:59.742857 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-10e6100e-f0b4-4d07-9447-fbb07cb58ca1 tempest-VolumesGetTest-1903602593 None] Created volume successfully. Feb 19 21:19:59.870681 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:19:59.874338 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:19:59.874782 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:19:59.902042 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Flow 'volume_create_manager' (360b4467-7b43-408e-b5b7-dc41242f43a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:19:59.909340 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c31bb97-13f9-41c1-96ab-371261053dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:59.916077 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:19:59.931905 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c31bb97-13f9-41c1-96ab-371261053dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-97076881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4eedc749-3216-426f-ba4e-d21d2794b261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4460bc7458364067affd49ffa2f6aad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=79ef619e-5101-4c01-b7d4-3f1d3f1a486c,status='creating',terminated_at=None,updated_at=2022-02-19T21:20:00Z,use_quota=True,user_id='6eb8aded09954e1088ec589d6d0fdd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:59.938194 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13360adf-22bb-4c62-a81f-b7d7cda7c447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:59.942521 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13360adf-22bb-4c62-a81f-b7d7cda7c447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:59.947974 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c802dd2f-ea27-4e6d-be17-0493b97cabf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:59.964690 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c802dd2f-ea27-4e6d-be17-0493b97cabf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4eedc749-3216-426f-ba4e-d21d2794b261', 'volume_name': 'volume-4eedc749-3216-426f-ba4e-d21d2794b261', 'volume_size': 1, 'source_volid': '79ef619e-5101-4c01-b7d4-3f1d3f1a486c', 'source_volstatus': 'available'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:59.969839 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045d49f6-6046-4ce4-bd3c-0c23516b7df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:59.974014 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045d49f6-6046-4ce4-bd3c-0c23516b7df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:19:59.978849 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c9906a-2540-4527-9125-6035c4d56d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:19:59.980544 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Volume 4eedc749-3216-426f-ba4e-d21d2794b261: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4eedc749-3216-426f-ba4e-d21d2794b261', 'volume_size': 1, 'source_volid': '79ef619e-5101-4c01-b7d4-3f1d3f1a486c', 'source_volstatus': 'available'} Feb 19 21:19:59.998309 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:00.096485 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] creating snapshot='volume-4eedc749-3216-426f-ba4e-d21d2794b261.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:20:01.183592 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] cloning 'volume-79ef619e-5101-4c01-b7d4-3f1d3f1a486c@volume-4eedc749-3216-426f-ba4e-d21d2794b261.clone_snap' to 'volume-4eedc749-3216-426f-ba4e-d21d2794b261' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:20:01.216842 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-5829c74e-1c98-418b-be6e-c3492ddefdf0 tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-240980d9-788e-4e35-be1d-0653777578ac-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.025s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:01.218380 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5829c74e-1c98-418b-be6e-c3492ddefdf0 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:01.326617 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-b90b0db5-b0af-4e2c-a8e2-e62880764850 tempest-VolumesBackupsV39Test-918988790 None] Lock "b'cinder-0311b7ea-7813-49d0-9380-40c61569e790-delete_volume'" acquired by "delete_volume" :: waited 0.131s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:01.441855 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71.deleted is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:20:01.443023 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:20:01.443412 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:20:01.467223 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:20:01.467713 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Marking volume 4eedc749-3216-426f-ba4e-d21d2794b261 as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:20:01.474878 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:20:01.478542 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:20:01.479062 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:20:01.502236 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Flow 'volume_create_manager' (5f06f088-c698-446b-8946-dd49962087eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:01.509977 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81aaa0d6-3739-4dae-abb5-b5a9517350a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:01.522135 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:20:01.526567 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Copying metadata from source volume 79ef619e-5101-4c01-b7d4-3f1d3f1a486c to 4eedc749-3216-426f-ba4e-d21d2794b261. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Feb 19 21:20:01.541293 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81aaa0d6-3739-4dae-abb5-b5a9517350a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:20:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1468035979',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd8cd885-f9ea-4597-a2b9-899f7880ea6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b206f017e904c07af8dc6c35551790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:20:01Z,use_quota=True,user_id='f9fb3af08ada44e185561b0e96f5fa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:01.546860 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51149c0e-b102-4cfd-b1e2-cb9cf13f8b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:01.551402 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51149c0e-b102-4cfd-b1e2-cb9cf13f8b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:01.556816 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a719f152-1a17-49c0-b017-097a7cbf5f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:01.561208 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a719f152-1a17-49c0-b017-097a7cbf5f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd8cd885-f9ea-4597-a2b9-899f7880ea6c', 'volume_name': 'volume-cd8cd885-f9ea-4597-a2b9-899f7880ea6c', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:01.566271 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cf6b96-f8a2-4da7-a721-95a907952b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:01.570853 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cf6b96-f8a2-4da7-a721-95a907952b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:01.577603 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9bb94f-da2f-4329-8ae9-08ec7a72dac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:01.578740 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Volume cd8cd885-f9ea-4597-a2b9-899f7880ea6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd8cd885-f9ea-4597-a2b9-899f7880ea6c', 'volume_size': 1} Feb 19 21:20:01.579136 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] creating volume 'volume-cd8cd885-f9ea-4597-a2b9-899f7880ea6c' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:20:01.580155 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:01.640202 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b90b0db5-b0af-4e2c-a8e2-e62880764850 tempest-VolumesBackupsV39Test-918988790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:02.177264 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b90b0db5-b0af-4e2c-a8e2-e62880764850 tempest-VolumesBackupsV39Test-918988790 None] Volume volume-0311b7ea-7813-49d0-9380-40c61569e790 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:20:02.213191 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b90b0db5-b0af-4e2c-a8e2-e62880764850 tempest-VolumesBackupsV39Test-918988790 None] deleting rbd volume volume-0311b7ea-7813-49d0-9380-40c61569e790 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:20:02.220832 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:20:02.221212 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:20:02.225300 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9bb94f-da2f-4329-8ae9-08ec7a72dac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd8cd885-f9ea-4597-a2b9-899f7880ea6c', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:02.232688 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c388676f-d9c9-47fc-81d4-89254db1b49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:02.242229 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Volume volume-cd8cd885-f9ea-4597-a2b9-899f7880ea6c (cd8cd885-f9ea-4597-a2b9-899f7880ea6c): created successfully Feb 19 21:20:02.247202 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c388676f-d9c9-47fc-81d4-89254db1b49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:02.254722 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Flow 'volume_create_manager' (5f06f088-c698-446b-8946-dd49962087eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:02.272814 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c9906a-2540-4527-9125-6035c4d56d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eedc749-3216-426f-ba4e-d21d2794b261', 'volume_size': 1, 'source_volid': '79ef619e-5101-4c01-b7d4-3f1d3f1a486c', 'source_volstatus': 'available'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:02.278336 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e9f4d6-6fa1-4d85-9286-2105f2c658a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:02.289368 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3a45d7f5-ed73-4f75-a7ba-cab1045fec81 tempest-VolumesGetTest-1903602593 None] Created volume successfully. Feb 19 21:20:02.299568 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Volume volume-4eedc749-3216-426f-ba4e-d21d2794b261 (4eedc749-3216-426f-ba4e-d21d2794b261): created successfully Feb 19 21:20:02.310083 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e9f4d6-6fa1-4d85-9286-2105f2c658a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:02.318412 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Flow 'volume_create_manager' (360b4467-7b43-408e-b5b7-dc41242f43a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:02.342713 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-6fb4c583-60d1-4085-aa29-b33ba71240d9 tempest-VolumesCloneTest-592035103 None] Created volume successfully. Feb 19 21:20:02.375883 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-5829c74e-1c98-418b-be6e-c3492ddefdf0 tempest-TestVolumeBootPattern-1165351049 None] Created reservations ['2f391ce0-f4e9-4364-90c9-88c2186103d8', 'b852161f-da73-402d-9202-89cfc0292bd9', '55787842-a953-4012-86db-6e820f83f3f6', '54f5ab33-2ac4-4594-ad81-aaedf1346bc2'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:02.427078 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-5829c74e-1c98-418b-be6e-c3492ddefdf0 tempest-TestVolumeBootPattern-1165351049 None] Delete snapshot completed successfully. Feb 19 21:20:02.433530 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-5829c74e-1c98-418b-be6e-c3492ddefdf0 tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-240980d9-788e-4e35-be1d-0653777578ac-delete_snapshot'" released by "delete_snapshot" :: held 1.217s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:02.522532 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-b90b0db5-b0af-4e2c-a8e2-e62880764850 tempest-VolumesBackupsV39Test-918988790 None] Created reservations ['915ed618-bf41-46bd-b04a-021ceb7f533c', 'f35d86f3-ba27-48d5-b269-61cdedd75a26', 'ebdee944-f778-4686-b5a9-cdd3883dd63b', '91d657e2-ab17-4685-8dde-251a2cb9d0ea'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:02.576919 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b90b0db5-b0af-4e2c-a8e2-e62880764850 tempest-VolumesBackupsV39Test-918988790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:02.616144 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b90b0db5-b0af-4e2c-a8e2-e62880764850 tempest-VolumesBackupsV39Test-918988790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:02.648166 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-b90b0db5-b0af-4e2c-a8e2-e62880764850 tempest-VolumesBackupsV39Test-918988790 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:20:02.653725 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b90b0db5-b0af-4e2c-a8e2-e62880764850 tempest-VolumesBackupsV39Test-918988790 None] Deleted volume successfully. Feb 19 21:20:02.670440 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-b90b0db5-b0af-4e2c-a8e2-e62880764850 tempest-VolumesBackupsV39Test-918988790 None] Lock "b'cinder-0311b7ea-7813-49d0-9380-40c61569e790-delete_volume'" released by "delete_volume" :: held 1.344s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:03.419273 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-be6eb195-6d9a-448c-a4d3-4660e0293e14 tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-cd8cd885-f9ea-4597-a2b9-899f7880ea6c-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:03.513791 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-be6eb195-6d9a-448c-a4d3-4660e0293e14 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:03.594146 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-be6eb195-6d9a-448c-a4d3-4660e0293e14 tempest-VolumesGetTest-1903602593 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:20:03.594146 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-be6eb195-6d9a-448c-a4d3-4660e0293e14 tempest-VolumesGetTest-1903602593 None] Volume volume-cd8cd885-f9ea-4597-a2b9-899f7880ea6c is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:20:03.614293 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-be6eb195-6d9a-448c-a4d3-4660e0293e14 tempest-VolumesGetTest-1903602593 None] deleting rbd volume volume-cd8cd885-f9ea-4597-a2b9-899f7880ea6c {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:20:03.637217 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:20:03.642352 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:20:03.643021 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:20:03.668162 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Flow 'volume_create_manager' (e0966c29-162f-46a4-ae9c-95d196dcab63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:03.675444 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7195bf9-6da4-40c9-a48a-1e358043ccd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:03.679957 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-556d347d-c6b7-4844-94cf-c27b24a0d03e tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-000c5608-10fc-4038-a53d-9e2101a06eeb-delete_volume'" acquired by "delete_volume" :: waited 0.057s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:03.685356 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:20:03.704502 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7195bf9-6da4-40c9-a48a-1e358043ccd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-797558333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a812e2a3-3c48-4520-aa48-3ab7669a5d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4460bc7458364067affd49ffa2f6aad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:20:03Z,use_quota=True,user_id='6eb8aded09954e1088ec589d6d0fdd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:03.711400 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc0bb27-6082-4da7-b3d2-d73f2b2f1ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:03.717022 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc0bb27-6082-4da7-b3d2-d73f2b2f1ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:03.723142 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f4133a-edd8-4d1b-b8eb-66c6b6a83639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:03.728457 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f4133a-edd8-4d1b-b8eb-66c6b6a83639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a812e2a3-3c48-4520-aa48-3ab7669a5d14', 'volume_name': 'volume-a812e2a3-3c48-4520-aa48-3ab7669a5d14', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:03.733889 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f20a2e6-f43b-40bd-8565-3f452c1c8dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:03.739015 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f20a2e6-f43b-40bd-8565-3f452c1c8dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:03.744925 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9973a31-b126-45c1-8e8d-7567d9f180d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:03.746297 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Volume a812e2a3-3c48-4520-aa48-3ab7669a5d14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a812e2a3-3c48-4520-aa48-3ab7669a5d14', 'volume_size': 1} Feb 19 21:20:03.746802 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] creating volume 'volume-a812e2a3-3c48-4520-aa48-3ab7669a5d14' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:20:03.748020 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:03.831458 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-556d347d-c6b7-4844-94cf-c27b24a0d03e tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:03.921367 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-556d347d-c6b7-4844-94cf-c27b24a0d03e tempest-TestVolumeBootPattern-1165351049 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:20:03.931256 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-556d347d-c6b7-4844-94cf-c27b24a0d03e tempest-TestVolumeBootPattern-1165351049 None] deleting rbd volume volume-000c5608-10fc-4038-a53d-9e2101a06eeb {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:20:03.949300 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:20:03.950006 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:20:03.954934 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9973a31-b126-45c1-8e8d-7567d9f180d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a812e2a3-3c48-4520-aa48-3ab7669a5d14', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:03.960248 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc285fd7-0f02-4d46-988f-ada914d2fe0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:03.984171 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Volume volume-a812e2a3-3c48-4520-aa48-3ab7669a5d14 (a812e2a3-3c48-4520-aa48-3ab7669a5d14): created successfully Feb 19 21:20:03.987405 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc285fd7-0f02-4d46-988f-ada914d2fe0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:03.993618 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Flow 'volume_create_manager' (e0966c29-162f-46a4-ae9c-95d196dcab63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:04.020223 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-dd2beb60-36cb-4d85-b0d8-afe408272fc7 tempest-VolumesCloneTest-592035103 None] Created volume successfully. Feb 19 21:20:04.064811 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-be6eb195-6d9a-448c-a4d3-4660e0293e14 tempest-VolumesGetTest-1903602593 None] Created reservations ['7b1a9e75-f757-4730-b124-99c8926c9abb', '1557cf7c-278f-4da1-86de-da302999233d', '701608b2-0d0d-4213-914d-723785b06d04', '424d2e73-cb98-4931-a93b-8863c55f252b'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:04.167766 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-be6eb195-6d9a-448c-a4d3-4660e0293e14 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:04.229977 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-be6eb195-6d9a-448c-a4d3-4660e0293e14 tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:04.273333 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-be6eb195-6d9a-448c-a4d3-4660e0293e14 tempest-VolumesGetTest-1903602593 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:20:04.278072 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-556d347d-c6b7-4844-94cf-c27b24a0d03e tempest-TestVolumeBootPattern-1165351049 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:20:04.322373 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-556d347d-c6b7-4844-94cf-c27b24a0d03e tempest-TestVolumeBootPattern-1165351049 None] deleting parent snapshot volume-000c5608-10fc-4038-a53d-9e2101a06eeb.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:20:05.298609 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-be6eb195-6d9a-448c-a4d3-4660e0293e14 tempest-VolumesGetTest-1903602593 None] Deleted volume successfully. Feb 19 21:20:05.320981 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:20:05.325482 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:20:05.325929 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:20:05.338723 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-4946f21f-57f3-42f8-b048-732de335f56e tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-c1947170-472f-4487-bcc3-919b4ef74b71-delete_volume'" acquired by "delete_volume" :: waited 0.049s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:05.358462 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-4946f21f-57f3-42f8-b048-732de335f56e tempest-VolumesGetTest-1903602593 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:20:05.374605 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Flow 'volume_create_manager' (67e97fa9-e67f-4099-a880-4a2cb0ef4587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:05.381711 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4e08ab-6d98-4bfb-815d-05c883884728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:05.391409 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-be6eb195-6d9a-448c-a4d3-4660e0293e14 tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-cd8cd885-f9ea-4597-a2b9-899f7880ea6c-delete_volume'" released by "delete_volume" :: held 1.972s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:05.413321 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4e08ab-6d98-4bfb-815d-05c883884728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1051922051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=888670fa-2f15-43c6-9529-4b72b4edca6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4460bc7458364067affd49ffa2f6aad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:20:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a812e2a3-3c48-4520-aa48-3ab7669a5d14,status='creating',terminated_at=None,updated_at=2022-02-19T21:20:05Z,use_quota=True,user_id='6eb8aded09954e1088ec589d6d0fdd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:05.427904 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b388c49-2c46-4562-af48-cec74a002111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:05.427904 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b388c49-2c46-4562-af48-cec74a002111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:05.430683 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d02d55f-b37e-44ae-910d-8eb32f627b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:05.452787 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d02d55f-b37e-44ae-910d-8eb32f627b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '888670fa-2f15-43c6-9529-4b72b4edca6a', 'volume_name': 'volume-888670fa-2f15-43c6-9529-4b72b4edca6a', 'volume_size': 2, 'source_volid': 'a812e2a3-3c48-4520-aa48-3ab7669a5d14', 'source_volstatus': 'available'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:05.457958 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c3faa5-3ac5-4d9e-a5a7-9f45fcdba0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:05.462379 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c3faa5-3ac5-4d9e-a5a7-9f45fcdba0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:05.467889 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2daf1c8e-f642-44b4-a1cd-cf16be2444e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:05.469052 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Volume 888670fa-2f15-43c6-9529-4b72b4edca6a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-888670fa-2f15-43c6-9529-4b72b4edca6a', 'volume_size': 2, 'source_volid': 'a812e2a3-3c48-4520-aa48-3ab7669a5d14', 'source_volstatus': 'available'} Feb 19 21:20:05.497763 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:05.553745 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] creating snapshot='volume-888670fa-2f15-43c6-9529-4b72b4edca6a.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:20:06.278405 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] cloning 'volume-a812e2a3-3c48-4520-aa48-3ab7669a5d14@volume-888670fa-2f15-43c6-9529-4b72b4edca6a.clone_snap' to 'volume-888670fa-2f15-43c6-9529-4b72b4edca6a' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:20:06.329933 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4946f21f-57f3-42f8-b048-732de335f56e tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:06.408364 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4946f21f-57f3-42f8-b048-732de335f56e tempest-VolumesGetTest-1903602593 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:20:06.415783 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4946f21f-57f3-42f8-b048-732de335f56e tempest-VolumesGetTest-1903602593 None] deleting rbd volume volume-c1947170-472f-4487-bcc3-919b4ef74b71 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:20:06.434227 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Volume volume-a812e2a3-3c48-4520-aa48-3ab7669a5d14 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:20:06.435464 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:20:06.435881 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:20:06.458343 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] resize volume 'volume-888670fa-2f15-43c6-9529-4b72b4edca6a' from 1 to 2 {{(pid=129319) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:694}} Feb 19 21:20:06.460792 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:06.552022 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:20:06.556668 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:20:06.558328 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:20:06.594832 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Flow 'volume_create_manager' (de43263a-7546-47c1-81f9-37f596f5986e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:06.599840 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c95aa2-7da5-44f3-8f52-a94ad2a934a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:06.602835 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-556d347d-c6b7-4844-94cf-c27b24a0d03e tempest-TestVolumeBootPattern-1165351049 None] Created reservations ['25ecb423-c38e-4e64-abd9-aa221ad8d711', 'e3c9be16-9867-4662-9d6a-152e32dbcddd', '1a7233e1-2bb0-47b3-8eb0-aefb0b3ac11e', 'fd60bde3-768b-4d47-bf85-3845af616227'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:06.617041 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:20:06.646194 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c95aa2-7da5-44f3-8f52-a94ad2a934a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1263074972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=35da5921-5c20-4565-9cff-5f9afd0ebd0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f101b14d492c4f419d522cfbd3a863e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:20:06Z,use_quota=True,user_id='12833678dba14769b444cbff3ccdb9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:06.652282 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a50626-4173-417d-a249-1cee74a4b7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:06.657066 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a50626-4173-417d-a249-1cee74a4b7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:06.662629 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b3e280-ee9f-4873-986e-68caa4c0ed4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:06.667670 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b3e280-ee9f-4873-986e-68caa4c0ed4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35da5921-5c20-4565-9cff-5f9afd0ebd0d', 'volume_name': 'volume-35da5921-5c20-4565-9cff-5f9afd0ebd0d', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:06.673037 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e9deab-29d5-442b-8724-7ae15fc0cc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:06.677856 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e9deab-29d5-442b-8724-7ae15fc0cc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:06.683366 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4462a5-e906-4293-bf37-5b7a6948c3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:06.684620 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Volume 35da5921-5c20-4565-9cff-5f9afd0ebd0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35da5921-5c20-4565-9cff-5f9afd0ebd0d', 'volume_size': 1} Feb 19 21:20:06.685019 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] creating volume 'volume-35da5921-5c20-4565-9cff-5f9afd0ebd0d' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:20:06.686076 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:06.753596 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:20:06.762545 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2daf1c8e-f642-44b4-a1cd-cf16be2444e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-888670fa-2f15-43c6-9529-4b72b4edca6a', 'volume_size': 2, 'source_volid': 'a812e2a3-3c48-4520-aa48-3ab7669a5d14', 'source_volstatus': 'available'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:06.764721 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73013ef-a3a1-43b0-a9b8-bfcde1e9c4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:06.769163 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4946f21f-57f3-42f8-b048-732de335f56e tempest-VolumesGetTest-1903602593 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:20:06.811812 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4946f21f-57f3-42f8-b048-732de335f56e tempest-VolumesGetTest-1903602593 None] deleting parent snapshot volume-c1947170-472f-4487-bcc3-919b4ef74b71.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:20:06.978526 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:20:06.979562 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:20:06.983572 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4462a5-e906-4293-bf37-5b7a6948c3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35da5921-5c20-4565-9cff-5f9afd0ebd0d', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:06.989074 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0939142e-dd98-4c32-9cf0-ef696aa9b8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:07.014305 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Volume volume-888670fa-2f15-43c6-9529-4b72b4edca6a (888670fa-2f15-43c6-9529-4b72b4edca6a): created successfully Feb 19 21:20:07.018686 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73013ef-a3a1-43b0-a9b8-bfcde1e9c4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:07.024366 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Flow 'volume_create_manager' (67e97fa9-e67f-4099-a880-4a2cb0ef4587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:07.036934 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Volume volume-35da5921-5c20-4565-9cff-5f9afd0ebd0d (35da5921-5c20-4565-9cff-5f9afd0ebd0d): created successfully Feb 19 21:20:07.037490 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0939142e-dd98-4c32-9cf0-ef696aa9b8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:07.043724 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Flow 'volume_create_manager' (de43263a-7546-47c1-81f9-37f596f5986e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:07.074068 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-80eea173-e5a6-4cff-abad-a9213c6cf8b2 tempest-VolumesCloneTest-592035103 None] Created volume successfully. Feb 19 21:20:07.077284 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-e8bcfa38-a09e-433c-83a7-270dfd307eff tempest-VolumesNegativeTest-2097690783 None] Created volume successfully. Feb 19 21:20:07.113019 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-556d347d-c6b7-4844-94cf-c27b24a0d03e tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:07.141408 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-556d347d-c6b7-4844-94cf-c27b24a0d03e tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:07.194410 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-556d347d-c6b7-4844-94cf-c27b24a0d03e tempest-TestVolumeBootPattern-1165351049 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:20:07.202260 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-556d347d-c6b7-4844-94cf-c27b24a0d03e tempest-TestVolumeBootPattern-1165351049 None] Deleted volume successfully. Feb 19 21:20:07.212457 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-4946f21f-57f3-42f8-b048-732de335f56e tempest-VolumesGetTest-1903602593 None] Created reservations ['b4e664c6-d037-4ca5-bd0c-05a9a87c3dc3', 'e6dc72a7-205b-4a2f-8a77-0fc99010411b', '37635278-2ea2-4da6-9e4c-926be79fcf63', '3296d2f5-7a0a-4a1c-a538-b5c17f53e6fd'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:07.220217 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-556d347d-c6b7-4844-94cf-c27b24a0d03e tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-000c5608-10fc-4038-a53d-9e2101a06eeb-delete_volume'" released by "delete_volume" :: held 3.540s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:07.271381 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4946f21f-57f3-42f8-b048-732de335f56e tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:07.306813 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-4946f21f-57f3-42f8-b048-732de335f56e tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:07.350548 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-4946f21f-57f3-42f8-b048-732de335f56e tempest-VolumesGetTest-1903602593 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:20:07.357134 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-4946f21f-57f3-42f8-b048-732de335f56e tempest-VolumesGetTest-1903602593 None] Deleted volume successfully. Feb 19 21:20:07.379254 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-4946f21f-57f3-42f8-b048-732de335f56e tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-c1947170-472f-4487-bcc3-919b4ef74b71-delete_volume'" released by "delete_volume" :: held 2.041s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:07.926280 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-9f5e32fd-173b-4bb2-a766-40f7720f8a8e tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-2d37ca0a-0f0e-439a-9171-42c9ebc0fa29-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:07.983751 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9f5e32fd-173b-4bb2-a766-40f7720f8a8e tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:08.094248 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9f5e32fd-173b-4bb2-a766-40f7720f8a8e tempest-VolumesGetTest-1903602593 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:20:08.095079 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9f5e32fd-173b-4bb2-a766-40f7720f8a8e tempest-VolumesGetTest-1903602593 None] Volume volume-2d37ca0a-0f0e-439a-9171-42c9ebc0fa29 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:20:08.106439 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9f5e32fd-173b-4bb2-a766-40f7720f8a8e tempest-VolumesGetTest-1903602593 None] deleting rbd volume volume-2d37ca0a-0f0e-439a-9171-42c9ebc0fa29 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:20:08.283739 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-78c1e67c-35e7-4597-9d9b-de67afed13fa tempest-VolumesCloneTest-592035103 None] Lock "b'cinder-888670fa-2f15-43c6-9529-4b72b4edca6a-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:08.346049 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-78c1e67c-35e7-4597-9d9b-de67afed13fa tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:08.423711 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-78c1e67c-35e7-4597-9d9b-de67afed13fa tempest-VolumesCloneTest-592035103 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:20:08.440037 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-78c1e67c-35e7-4597-9d9b-de67afed13fa tempest-VolumesCloneTest-592035103 None] deleting rbd volume volume-888670fa-2f15-43c6-9529-4b72b4edca6a {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:20:08.533672 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-9f5e32fd-173b-4bb2-a766-40f7720f8a8e tempest-VolumesGetTest-1903602593 None] Created reservations ['4114db1e-8efc-4a34-b49f-fe8ec511ad6b', '66dc4167-6757-4f69-8fd3-8fa156809cd8', 'bbd4daad-d8c1-4988-b95d-207de77bb84b', '36c0f4fc-9ca0-433d-a40f-16a3a044fb2a'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:08.633027 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9f5e32fd-173b-4bb2-a766-40f7720f8a8e tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:08.736600 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9f5e32fd-173b-4bb2-a766-40f7720f8a8e tempest-VolumesGetTest-1903602593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:08.790960 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-9f5e32fd-173b-4bb2-a766-40f7720f8a8e tempest-VolumesGetTest-1903602593 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:20:08.798172 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-9f5e32fd-173b-4bb2-a766-40f7720f8a8e tempest-VolumesGetTest-1903602593 None] Deleted volume successfully. Feb 19 21:20:08.819002 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-9f5e32fd-173b-4bb2-a766-40f7720f8a8e tempest-VolumesGetTest-1903602593 None] Lock "b'cinder-2d37ca0a-0f0e-439a-9171-42c9ebc0fa29-delete_volume'" released by "delete_volume" :: held 0.892s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:08.820545 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-78c1e67c-35e7-4597-9d9b-de67afed13fa tempest-VolumesCloneTest-592035103 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:20:08.849283 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-78c1e67c-35e7-4597-9d9b-de67afed13fa tempest-VolumesCloneTest-592035103 None] Volume volume-a812e2a3-3c48-4520-aa48-3ab7669a5d14 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:20:08.851511 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-78c1e67c-35e7-4597-9d9b-de67afed13fa tempest-VolumesCloneTest-592035103 None] deleting parent snapshot volume-888670fa-2f15-43c6-9529-4b72b4edca6a.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:20:09.433978 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:20:09.439133 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:20:09.439949 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:20:09.466129 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Flow 'volume_create_manager' (ca41cce0-3d17-4655-a472-b663596257a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:09.475939 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84ea036-eceb-4e6d-9640-212d19365f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:09.494916 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:20:09.505959 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-78c1e67c-35e7-4597-9d9b-de67afed13fa tempest-VolumesCloneTest-592035103 None] Created reservations ['09b7377c-ac7c-4d86-a3f3-7f62946095d8', '6e3a9b72-d614-4124-b13f-0009dbcca9ad', '051895c9-c0ca-4fe2-9bbc-15af2d9f0db8', 'bcf4eb78-2b02-4232-ba78-aec2d567cd81'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:09.515245 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84ea036-eceb-4e6d-9640-212d19365f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1810334769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=810eb069-3450-4d86-bd8b-728ffd2bc8f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88a055c429b4b9e8e86a370c8571785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:20:09Z,use_quota=True,user_id='2af13ad54ab048d495e5ff0c0453abb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:09.520968 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcbb0bd-282c-489c-b29a-d778928e0241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:09.525532 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcbb0bd-282c-489c-b29a-d778928e0241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:09.531568 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c620e71-ab22-4323-8ca7-af48d0bbef20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:09.626858 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-78c1e67c-35e7-4597-9d9b-de67afed13fa tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:09.691979 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-78c1e67c-35e7-4597-9d9b-de67afed13fa tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:09.770180 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-78c1e67c-35e7-4597-9d9b-de67afed13fa tempest-VolumesCloneTest-592035103 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:20:09.776401 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-78c1e67c-35e7-4597-9d9b-de67afed13fa tempest-VolumesCloneTest-592035103 None] Deleted volume successfully. Feb 19 21:20:09.805564 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-78c1e67c-35e7-4597-9d9b-de67afed13fa tempest-VolumesCloneTest-592035103 None] Lock "b'cinder-888670fa-2f15-43c6-9529-4b72b4edca6a-delete_volume'" released by "delete_volume" :: held 1.522s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:09.817526 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c620e71-ab22-4323-8ca7-af48d0bbef20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '810eb069-3450-4d86-bd8b-728ffd2bc8f6', 'volume_name': 'volume-810eb069-3450-4d86-bd8b-728ffd2bc8f6', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:09.828085 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512c9777-a9be-4c09-a542-38715dd6f875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:09.836181 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512c9777-a9be-4c09-a542-38715dd6f875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:09.843789 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12187fe-73b9-4efa-8b7a-cff64caa3f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:09.845171 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Volume 810eb069-3450-4d86-bd8b-728ffd2bc8f6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-810eb069-3450-4d86-bd8b-728ffd2bc8f6', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 21:20:09.845967 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Cloning 810eb069-3450-4d86-bd8b-728ffd2bc8f6 from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 21:20:09.859759 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:09.873801 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 20, 9, 864691)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:20:09.874730 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:20:09.875793 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Found cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 19 21:20:09.884031 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 0.024s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:09.885259 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 21:20:09.894071 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 20, 9, 889738)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:20:09.894732 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:20:09.895369 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Creating from source image-volume d609c16c-1e31-4237-8163-d85a8fcc768b {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 19 21:20:09.917208 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:10.009473 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] creating snapshot='volume-810eb069-3450-4d86-bd8b-728ffd2bc8f6.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:20:10.362152 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] cloning 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b@volume-810eb069-3450-4d86-bd8b-728ffd2bc8f6.clone_snap' to 'volume-810eb069-3450-4d86-bd8b-728ffd2bc8f6' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:20:10.579929 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71.deleted is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:20:10.581813 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:20:10.582245 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:20:10.631691 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:20:10.633459 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Marking volume 810eb069-3450-4d86-bd8b-728ffd2bc8f6 as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:20:10.655672 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to 810eb069-3450-4d86-bd8b-728ffd2bc8f6. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 21:20:10.656668 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Creating volume glance metadata for volume 810eb069-3450-4d86-bd8b-728ffd2bc8f6 backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 21:20:10.662545 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-979cb001-fe84-4b95-acab-7ece658c8f48 tempest-VolumesCloneTest-592035103 None] Lock "b'cinder-a812e2a3-3c48-4520-aa48-3ab7669a5d14-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:10.733232 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-979cb001-fe84-4b95-acab-7ece658c8f48 tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:10.792854 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-979cb001-fe84-4b95-acab-7ece658c8f48 tempest-VolumesCloneTest-592035103 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:20:10.793533 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-979cb001-fe84-4b95-acab-7ece658c8f48 tempest-VolumesCloneTest-592035103 None] Volume volume-a812e2a3-3c48-4520-aa48-3ab7669a5d14 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:20:10.810950 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-979cb001-fe84-4b95-acab-7ece658c8f48 tempest-VolumesCloneTest-592035103 None] deleting rbd volume volume-a812e2a3-3c48-4520-aa48-3ab7669a5d14 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:20:10.908038 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12187fe-73b9-4efa-8b7a-cff64caa3f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-810eb069-3450-4d86-bd8b-728ffd2bc8f6', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:10.918766 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aaa3bfb-edb4-41b5-87ab-d5f4287f5fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:10.954833 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Volume volume-810eb069-3450-4d86-bd8b-728ffd2bc8f6 (810eb069-3450-4d86-bd8b-728ffd2bc8f6): created successfully Feb 19 21:20:10.966604 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aaa3bfb-edb4-41b5-87ab-d5f4287f5fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:10.988535 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Flow 'volume_create_manager' (ca41cce0-3d17-4655-a472-b663596257a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:11.009389 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b5ecd815-7010-4c55-9d63-5647ca1f9fde tempest-TestVolumeBootPattern-1165351049 None] Created volume successfully. Feb 19 21:20:11.242519 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-979cb001-fe84-4b95-acab-7ece658c8f48 tempest-VolumesCloneTest-592035103 None] Created reservations ['29d03b3e-347b-4925-b511-87b58fa71a42', '5c6a7e24-4a89-43b8-83fc-dfa7e19b7112', 'f86e3f29-b9c0-4be3-aba7-9564c82c9567', 'cc54d97e-2f08-4488-ac86-7b99887d9108'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:11.306441 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-979cb001-fe84-4b95-acab-7ece658c8f48 tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:11.367216 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-979cb001-fe84-4b95-acab-7ece658c8f48 tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:11.430631 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-979cb001-fe84-4b95-acab-7ece658c8f48 tempest-VolumesCloneTest-592035103 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:20:11.436825 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-979cb001-fe84-4b95-acab-7ece658c8f48 tempest-VolumesCloneTest-592035103 None] Deleted volume successfully. Feb 19 21:20:11.458528 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-979cb001-fe84-4b95-acab-7ece658c8f48 tempest-VolumesCloneTest-592035103 None] Lock "b'cinder-a812e2a3-3c48-4520-aa48-3ab7669a5d14-delete_volume'" released by "delete_volume" :: held 0.797s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:11.798200 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a08aa448-413a-44b0-aa72-05fae561832d tempest-VolumesCloneTest-592035103 None] Lock "b'cinder-4eedc749-3216-426f-ba4e-d21d2794b261-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:11.871790 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a08aa448-413a-44b0-aa72-05fae561832d tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:12.067150 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a08aa448-413a-44b0-aa72-05fae561832d tempest-VolumesCloneTest-592035103 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:20:12.085298 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a08aa448-413a-44b0-aa72-05fae561832d tempest-VolumesCloneTest-592035103 None] deleting rbd volume volume-4eedc749-3216-426f-ba4e-d21d2794b261 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:20:12.629662 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a08aa448-413a-44b0-aa72-05fae561832d tempest-VolumesCloneTest-592035103 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:20:12.681979 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a08aa448-413a-44b0-aa72-05fae561832d tempest-VolumesCloneTest-592035103 None] deleting parent snapshot volume-4eedc749-3216-426f-ba4e-d21d2794b261.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:20:13.503449 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-a08aa448-413a-44b0-aa72-05fae561832d tempest-VolumesCloneTest-592035103 None] Created reservations ['6b090f81-e8dc-42be-8ee8-df30a020cdc5', 'b4d8a059-9e67-458b-988d-44a9c9d9d572', '6c3495f7-9f34-4285-91ed-f82d4b4e9374', '84c0cb72-d735-43cb-95b0-b869249ce95b'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:13.567734 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a08aa448-413a-44b0-aa72-05fae561832d tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:13.650029 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a08aa448-413a-44b0-aa72-05fae561832d tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:13.714780 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-a08aa448-413a-44b0-aa72-05fae561832d tempest-VolumesCloneTest-592035103 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:20:13.719307 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a08aa448-413a-44b0-aa72-05fae561832d tempest-VolumesCloneTest-592035103 None] Deleted volume successfully. Feb 19 21:20:13.751711 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a08aa448-413a-44b0-aa72-05fae561832d tempest-VolumesCloneTest-592035103 None] Lock "b'cinder-4eedc749-3216-426f-ba4e-d21d2794b261-delete_volume'" released by "delete_volume" :: held 1.953s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:14.024265 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-ea3f9e22-8fd4-4547-a5ee-52ba4f3a4c80 tempest-VolumesCloneTest-592035103 None] Lock "b'cinder-79ef619e-5101-4c01-b7d4-3f1d3f1a486c-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:14.089991 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ea3f9e22-8fd4-4547-a5ee-52ba4f3a4c80 tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:14.203817 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ea3f9e22-8fd4-4547-a5ee-52ba4f3a4c80 tempest-VolumesCloneTest-592035103 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:20:14.213457 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ea3f9e22-8fd4-4547-a5ee-52ba4f3a4c80 tempest-VolumesCloneTest-592035103 None] deleting rbd volume volume-79ef619e-5101-4c01-b7d4-3f1d3f1a486c {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:20:14.516973 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ea3f9e22-8fd4-4547-a5ee-52ba4f3a4c80 tempest-VolumesCloneTest-592035103 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:20:14.558179 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ea3f9e22-8fd4-4547-a5ee-52ba4f3a4c80 tempest-VolumesCloneTest-592035103 None] deleting parent snapshot volume-79ef619e-5101-4c01-b7d4-3f1d3f1a486c.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:20:15.533545 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-5efc329b-b80a-4d50-b8bf-d54e30280c82 req-24394022-d514-47f1-a12e-671410feb24b tempest-TestVolumeBootPattern-1165351049 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:20:15.597289 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-ea3f9e22-8fd4-4547-a5ee-52ba4f3a4c80 tempest-VolumesCloneTest-592035103 None] Created reservations ['fea66932-7a0b-453a-af96-593c2cbc4a50', '50fad5a3-d2eb-43d8-9d9f-f60779a04fe5', '0808980f-0063-40f5-992d-e63fa556baa9', '774b9417-42b8-4773-afc0-23cb83380be0'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:15.672725 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ea3f9e22-8fd4-4547-a5ee-52ba4f3a4c80 tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:15.746865 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-ea3f9e22-8fd4-4547-a5ee-52ba4f3a4c80 tempest-VolumesCloneTest-592035103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:15.796891 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-ea3f9e22-8fd4-4547-a5ee-52ba4f3a4c80 tempest-VolumesCloneTest-592035103 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:20:15.802049 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-ea3f9e22-8fd4-4547-a5ee-52ba4f3a4c80 tempest-VolumesCloneTest-592035103 None] Deleted volume successfully. Feb 19 21:20:15.817908 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-ea3f9e22-8fd4-4547-a5ee-52ba4f3a4c80 tempest-VolumesCloneTest-592035103 None] Lock "b'cinder-79ef619e-5101-4c01-b7d4-3f1d3f1a486c-delete_volume'" released by "delete_volume" :: held 1.794s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:16.282105 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-5efc329b-b80a-4d50-b8bf-d54e30280c82 req-24394022-d514-47f1-a12e-671410feb24b tempest-TestVolumeBootPattern-1165351049 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.750s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:20:16.283496 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-5efc329b-b80a-4d50-b8bf-d54e30280c82 req-24394022-d514-47f1-a12e-671410feb24b tempest-TestVolumeBootPattern-1165351049 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-810eb069-3450-4d86-bd8b-728ffd2bc8f6', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '810eb069-3450-4d86-bd8b-728ffd2bc8f6', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:20:16.326400 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-5efc329b-b80a-4d50-b8bf-d54e30280c82 req-24394022-d514-47f1-a12e-671410feb24b tempest-TestVolumeBootPattern-1165351049 None] Connection info returned from driver {'name': 'volumes/volume-810eb069-3450-4d86-bd8b-728ffd2bc8f6', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '810eb069-3450-4d86-bd8b-728ffd2bc8f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1c5891b3-8b8a-4ebe-a415-e206ff5212bc'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:20:16.432679 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-5efc329b-b80a-4d50-b8bf-d54e30280c82 req-24394022-d514-47f1-a12e-671410feb24b tempest-TestVolumeBootPattern-1165351049 None] attachment_update completed successfully. Feb 19 21:20:18.664313 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:20:18.671180 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:20:18.671857 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:20:18.697263 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Flow 'volume_create_manager' (145d152c-48c6-452c-987f-949607402418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:18.704742 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f63f74b-2878-46c0-b49c-2de58b2d7434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:18.714584 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:20:18.730505 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f63f74b-2878-46c0-b49c-2de58b2d7434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-125236859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e39ecf95-57e4-4669-9ae3-b9c454848805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd5f6c5ad7a43ebb775aa4a8f3cfa5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:20:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:20:19Z,use_quota=True,user_id='d518555ca5f449eaa82cf50963757769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:18.740663 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0062cb00-38c2-4d22-af0d-b976be8ee72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:18.746271 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0062cb00-38c2-4d22-af0d-b976be8ee72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:18.752210 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01830f8-c440-4732-bb69-fbefe50e2ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:18.756532 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01830f8-c440-4732-bb69-fbefe50e2ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e39ecf95-57e4-4669-9ae3-b9c454848805', 'volume_name': 'volume-e39ecf95-57e4-4669-9ae3-b9c454848805', 'volume_size': 2}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:18.762108 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc417a0-d881-4d48-8a42-551929877f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:18.766537 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc417a0-d881-4d48-8a42-551929877f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:18.771398 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7016f706-8c42-402f-b089-725601ab09c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:18.772543 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Volume e39ecf95-57e4-4669-9ae3-b9c454848805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e39ecf95-57e4-4669-9ae3-b9c454848805', 'volume_size': 2} Feb 19 21:20:18.772980 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] creating volume 'volume-e39ecf95-57e4-4669-9ae3-b9c454848805' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:20:18.774077 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:18.851792 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:20:18.852168 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:20:18.855899 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7016f706-8c42-402f-b089-725601ab09c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e39ecf95-57e4-4669-9ae3-b9c454848805', 'volume_size': 2}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:18.860542 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371da058-a3fc-496a-b076-6d547a16edf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:18.870145 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Volume volume-e39ecf95-57e4-4669-9ae3-b9c454848805 (e39ecf95-57e4-4669-9ae3-b9c454848805): created successfully Feb 19 21:20:18.876512 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371da058-a3fc-496a-b076-6d547a16edf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:18.886578 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Flow 'volume_create_manager' (145d152c-48c6-452c-987f-949607402418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:18.898407 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-c7102583-8615-484a-99b8-a86117adf5f7 tempest-VolumesCloneNegativeTest-1139111870 None] Created volume successfully. Feb 19 21:20:19.761583 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-cab078a0-0033-45ea-bea2-19fc04615d3f tempest-VolumesCloneNegativeTest-1139111870 None] Lock "b'cinder-e39ecf95-57e4-4669-9ae3-b9c454848805-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:19.810471 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cab078a0-0033-45ea-bea2-19fc04615d3f tempest-VolumesCloneNegativeTest-1139111870 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:19.866241 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cab078a0-0033-45ea-bea2-19fc04615d3f tempest-VolumesCloneNegativeTest-1139111870 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:20:19.866812 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cab078a0-0033-45ea-bea2-19fc04615d3f tempest-VolumesCloneNegativeTest-1139111870 None] Volume volume-e39ecf95-57e4-4669-9ae3-b9c454848805 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:20:19.876965 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cab078a0-0033-45ea-bea2-19fc04615d3f tempest-VolumesCloneNegativeTest-1139111870 None] deleting rbd volume volume-e39ecf95-57e4-4669-9ae3-b9c454848805 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:20:20.158439 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-cab078a0-0033-45ea-bea2-19fc04615d3f tempest-VolumesCloneNegativeTest-1139111870 None] Created reservations ['8339695a-f52c-41ff-a2a7-13cca438fdc5', '90ab0fdc-ec63-4fca-9312-3c4865776d41', '536b1a13-a089-4977-bf76-07733ab23a8a', '742be7ca-5e18-4bad-b6ff-5e82f6260266'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:20.233830 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cab078a0-0033-45ea-bea2-19fc04615d3f tempest-VolumesCloneNegativeTest-1139111870 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:20.264799 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-cab078a0-0033-45ea-bea2-19fc04615d3f tempest-VolumesCloneNegativeTest-1139111870 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:20.301459 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-cab078a0-0033-45ea-bea2-19fc04615d3f tempest-VolumesCloneNegativeTest-1139111870 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:20:20.307022 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-cab078a0-0033-45ea-bea2-19fc04615d3f tempest-VolumesCloneNegativeTest-1139111870 None] Deleted volume successfully. Feb 19 21:20:20.326051 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-cab078a0-0033-45ea-bea2-19fc04615d3f tempest-VolumesCloneNegativeTest-1139111870 None] Lock "b'cinder-e39ecf95-57e4-4669-9ae3-b9c454848805-delete_volume'" released by "delete_volume" :: held 0.560s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:22.180038 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:20:22.180991 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:22.216660 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:22.292391 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:20:23.435984 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:20:23.445970 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:20:23.446442 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:20:23.491393 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Flow 'volume_create_manager' (617db0ae-9b2f-4aae-bc1c-cfc96b73f3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:23.513332 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396423d4-68db-4eda-ab77-ab0922c1e784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:23.530780 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:20:23.550775 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396423d4-68db-4eda-ab77-ab0922c1e784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-930143158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=55645b60-c220-4320-ad52-3edf2f1df8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7674fc9fd1364fc19f4d3a3f29fff526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:20:23Z,use_quota=True,user_id='40b5203563744c88bd24defd8f677904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:23.557636 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed3b390-16a5-4450-ab30-49a30bd9bd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:23.563697 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed3b390-16a5-4450-ab30-49a30bd9bd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:23.578384 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8fb8f4-0472-42f4-906a-195df77aa361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:23.586709 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8fb8f4-0472-42f4-906a-195df77aa361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55645b60-c220-4320-ad52-3edf2f1df8ab', 'volume_name': 'volume-55645b60-c220-4320-ad52-3edf2f1df8ab', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:23.595642 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4ac84a-f3d5-4342-8d83-06b7fbeee104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:23.603077 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4ac84a-f3d5-4342-8d83-06b7fbeee104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:23.613369 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67eaafd7-3350-4d7b-9863-dc21ae1fd3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:23.615505 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Volume 55645b60-c220-4320-ad52-3edf2f1df8ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55645b60-c220-4320-ad52-3edf2f1df8ab', 'volume_size': 1} Feb 19 21:20:23.616292 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] creating volume 'volume-55645b60-c220-4320-ad52-3edf2f1df8ab' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:20:23.618084 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:23.740307 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:20:23.741195 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:20:23.746426 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67eaafd7-3350-4d7b-9863-dc21ae1fd3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55645b60-c220-4320-ad52-3edf2f1df8ab', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:23.754011 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9933cc61-3ed8-487d-b490-0babb91286da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:23.773115 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Volume volume-55645b60-c220-4320-ad52-3edf2f1df8ab (55645b60-c220-4320-ad52-3edf2f1df8ab): created successfully Feb 19 21:20:23.778112 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9933cc61-3ed8-487d-b490-0babb91286da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:23.784405 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Flow 'volume_create_manager' (617db0ae-9b2f-4aae-bc1c-cfc96b73f3a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:23.797255 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d13e132e-cc57-47fa-b3fc-c3eb3cd0ccf0 tempest-VolumesSnapshotListTestJSON-20808177 None] Created volume successfully. Feb 19 21:20:24.665397 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-09a4e583-d9c3-4f31-a050-a4884e6142ea tempest-VolumesSnapshotListTestJSON-20808177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:25.549281 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-09a4e583-d9c3-4f31-a050-a4884e6142ea tempest-VolumesSnapshotListTestJSON-20808177 None] Create snapshot completed successfully Feb 19 21:20:26.068062 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-984586ff-2949-43fa-b860-6808e2089e0f tempest-VolumesSnapshotListTestJSON-20808177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:26.542817 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-984586ff-2949-43fa-b860-6808e2089e0f tempest-VolumesSnapshotListTestJSON-20808177 None] Create snapshot completed successfully Feb 19 21:20:27.430049 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-fdb08d7d-b827-4277-a254-23ebc185eec2 tempest-VolumesSnapshotListTestJSON-20808177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:28.599730 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-fdb08d7d-b827-4277-a254-23ebc185eec2 tempest-VolumesSnapshotListTestJSON-20808177 None] Create snapshot completed successfully Feb 19 21:20:30.762179 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-91c144b1-07d1-4446-8558-ab517e21aa32 req-39b21eef-ae86-4aa3-817e-16244dd203f6 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:30.895863 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-7b151e31-e725-4194-861d-144187942b1b tempest-VolumesSnapshotListTestJSON-20808177 None] Lock "b'cinder-b6f00053-2d7d-419d-adad-98419ba57a79-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:30.897548 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-7b151e31-e725-4194-861d-144187942b1b tempest-VolumesSnapshotListTestJSON-20808177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:30.985135 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-9fb20695-5ee3-42db-a707-51c20f282dfe tempest-VolumesNegativeTest-2097690783 None] Lock "b'cinder-35da5921-5c20-4565-9cff-5f9afd0ebd0d-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:31.049724 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9fb20695-5ee3-42db-a707-51c20f282dfe tempest-VolumesNegativeTest-2097690783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:31.119900 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9fb20695-5ee3-42db-a707-51c20f282dfe tempest-VolumesNegativeTest-2097690783 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:20:31.120350 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9fb20695-5ee3-42db-a707-51c20f282dfe tempest-VolumesNegativeTest-2097690783 None] Volume volume-35da5921-5c20-4565-9cff-5f9afd0ebd0d is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:20:31.129158 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9fb20695-5ee3-42db-a707-51c20f282dfe tempest-VolumesNegativeTest-2097690783 None] deleting rbd volume volume-35da5921-5c20-4565-9cff-5f9afd0ebd0d {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:20:31.574101 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-9fb20695-5ee3-42db-a707-51c20f282dfe tempest-VolumesNegativeTest-2097690783 None] Created reservations ['74d8e2c5-a548-4f68-aabe-7d30b154661e', '7aaf5f5f-6b39-43f3-b8c3-34a698a02ff4', '1cc8224e-fb6d-45e5-b1fb-2819713e5ec1', '75004a00-777d-4047-9d83-05e18680d7d6'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:31.667375 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9fb20695-5ee3-42db-a707-51c20f282dfe tempest-VolumesNegativeTest-2097690783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:31.695861 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9fb20695-5ee3-42db-a707-51c20f282dfe tempest-VolumesNegativeTest-2097690783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:31.740724 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-9fb20695-5ee3-42db-a707-51c20f282dfe tempest-VolumesNegativeTest-2097690783 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:20:31.747544 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-9fb20695-5ee3-42db-a707-51c20f282dfe tempest-VolumesNegativeTest-2097690783 None] Deleted volume successfully. Feb 19 21:20:31.786631 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-9fb20695-5ee3-42db-a707-51c20f282dfe tempest-VolumesNegativeTest-2097690783 None] Lock "b'cinder-35da5921-5c20-4565-9cff-5f9afd0ebd0d-delete_volume'" released by "delete_volume" :: held 0.802s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:31.853499 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-7b151e31-e725-4194-861d-144187942b1b tempest-VolumesSnapshotListTestJSON-20808177 None] Created reservations ['466e6e3a-0c0c-4017-8e7d-6cf251a57255', '418b9ce1-78f8-430c-b937-40f72f076789', '17c03e9a-f4c9-4b2f-96b8-ca27182793a8', 'd2b77f41-42e1-4229-a422-b73387727a9d'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:31.902370 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-91c144b1-07d1-4446-8558-ab517e21aa32 req-39b21eef-ae86-4aa3-817e-16244dd203f6 tempest-TestVolumeBootPattern-1165351049 None] Create snapshot completed successfully Feb 19 21:20:31.929972 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-7b151e31-e725-4194-861d-144187942b1b tempest-VolumesSnapshotListTestJSON-20808177 None] Delete snapshot completed successfully. Feb 19 21:20:31.937639 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-7b151e31-e725-4194-861d-144187942b1b tempest-VolumesSnapshotListTestJSON-20808177 None] Lock "b'cinder-b6f00053-2d7d-419d-adad-98419ba57a79-delete_snapshot'" released by "delete_snapshot" :: held 1.042s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:33.049455 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3f75b88f-a651-4119-976a-5889611b9428 tempest-VolumesSnapshotListTestJSON-20808177 None] Lock "b'cinder-c0f7cd1d-c9e8-4240-8d74-fe6158bcdadb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:33.052121 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3f75b88f-a651-4119-976a-5889611b9428 tempest-VolumesSnapshotListTestJSON-20808177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:33.716667 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-3f75b88f-a651-4119-976a-5889611b9428 tempest-VolumesSnapshotListTestJSON-20808177 None] Created reservations ['d503e244-700a-400f-8fb0-10e86f4b400f', 'a77615dc-f6bd-46c9-9768-9c76bd44e519', '8ec3667b-dfd0-4e53-a95f-da34fb1c3b5f', '2e658fb8-b647-419c-bf8b-39386fd63307'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:33.781600 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-3f75b88f-a651-4119-976a-5889611b9428 tempest-VolumesSnapshotListTestJSON-20808177 None] Delete snapshot completed successfully. Feb 19 21:20:33.787156 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-3f75b88f-a651-4119-976a-5889611b9428 tempest-VolumesSnapshotListTestJSON-20808177 None] Lock "b'cinder-c0f7cd1d-c9e8-4240-8d74-fe6158bcdadb-delete_snapshot'" released by "delete_snapshot" :: held 0.740s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:34.174064 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-bad81dc2-81ef-41ef-aca9-c8dc60587732 tempest-VolumesSnapshotListTestJSON-20808177 None] Lock "b'cinder-e0102b3f-7539-4571-b633-85eab762ca7c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:34.175938 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bad81dc2-81ef-41ef-aca9-c8dc60587732 tempest-VolumesSnapshotListTestJSON-20808177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:34.738993 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-bad81dc2-81ef-41ef-aca9-c8dc60587732 tempest-VolumesSnapshotListTestJSON-20808177 None] Created reservations ['7a84be38-dd4a-4eaf-bd10-502d614ef2f3', '2e6bef80-aa54-4b5e-892a-12d77f3ace47', '7e418d32-b891-4771-ad5d-4572cf4fdf71', 'ecb9a97d-7f4d-4abd-a5b3-f84b29576599'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:34.795910 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-bad81dc2-81ef-41ef-aca9-c8dc60587732 tempest-VolumesSnapshotListTestJSON-20808177 None] Delete snapshot completed successfully. Feb 19 21:20:34.802506 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-bad81dc2-81ef-41ef-aca9-c8dc60587732 tempest-VolumesSnapshotListTestJSON-20808177 None] Lock "b'cinder-e0102b3f-7539-4571-b633-85eab762ca7c-delete_snapshot'" released by "delete_snapshot" :: held 0.628s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:35.364876 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-926e1cc5-ce67-4c6b-bfb2-7e157b466c40 tempest-VolumesSnapshotListTestJSON-20808177 None] Lock "b'cinder-55645b60-c220-4320-ad52-3edf2f1df8ab-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:35.460230 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-926e1cc5-ce67-4c6b-bfb2-7e157b466c40 tempest-VolumesSnapshotListTestJSON-20808177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:35.547892 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-926e1cc5-ce67-4c6b-bfb2-7e157b466c40 tempest-VolumesSnapshotListTestJSON-20808177 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:20:35.548515 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-926e1cc5-ce67-4c6b-bfb2-7e157b466c40 tempest-VolumesSnapshotListTestJSON-20808177 None] Volume volume-55645b60-c220-4320-ad52-3edf2f1df8ab is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:20:35.567209 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-926e1cc5-ce67-4c6b-bfb2-7e157b466c40 tempest-VolumesSnapshotListTestJSON-20808177 None] deleting rbd volume volume-55645b60-c220-4320-ad52-3edf2f1df8ab {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:20:36.139226 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-926e1cc5-ce67-4c6b-bfb2-7e157b466c40 tempest-VolumesSnapshotListTestJSON-20808177 None] Created reservations ['4f37f999-bfd3-451f-9610-097e9bc222be', '2d7b663d-8847-47a5-94e4-8d52299b7bf7', '17c2dbec-f1f6-4179-94a4-96a2aa889f0e', '3ec3dae7-816c-49ba-b86d-456f6803063b'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:36.221365 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-926e1cc5-ce67-4c6b-bfb2-7e157b466c40 tempest-VolumesSnapshotListTestJSON-20808177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:36.291995 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-926e1cc5-ce67-4c6b-bfb2-7e157b466c40 tempest-VolumesSnapshotListTestJSON-20808177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:36.364415 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-926e1cc5-ce67-4c6b-bfb2-7e157b466c40 tempest-VolumesSnapshotListTestJSON-20808177 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:20:36.371562 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-926e1cc5-ce67-4c6b-bfb2-7e157b466c40 tempest-VolumesSnapshotListTestJSON-20808177 None] Deleted volume successfully. Feb 19 21:20:36.405721 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-926e1cc5-ce67-4c6b-bfb2-7e157b466c40 tempest-VolumesSnapshotListTestJSON-20808177 None] Lock "b'cinder-55645b60-c220-4320-ad52-3edf2f1df8ab-delete_volume'" released by "delete_volume" :: held 1.040s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:20:36.633104 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:20:36.642862 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:20:36.646193 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:20:36.725007 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Flow 'volume_create_manager' (d935bb43-09a8-4361-b75d-0eac68ef952e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:36.733132 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b75165-b133-48cd-bdad-7682a719c39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:36.740534 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:20:36.781195 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b75165-b133-48cd-bdad-7682a719c39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:20:36Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ac08a91b-5da5-4874-9adb-6f523e666d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88a055c429b4b9e8e86a370c8571785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1865bd6-93fe-4f68-a812-5347bf3eb3b4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:20:37Z,use_quota=True,user_id='2af13ad54ab048d495e5ff0c0453abb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:36.816901 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaea5b4a-f416-4361-9f33-2e3e55bbeb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:36.827328 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaea5b4a-f416-4361-9f33-2e3e55bbeb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:36.852659 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4cfa99-e827-4d60-96b4-36c4dd8c5428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:36.886250 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4cfa99-e827-4d60-96b4-36c4dd8c5428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac08a91b-5da5-4874-9adb-6f523e666d6d', 'volume_name': 'volume-ac08a91b-5da5-4874-9adb-6f523e666d6d', 'volume_size': 1, 'snapshot_id': 'a1865bd6-93fe-4f68-a812-5347bf3eb3b4'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:36.892720 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eae655b-ce2f-4adc-9b8b-7d74855abbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:36.913479 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eae655b-ce2f-4adc-9b8b-7d74855abbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:36.932999 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13705ddc-f74f-45bc-92a3-071cc034ced4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:36.934180 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Volume ac08a91b-5da5-4874-9adb-6f523e666d6d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac08a91b-5da5-4874-9adb-6f523e666d6d', 'volume_size': 1, 'snapshot_id': 'a1865bd6-93fe-4f68-a812-5347bf3eb3b4'} Feb 19 21:20:37.005492 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] cloning volumes/volume-810eb069-3450-4d86-bd8b-728ffd2bc8f6@snapshot-a1865bd6-93fe-4f68-a812-5347bf3eb3b4 to volume-ac08a91b-5da5-4874-9adb-6f523e666d6d {{(pid=129319) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 19 21:20:37.006306 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:37.173304 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:37.460628 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:20:37.462555 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:20:37.543642 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Marking volume ac08a91b-5da5-4874-9adb-6f523e666d6d as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:20:37.565079 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Copying metadata from snapshot a1865bd6-93fe-4f68-a812-5347bf3eb3b4 to ac08a91b-5da5-4874-9adb-6f523e666d6d. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Feb 19 21:20:37.621935 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13705ddc-f74f-45bc-92a3-071cc034ced4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac08a91b-5da5-4874-9adb-6f523e666d6d', 'volume_size': 1, 'snapshot_id': 'a1865bd6-93fe-4f68-a812-5347bf3eb3b4'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:37.627444 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e203c4a-3b9a-4c0d-9445-a46888fcff36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:20:37.641489 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Volume volume-ac08a91b-5da5-4874-9adb-6f523e666d6d (ac08a91b-5da5-4874-9adb-6f523e666d6d): created successfully Feb 19 21:20:37.648294 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e203c4a-3b9a-4c0d-9445-a46888fcff36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:20:37.652871 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Flow 'volume_create_manager' (d935bb43-09a8-4361-b75d-0eac68ef952e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:20:37.676490 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-8e568499-ad51-48e2-b13d-2971495288f6 tempest-TestVolumeBootPattern-1165351049 None] Created volume successfully. Feb 19 21:20:39.895997 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-94e3f5b8-e2c4-4d77-8529-421b36e3d15d tempest-TestVolumeBootPattern-1165351049 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:20:40.768624 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-94e3f5b8-e2c4-4d77-8529-421b36e3d15d tempest-TestVolumeBootPattern-1165351049 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.872s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:20:40.770052 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-94e3f5b8-e2c4-4d77-8529-421b36e3d15d tempest-TestVolumeBootPattern-1165351049 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ac08a91b-5da5-4874-9adb-6f523e666d6d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'ac08a91b-5da5-4874-9adb-6f523e666d6d', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:20:40.806929 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-94e3f5b8-e2c4-4d77-8529-421b36e3d15d tempest-TestVolumeBootPattern-1165351049 None] Connection info returned from driver {'name': 'volumes/volume-ac08a91b-5da5-4874-9adb-6f523e666d6d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ac08a91b-5da5-4874-9adb-6f523e666d6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '555da4cd-acbf-4dbf-a8f0-7d828a8f79dc'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:20:40.873749 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 req-94e3f5b8-e2c4-4d77-8529-421b36e3d15d tempest-TestVolumeBootPattern-1165351049 None] attachment_update completed successfully. Feb 19 21:20:55.329081 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-fa596e53-23b5-4710-8d95-637add643d08 req-d1be948f-7543-4cdb-b186-cc708335ace7 tempest-TestVolumeBootPattern-1165351049 None] Terminate volume connection completed successfully. Feb 19 21:20:55.329640 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-fa596e53-23b5-4710-8d95-637add643d08 req-d1be948f-7543-4cdb-b186-cc708335ace7 tempest-TestVolumeBootPattern-1165351049 None] Deleting attachment 555da4cd-acbf-4dbf-a8f0-7d828a8f79dc. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:20:55.594608 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-fa596e53-23b5-4710-8d95-637add643d08 req-0228103a-0c0a-49fb-8d20-da12c45f8aa8 tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-ac08a91b-5da5-4874-9adb-6f523e666d6d-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:55.735713 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-fa596e53-23b5-4710-8d95-637add643d08 req-0228103a-0c0a-49fb-8d20-da12c45f8aa8 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:55.963266 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-fa596e53-23b5-4710-8d95-637add643d08 req-0228103a-0c0a-49fb-8d20-da12c45f8aa8 tempest-TestVolumeBootPattern-1165351049 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:20:55.999995 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-fa596e53-23b5-4710-8d95-637add643d08 req-0228103a-0c0a-49fb-8d20-da12c45f8aa8 tempest-TestVolumeBootPattern-1165351049 None] deleting rbd volume volume-ac08a91b-5da5-4874-9adb-6f523e666d6d {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:20:56.986911 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [req-fa596e53-23b5-4710-8d95-637add643d08 req-0228103a-0c0a-49fb-8d20-da12c45f8aa8 tempest-TestVolumeBootPattern-1165351049 None] Created reservations ['5add2d8e-ad95-4d6d-8143-d4e97eaaacd7', 'a7134723-1593-4109-a0ad-9cd30e5f375d', '1c3e619b-5b48-4eb4-a8bd-8ca6bfcbac6b', '2193e778-73fb-4003-8080-ff2d3d91d790'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:20:57.141353 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-fa596e53-23b5-4710-8d95-637add643d08 req-0228103a-0c0a-49fb-8d20-da12c45f8aa8 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:57.246546 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-fa596e53-23b5-4710-8d95-637add643d08 req-0228103a-0c0a-49fb-8d20-da12c45f8aa8 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:57.328937 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [req-fa596e53-23b5-4710-8d95-637add643d08 req-0228103a-0c0a-49fb-8d20-da12c45f8aa8 tempest-TestVolumeBootPattern-1165351049 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:20:57.341233 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-fa596e53-23b5-4710-8d95-637add643d08 req-0228103a-0c0a-49fb-8d20-da12c45f8aa8 tempest-TestVolumeBootPattern-1165351049 None] Deleted volume successfully. Feb 19 21:20:57.371901 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-724e54cd-fa20-455c-b220-363946c6837d tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-a1865bd6-93fe-4f68-a812-5347bf3eb3b4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.036s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:20:57.378194 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-724e54cd-fa20-455c-b220-363946c6837d tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:20:57.573928 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-fa596e53-23b5-4710-8d95-637add643d08 req-0228103a-0c0a-49fb-8d20-da12c45f8aa8 tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-ac08a91b-5da5-4874-9adb-6f523e666d6d-delete_volume'" released by "delete_volume" :: held 1.977s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:21:09.309937 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-5bf53d54-bae9-48a0-965e-ff6f716b46d5 tempest-BackendsCapabilitiesAdminTestsJSON-1934052982 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:392969cf-2ceb-4da2-b64f-9f17646991cb:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129319) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Feb 19 21:21:09.349485 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d3a9e83f-4a43-4ff4-a7b2-962d2d95a909 tempest-BackendsCapabilitiesAdminTestsJSON-1934052982 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:392969cf-2ceb-4da2-b64f-9f17646991cb:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129319) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Feb 19 21:21:12.737944 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:21:12.752988 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:21:12.753484 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:21:12.783301 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Flow 'volume_create_manager' (61c50df4-23f7-43bb-aa47-e6a3b0fe9b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:21:12.799440 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcefad54-028c-435d-a422-4082cc6d8cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:12.807822 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:21:12.824766 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcefad54-028c-435d-a422-4082cc6d8cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-989996850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dced8397-0ea8-4caa-824e-aa1fcd4fdb0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e2a227c87942d7ad7e2c9d8329fd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:21:13Z,use_quota=True,user_id='240cbe1ec99f40be9520de32902a357c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:12.831515 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558a1053-6d85-40ae-8519-913979dca6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:12.836083 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558a1053-6d85-40ae-8519-913979dca6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:12.842583 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc7d1d7-7138-4ba9-910e-dd5f56f89de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:12.962266 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc7d1d7-7138-4ba9-910e-dd5f56f89de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dced8397-0ea8-4caa-824e-aa1fcd4fdb0f', 'volume_name': 'volume-dced8397-0ea8-4caa-824e-aa1fcd4fdb0f', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:12.982357 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81bdea5-c0c2-4113-b64a-6feea507c88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:12.986688 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81bdea5-c0c2-4113-b64a-6feea507c88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:13.004380 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9d6791-dc54-4098-8d76-3bd1d8c51c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:13.005597 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Volume dced8397-0ea8-4caa-824e-aa1fcd4fdb0f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dced8397-0ea8-4caa-824e-aa1fcd4fdb0f', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 21:21:13.006387 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Cloning dced8397-0ea8-4caa-824e-aa1fcd4fdb0f from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 21:21:13.025538 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.018s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:21:13.051874 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 21, 13, 42644)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:21:13.052755 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:21:13.053676 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Found cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 19 21:21:13.060423 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 0.035s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:21:13.061561 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 21:21:13.068222 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 21, 13, 65657)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:21:13.068690 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:21:13.069183 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Creating from source image-volume d609c16c-1e31-4237-8163-d85a8fcc768b {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 19 21:21:13.093118 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:13.164427 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] creating snapshot='volume-dced8397-0ea8-4caa-824e-aa1fcd4fdb0f.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:21:13.418256 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] cloning 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b@volume-dced8397-0ea8-4caa-824e-aa1fcd4fdb0f.clone_snap' to 'volume-dced8397-0ea8-4caa-824e-aa1fcd4fdb0f' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:21:13.612204 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71.deleted is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:21:13.613416 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:21:13.613817 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:21:13.639692 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:21:13.640314 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Marking volume dced8397-0ea8-4caa-824e-aa1fcd4fdb0f as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:21:13.649420 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to dced8397-0ea8-4caa-824e-aa1fcd4fdb0f. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 21:21:13.650637 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Creating volume glance metadata for volume dced8397-0ea8-4caa-824e-aa1fcd4fdb0f backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 21:21:13.711088 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9d6791-dc54-4098-8d76-3bd1d8c51c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dced8397-0ea8-4caa-824e-aa1fcd4fdb0f', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:13.718537 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9e97a8-0d5e-433f-99de-bbbf089c4498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:13.730493 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Volume volume-dced8397-0ea8-4caa-824e-aa1fcd4fdb0f (dced8397-0ea8-4caa-824e-aa1fcd4fdb0f): created successfully Feb 19 21:21:13.734403 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9e97a8-0d5e-433f-99de-bbbf089c4498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:13.741424 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Flow 'volume_create_manager' (61c50df4-23f7-43bb-aa47-e6a3b0fe9b10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:21:13.750271 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-af6d4317-e34e-499e-93ab-66df7f85e1d5 tempest-VolumesImageMetadata-2083443884 None] Created volume successfully. Feb 19 21:21:15.148962 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-aa5ae3bc-dea3-4fd8-b2d9-3cc3585fa92c tempest-VolumesImageMetadata-2083443884 None] Lock "b'cinder-dced8397-0ea8-4caa-824e-aa1fcd4fdb0f-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:21:15.190160 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-aa5ae3bc-dea3-4fd8-b2d9-3cc3585fa92c tempest-VolumesImageMetadata-2083443884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:15.280649 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-aa5ae3bc-dea3-4fd8-b2d9-3cc3585fa92c tempest-VolumesImageMetadata-2083443884 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:21:15.302594 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-aa5ae3bc-dea3-4fd8-b2d9-3cc3585fa92c tempest-VolumesImageMetadata-2083443884 None] deleting rbd volume volume-dced8397-0ea8-4caa-824e-aa1fcd4fdb0f {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:21:15.781957 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-aa5ae3bc-dea3-4fd8-b2d9-3cc3585fa92c tempest-VolumesImageMetadata-2083443884 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:21:15.829574 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-aa5ae3bc-dea3-4fd8-b2d9-3cc3585fa92c tempest-VolumesImageMetadata-2083443884 None] deleting parent snapshot volume-dced8397-0ea8-4caa-824e-aa1fcd4fdb0f.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:21:16.526017 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-aa5ae3bc-dea3-4fd8-b2d9-3cc3585fa92c tempest-VolumesImageMetadata-2083443884 None] Created reservations ['3e75063f-6061-4553-878e-d89afcef93f8', '7dd31072-39b1-42ba-bd77-04f67a2493b7', '153a4643-286f-47e7-bd9b-f075e589c646', '6a7b2d71-fa1f-41f9-9bad-8545626af8f5'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:21:16.590793 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-aa5ae3bc-dea3-4fd8-b2d9-3cc3585fa92c tempest-VolumesImageMetadata-2083443884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:16.639554 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-aa5ae3bc-dea3-4fd8-b2d9-3cc3585fa92c tempest-VolumesImageMetadata-2083443884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:16.691198 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-aa5ae3bc-dea3-4fd8-b2d9-3cc3585fa92c tempest-VolumesImageMetadata-2083443884 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:21:16.703555 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-aa5ae3bc-dea3-4fd8-b2d9-3cc3585fa92c tempest-VolumesImageMetadata-2083443884 None] Deleted volume successfully. Feb 19 21:21:16.719875 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-aa5ae3bc-dea3-4fd8-b2d9-3cc3585fa92c tempest-VolumesImageMetadata-2083443884 None] Lock "b'cinder-dced8397-0ea8-4caa-824e-aa1fcd4fdb0f-delete_volume'" released by "delete_volume" :: held 1.571s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:21:21.416148 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:21:21.419509 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:21:21.419960 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:21:21.441537 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Flow 'volume_create_manager' (857ceaa9-8791-456a-8566-bb626943efab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:21:21.449089 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fface55-304c-4d26-ba0e-bf3bf82bcd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:21.456300 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:21:21.470637 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fface55-304c-4d26-ba0e-bf3bf82bcd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2141450133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=19d56bc4-b5be-4ed9-b3be-3f7ab288c1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d70683f9faa4d26bf5d04413711de7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:21:21Z,use_quota=True,user_id='0dbd1b5c72d3493ca1a72612d31076ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:21.476077 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5168cf-b44e-4048-8b9b-f0471d94b229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:21.480400 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5168cf-b44e-4048-8b9b-f0471d94b229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:21.485587 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df65a728-f211-41ef-9300-0598f325e6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:21.489822 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df65a728-f211-41ef-9300-0598f325e6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19d56bc4-b5be-4ed9-b3be-3f7ab288c1f5', 'volume_name': 'volume-19d56bc4-b5be-4ed9-b3be-3f7ab288c1f5', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:21.495346 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85916604-3d16-48b3-b31e-4402ae664e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:21.499404 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85916604-3d16-48b3-b31e-4402ae664e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:21.504180 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f61572-a279-4efe-95b4-19156f560987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:21.505299 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Volume 19d56bc4-b5be-4ed9-b3be-3f7ab288c1f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19d56bc4-b5be-4ed9-b3be-3f7ab288c1f5', 'volume_size': 1} Feb 19 21:21:21.505683 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] creating volume 'volume-19d56bc4-b5be-4ed9-b3be-3f7ab288c1f5' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:21:21.506675 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:21.566288 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:21:21.566548 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:21:21.570399 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f61572-a279-4efe-95b4-19156f560987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19d56bc4-b5be-4ed9-b3be-3f7ab288c1f5', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:21.575505 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c78723-71a8-436f-9af0-c05dab487609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:21.588864 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Volume volume-19d56bc4-b5be-4ed9-b3be-3f7ab288c1f5 (19d56bc4-b5be-4ed9-b3be-3f7ab288c1f5): created successfully Feb 19 21:21:21.592695 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c78723-71a8-436f-9af0-c05dab487609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:21.598432 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Flow 'volume_create_manager' (857ceaa9-8791-456a-8566-bb626943efab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:21:21.607443 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-231142f2-ccac-413c-b3c2-69fd90b32199 tempest-VolumesTransfersTest-919205524 None] Created volume successfully. Feb 19 21:21:22.183204 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:21:22.183982 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:22.207071 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:22.231327 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:21:22.936499 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b759e190-5678-4893-8285-80a9b32b261e tempest-VolumesTransfersTest-698131963 None] Transfer volume completed successfully. Feb 19 21:21:23.324114 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-272764d5-6f4e-4235-90ce-8880cb69f8ef tempest-VolumesTransfersTest-267894900 None] Lock "b'cinder-19d56bc4-b5be-4ed9-b3be-3f7ab288c1f5-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:21:23.357317 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-272764d5-6f4e-4235-90ce-8880cb69f8ef tempest-VolumesTransfersTest-267894900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:23.395391 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-272764d5-6f4e-4235-90ce-8880cb69f8ef tempest-VolumesTransfersTest-267894900 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:21:23.395923 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-272764d5-6f4e-4235-90ce-8880cb69f8ef tempest-VolumesTransfersTest-267894900 None] Volume volume-19d56bc4-b5be-4ed9-b3be-3f7ab288c1f5 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:21:23.406593 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-272764d5-6f4e-4235-90ce-8880cb69f8ef tempest-VolumesTransfersTest-267894900 None] deleting rbd volume volume-19d56bc4-b5be-4ed9-b3be-3f7ab288c1f5 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:21:23.642826 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-272764d5-6f4e-4235-90ce-8880cb69f8ef tempest-VolumesTransfersTest-267894900 None] Created reservations ['34fe5c17-ca4b-49f5-82f9-44978b0a9ad6', 'f7de3473-9fc9-4b24-a475-b6f75d810474', '63d08aca-b47f-4e2d-83c7-946aad31bf24', '0ac5de3f-5695-4363-aaec-a327eb03dc12'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:21:23.696998 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-272764d5-6f4e-4235-90ce-8880cb69f8ef tempest-VolumesTransfersTest-267894900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:23.722803 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-272764d5-6f4e-4235-90ce-8880cb69f8ef tempest-VolumesTransfersTest-267894900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:23.749130 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-272764d5-6f4e-4235-90ce-8880cb69f8ef tempest-VolumesTransfersTest-267894900 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:21:23.755104 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-272764d5-6f4e-4235-90ce-8880cb69f8ef tempest-VolumesTransfersTest-267894900 None] Deleted volume successfully. Feb 19 21:21:23.770202 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-272764d5-6f4e-4235-90ce-8880cb69f8ef tempest-VolumesTransfersTest-267894900 None] Lock "b'cinder-19d56bc4-b5be-4ed9-b3be-3f7ab288c1f5-delete_volume'" released by "delete_volume" :: held 0.446s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:21:24.736020 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:21:24.739272 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:21:24.739894 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:21:24.761997 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Flow 'volume_create_manager' (993432d7-ffdd-4258-8f51-caf158ba6520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:21:24.769072 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9058fd8-6225-4fe3-a73d-3d9bdf551a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:24.777153 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:21:24.797128 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9058fd8-6225-4fe3-a73d-3d9bdf551a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1861821884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=beee0691-3fa5-4232-aa77-1204f3d13884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d70683f9faa4d26bf5d04413711de7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:21:25Z,use_quota=True,user_id='0dbd1b5c72d3493ca1a72612d31076ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:24.802675 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a92f2d-babe-454b-af66-3b09f9c231aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:24.807541 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a92f2d-babe-454b-af66-3b09f9c231aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:24.812813 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a309361-659a-4f9a-a377-b3ae160305e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:24.817094 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a309361-659a-4f9a-a377-b3ae160305e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beee0691-3fa5-4232-aa77-1204f3d13884', 'volume_name': 'volume-beee0691-3fa5-4232-aa77-1204f3d13884', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:24.822397 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be34f89-ba18-47f7-af50-e7b2b1781d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:24.826734 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be34f89-ba18-47f7-af50-e7b2b1781d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:24.831650 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db52af5d-cf04-4c2a-aa39-5805861ad8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:24.832881 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Volume beee0691-3fa5-4232-aa77-1204f3d13884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beee0691-3fa5-4232-aa77-1204f3d13884', 'volume_size': 1} Feb 19 21:21:24.833273 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] creating volume 'volume-beee0691-3fa5-4232-aa77-1204f3d13884' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:21:24.834282 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:24.907248 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:21:24.907552 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:21:24.911371 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db52af5d-cf04-4c2a-aa39-5805861ad8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beee0691-3fa5-4232-aa77-1204f3d13884', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:24.916205 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfcb082f-5ed0-4b9e-9dc9-fb7556d3ceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:24.926777 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Volume volume-beee0691-3fa5-4232-aa77-1204f3d13884 (beee0691-3fa5-4232-aa77-1204f3d13884): created successfully Feb 19 21:21:24.930485 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfcb082f-5ed0-4b9e-9dc9-fb7556d3ceba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:24.936843 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Flow 'volume_create_manager' (993432d7-ffdd-4258-8f51-caf158ba6520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:21:24.947944 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a72af7c2-af69-4ed8-a263-4e6fe616ca88 tempest-VolumesTransfersTest-919205524 None] Created volume successfully. Feb 19 21:21:26.057638 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-8eb56e55-e1ad-4979-9f3b-4df4c7cfe392 tempest-VolumesTransfersTest-267894900 None] Lock "b'cinder-beee0691-3fa5-4232-aa77-1204f3d13884-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:21:26.086155 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8eb56e55-e1ad-4979-9f3b-4df4c7cfe392 tempest-VolumesTransfersTest-267894900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:26.141463 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8eb56e55-e1ad-4979-9f3b-4df4c7cfe392 tempest-VolumesTransfersTest-267894900 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:21:26.142339 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8eb56e55-e1ad-4979-9f3b-4df4c7cfe392 tempest-VolumesTransfersTest-267894900 None] Volume volume-beee0691-3fa5-4232-aa77-1204f3d13884 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:21:26.155094 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8eb56e55-e1ad-4979-9f3b-4df4c7cfe392 tempest-VolumesTransfersTest-267894900 None] deleting rbd volume volume-beee0691-3fa5-4232-aa77-1204f3d13884 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:21:26.490273 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-8eb56e55-e1ad-4979-9f3b-4df4c7cfe392 tempest-VolumesTransfersTest-267894900 None] Created reservations ['e35281b7-e2fe-43f6-ae69-fb6fe50aafed', '487c381a-c5bf-4498-a0a5-40d8d0d78c44', '886c6355-0327-4e36-b0bb-8c5b13d262be', '5f043798-c6ee-48cf-92f2-2b25756cd712'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:21:26.547760 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8eb56e55-e1ad-4979-9f3b-4df4c7cfe392 tempest-VolumesTransfersTest-267894900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:26.572106 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8eb56e55-e1ad-4979-9f3b-4df4c7cfe392 tempest-VolumesTransfersTest-267894900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:26.598068 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-8eb56e55-e1ad-4979-9f3b-4df4c7cfe392 tempest-VolumesTransfersTest-267894900 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:21:26.603647 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8eb56e55-e1ad-4979-9f3b-4df4c7cfe392 tempest-VolumesTransfersTest-267894900 None] Deleted volume successfully. Feb 19 21:21:26.617985 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-8eb56e55-e1ad-4979-9f3b-4df4c7cfe392 tempest-VolumesTransfersTest-267894900 None] Lock "b'cinder-beee0691-3fa5-4232-aa77-1204f3d13884-delete_volume'" released by "delete_volume" :: held 0.560s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:21:27.738954 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-724e54cd-fa20-455c-b220-363946c6837d tempest-TestVolumeBootPattern-1165351049 None] Created reservations ['9fde5b7f-d8eb-4fd5-87ef-5aa10b5c0320', '9b8cd65b-0477-4a00-9590-003e23d95476', 'f26676fb-0eae-4130-a4fe-d143f11c0445', 'f07793b1-8e82-4667-8a0e-cd84d914e557'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:21:27.792527 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-724e54cd-fa20-455c-b220-363946c6837d tempest-TestVolumeBootPattern-1165351049 None] Delete snapshot completed successfully. Feb 19 21:21:27.797944 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-724e54cd-fa20-455c-b220-363946c6837d tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-a1865bd6-93fe-4f68-a812-5347bf3eb3b4-delete_snapshot'" released by "delete_snapshot" :: held 30.426s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:21:30.991748 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-7612b054-2988-481f-9d7f-3757c1c995e9 req-73dfca35-367b-4b4a-b1a8-190d6f189649 tempest-TestVolumeBootPattern-1165351049 None] Terminate volume connection completed successfully. Feb 19 21:21:30.993158 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-7612b054-2988-481f-9d7f-3757c1c995e9 req-73dfca35-367b-4b4a-b1a8-190d6f189649 tempest-TestVolumeBootPattern-1165351049 None] Deleting attachment 1c5891b3-8b8a-4ebe-a415-e206ff5212bc. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:21:31.146832 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-7612b054-2988-481f-9d7f-3757c1c995e9 req-e148ebf8-8f19-4194-81a9-356e67c3b629 tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-810eb069-3450-4d86-bd8b-728ffd2bc8f6-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:21:31.214264 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-7612b054-2988-481f-9d7f-3757c1c995e9 req-e148ebf8-8f19-4194-81a9-356e67c3b629 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:31.320688 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-7612b054-2988-481f-9d7f-3757c1c995e9 req-e148ebf8-8f19-4194-81a9-356e67c3b629 tempest-TestVolumeBootPattern-1165351049 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:21:31.330539 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-7612b054-2988-481f-9d7f-3757c1c995e9 req-e148ebf8-8f19-4194-81a9-356e67c3b629 tempest-TestVolumeBootPattern-1165351049 None] deleting rbd volume volume-810eb069-3450-4d86-bd8b-728ffd2bc8f6 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:21:31.686961 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-7612b054-2988-481f-9d7f-3757c1c995e9 req-e148ebf8-8f19-4194-81a9-356e67c3b629 tempest-TestVolumeBootPattern-1165351049 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:21:31.732135 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-7612b054-2988-481f-9d7f-3757c1c995e9 req-e148ebf8-8f19-4194-81a9-356e67c3b629 tempest-TestVolumeBootPattern-1165351049 None] deleting parent snapshot volume-810eb069-3450-4d86-bd8b-728ffd2bc8f6.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:21:32.637769 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [req-7612b054-2988-481f-9d7f-3757c1c995e9 req-e148ebf8-8f19-4194-81a9-356e67c3b629 tempest-TestVolumeBootPattern-1165351049 None] Created reservations ['9e890fe8-57a0-481d-9008-4cc7164a55bb', '009a7633-804c-4860-bf47-11d7b5f5c86f', '98bd73be-cbe7-42c2-804c-21ec0f653a59', '8508b771-4755-4703-bcdd-63be6abb4aea'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:21:32.705535 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-7612b054-2988-481f-9d7f-3757c1c995e9 req-e148ebf8-8f19-4194-81a9-356e67c3b629 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:32.742665 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-7612b054-2988-481f-9d7f-3757c1c995e9 req-e148ebf8-8f19-4194-81a9-356e67c3b629 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:32.781013 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [req-7612b054-2988-481f-9d7f-3757c1c995e9 req-e148ebf8-8f19-4194-81a9-356e67c3b629 tempest-TestVolumeBootPattern-1165351049 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:21:32.785380 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-7612b054-2988-481f-9d7f-3757c1c995e9 req-e148ebf8-8f19-4194-81a9-356e67c3b629 tempest-TestVolumeBootPattern-1165351049 None] Deleted volume successfully. Feb 19 21:21:32.799244 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-7612b054-2988-481f-9d7f-3757c1c995e9 req-e148ebf8-8f19-4194-81a9-356e67c3b629 tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-810eb069-3450-4d86-bd8b-728ffd2bc8f6-delete_volume'" released by "delete_volume" :: held 1.652s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:21:36.304377 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:21:36.309052 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:21:36.309825 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:21:36.334678 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Flow 'volume_create_manager' (d19ab28f-1f06-4658-813c-c66e4ffc2695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:21:36.342668 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40d9be8-1faf-4293-a65c-d8ef48c8b1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:36.351513 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:21:36.377450 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40d9be8-1faf-4293-a65c-d8ef48c8b1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1232650163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f7b8b771-4b05-452c-b7b9-907ea4593f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88a055c429b4b9e8e86a370c8571785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:21:36Z,use_quota=True,user_id='2af13ad54ab048d495e5ff0c0453abb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:36.386871 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc44571-7d34-4ce0-9ba9-e3675423649d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:36.394928 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc44571-7d34-4ce0-9ba9-e3675423649d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:36.401871 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488fd947-e485-48f5-a4c7-a01994bfa1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:36.505319 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488fd947-e485-48f5-a4c7-a01994bfa1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7b8b771-4b05-452c-b7b9-907ea4593f17', 'volume_name': 'volume-f7b8b771-4b05-452c-b7b9-907ea4593f17', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:36.512152 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940dd7fc-0b53-410a-bc6e-065af858f4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:36.516576 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940dd7fc-0b53-410a-bc6e-065af858f4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:36.521588 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000a8d3c-c4c1-45f7-9503-203e528a6ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:36.522779 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Volume f7b8b771-4b05-452c-b7b9-907ea4593f17: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7b8b771-4b05-452c-b7b9-907ea4593f17', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 21:21:36.523565 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Cloning f7b8b771-4b05-452c-b7b9-907ea4593f17 from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 21:21:36.533457 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:21:36.546058 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 21, 36, 538773)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:21:36.547203 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:21:36.548233 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Found cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 19 21:21:36.554713 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 0.021s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:21:36.556414 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 21:21:36.564440 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 21, 36, 561712)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:21:36.565178 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:21:36.565926 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Creating from source image-volume d609c16c-1e31-4237-8163-d85a8fcc768b {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 19 21:21:36.582823 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:21:36.671994 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] creating snapshot='volume-f7b8b771-4b05-452c-b7b9-907ea4593f17.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:21:37.641872 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] cloning 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b@volume-f7b8b771-4b05-452c-b7b9-907ea4593f17.clone_snap' to 'volume-f7b8b771-4b05-452c-b7b9-907ea4593f17' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:21:37.841390 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71.deleted is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:21:37.850578 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:21:37.851010 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:21:37.882314 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:21:37.883332 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Marking volume f7b8b771-4b05-452c-b7b9-907ea4593f17 as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:21:37.894352 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to f7b8b771-4b05-452c-b7b9-907ea4593f17. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 21:21:37.895144 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Creating volume glance metadata for volume f7b8b771-4b05-452c-b7b9-907ea4593f17 backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 21:21:37.986613 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000a8d3c-c4c1-45f7-9503-203e528a6ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b8b771-4b05-452c-b7b9-907ea4593f17', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:37.995012 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6e2954-4309-4b46-96cc-d7d705f2e252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:21:38.011383 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Volume volume-f7b8b771-4b05-452c-b7b9-907ea4593f17 (f7b8b771-4b05-452c-b7b9-907ea4593f17): created successfully Feb 19 21:21:38.016888 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6e2954-4309-4b46-96cc-d7d705f2e252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:21:38.023528 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Flow 'volume_create_manager' (d19ab28f-1f06-4658-813c-c66e4ffc2695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:21:38.036146 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-778b042d-fe07-4fd7-b525-d2231bc6faf8 tempest-TestVolumeBootPattern-1165351049 None] Created volume successfully. Feb 19 21:21:41.703576 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 req-41eb6d04-a12f-4bca-a2ee-fbba7be1265d tempest-TestVolumeBootPattern-1165351049 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:21:42.750761 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 req-41eb6d04-a12f-4bca-a2ee-fbba7be1265d tempest-TestVolumeBootPattern-1165351049 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.046s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:21:42.755751 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 req-41eb6d04-a12f-4bca-a2ee-fbba7be1265d tempest-TestVolumeBootPattern-1165351049 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f7b8b771-4b05-452c-b7b9-907ea4593f17', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'f7b8b771-4b05-452c-b7b9-907ea4593f17', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:21:42.802078 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 req-41eb6d04-a12f-4bca-a2ee-fbba7be1265d tempest-TestVolumeBootPattern-1165351049 None] Connection info returned from driver {'name': 'volumes/volume-f7b8b771-4b05-452c-b7b9-907ea4593f17', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f7b8b771-4b05-452c-b7b9-907ea4593f17', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2fe42489-9633-4ee3-ae92-e47ce4a541d7'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:21:42.882706 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 req-41eb6d04-a12f-4bca-a2ee-fbba7be1265d tempest-TestVolumeBootPattern-1165351049 None] attachment_update completed successfully. Feb 19 21:22:22.186320 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:22:22.187359 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:22:22.210959 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:22:22.233393 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:23:22.189130 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:23:22.190244 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:23:22.219207 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:23:22.251090 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:24:06.835097 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-ef05994d-ffe7-4fd1-a61d-e6a109db1509 req-eb650f05-e33f-4806-9275-d66f53421202 tempest-TestVolumeBootPattern-1165351049 None] Terminate volume connection completed successfully. Feb 19 21:24:06.836559 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-ef05994d-ffe7-4fd1-a61d-e6a109db1509 req-eb650f05-e33f-4806-9275-d66f53421202 tempest-TestVolumeBootPattern-1165351049 None] Deleting attachment 2fe42489-9633-4ee3-ae92-e47ce4a541d7. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:24:11.805117 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-4831e924-c266-4203-99fe-22f6cb7cd53b req-b02b8be1-757b-4536-987b-11c173949168 tempest-TestVolumeBootPattern-1165351049 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:24:12.528363 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-4831e924-c266-4203-99fe-22f6cb7cd53b req-b02b8be1-757b-4536-987b-11c173949168 tempest-TestVolumeBootPattern-1165351049 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.723s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:24:12.529977 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-4831e924-c266-4203-99fe-22f6cb7cd53b req-b02b8be1-757b-4536-987b-11c173949168 tempest-TestVolumeBootPattern-1165351049 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f7b8b771-4b05-452c-b7b9-907ea4593f17', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'f7b8b771-4b05-452c-b7b9-907ea4593f17', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:24:12.578402 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-4831e924-c266-4203-99fe-22f6cb7cd53b req-b02b8be1-757b-4536-987b-11c173949168 tempest-TestVolumeBootPattern-1165351049 None] Connection info returned from driver {'name': 'volumes/volume-f7b8b771-4b05-452c-b7b9-907ea4593f17', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f7b8b771-4b05-452c-b7b9-907ea4593f17', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '36a910d9-2062-4e0e-b5c7-d4a7d3c18b5b'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:24:12.644459 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-4831e924-c266-4203-99fe-22f6cb7cd53b req-b02b8be1-757b-4536-987b-11c173949168 tempest-TestVolumeBootPattern-1165351049 None] attachment_update completed successfully. Feb 19 21:24:22.187183 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:24:22.189722 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:24:22.321293 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:24:22.437949 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:25:22.185231 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:25:22.185979 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:25:22.219779 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:25:22.243293 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:26:06.488364 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-701ccfe6-febb-4b3c-80af-13dc14ec8a78 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:26:07.493927 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-701ccfe6-febb-4b3c-80af-13dc14ec8a78 tempest-TestVolumeBootPattern-1165351049 None] Create snapshot completed successfully Feb 19 21:26:08.921315 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:26:08.924903 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:26:08.925516 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:26:08.954174 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Flow 'volume_create_manager' (a755487b-11b0-43e2-8748-dacd47734bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:26:08.961173 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d6e2cd-ddf8-4005-bff2-00a5bf734595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:26:08.970292 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:26:08.984522 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d6e2cd-ddf8-4005-bff2-00a5bf734595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-497428171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2fb22bc4-5b5a-4c49-8ee0-26772c8d7020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88a055c429b4b9e8e86a370c8571785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ebd215e7-b598-475a-954e-90e45e168833,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:26:09Z,use_quota=True,user_id='2af13ad54ab048d495e5ff0c0453abb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:26:08.991087 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc55754-68fe-45ea-b07a-92bd6c5a4586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:26:08.995871 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc55754-68fe-45ea-b07a-92bd6c5a4586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:26:09.001096 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b531d02-edfe-488f-bb44-9fc39611dd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:26:09.005305 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b531d02-edfe-488f-bb44-9fc39611dd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2fb22bc4-5b5a-4c49-8ee0-26772c8d7020', 'volume_name': 'volume-2fb22bc4-5b5a-4c49-8ee0-26772c8d7020', 'volume_size': 1, 'snapshot_id': 'ebd215e7-b598-475a-954e-90e45e168833'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:26:09.010335 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d54619-1595-4ac2-84e2-9f0fb0adab5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:26:09.014846 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d54619-1595-4ac2-84e2-9f0fb0adab5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:26:09.019613 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d205e866-abe4-4a9b-a75a-a4f29617ffcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:26:09.020722 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Volume 2fb22bc4-5b5a-4c49-8ee0-26772c8d7020: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2fb22bc4-5b5a-4c49-8ee0-26772c8d7020', 'volume_size': 1, 'snapshot_id': 'ebd215e7-b598-475a-954e-90e45e168833'} Feb 19 21:26:09.041874 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] cloning volumes/volume-f7b8b771-4b05-452c-b7b9-907ea4593f17@snapshot-ebd215e7-b598-475a-954e-90e45e168833 to volume-2fb22bc4-5b5a-4c49-8ee0-26772c8d7020 {{(pid=129319) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 19 21:26:09.042799 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:26:09.108186 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:26:09.242155 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:26:09.242459 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:26:09.261491 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Marking volume 2fb22bc4-5b5a-4c49-8ee0-26772c8d7020 as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:26:09.266617 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Copying metadata from snapshot ebd215e7-b598-475a-954e-90e45e168833 to 2fb22bc4-5b5a-4c49-8ee0-26772c8d7020. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Feb 19 21:26:09.302383 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d205e866-abe4-4a9b-a75a-a4f29617ffcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb22bc4-5b5a-4c49-8ee0-26772c8d7020', 'volume_size': 1, 'snapshot_id': 'ebd215e7-b598-475a-954e-90e45e168833'}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:26:09.307157 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f9a67c-680b-49ad-81c5-e9c506f903b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:26:09.315965 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Volume volume-2fb22bc4-5b5a-4c49-8ee0-26772c8d7020 (2fb22bc4-5b5a-4c49-8ee0-26772c8d7020): created successfully Feb 19 21:26:09.319561 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f9a67c-680b-49ad-81c5-e9c506f903b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:26:09.326297 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Flow 'volume_create_manager' (a755487b-11b0-43e2-8748-dacd47734bde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:26:09.339512 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-6678feae-b51f-4f75-861d-2c28f0d97f08 tempest-TestVolumeBootPattern-1165351049 None] Created volume successfully. Feb 19 21:26:12.140279 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 req-4bf87f5e-d923-491f-9456-eb91c81a8c28 tempest-TestVolumeBootPattern-1165351049 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:26:12.833691 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 req-4bf87f5e-d923-491f-9456-eb91c81a8c28 tempest-TestVolumeBootPattern-1165351049 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.693s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:26:12.835386 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 req-4bf87f5e-d923-491f-9456-eb91c81a8c28 tempest-TestVolumeBootPattern-1165351049 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2fb22bc4-5b5a-4c49-8ee0-26772c8d7020', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '2fb22bc4-5b5a-4c49-8ee0-26772c8d7020', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:26:12.862139 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 req-4bf87f5e-d923-491f-9456-eb91c81a8c28 tempest-TestVolumeBootPattern-1165351049 None] Connection info returned from driver {'name': 'volumes/volume-2fb22bc4-5b5a-4c49-8ee0-26772c8d7020', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2fb22bc4-5b5a-4c49-8ee0-26772c8d7020', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a3834f42-a174-40ef-a189-5a8b1105bc6a'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:26:12.914189 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 req-4bf87f5e-d923-491f-9456-eb91c81a8c28 tempest-TestVolumeBootPattern-1165351049 None] attachment_update completed successfully. Feb 19 21:26:22.188912 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:26:22.190014 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:26:22.245484 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:26:22.291634 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:27:22.187317 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:27:22.188519 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:27:22.209923 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:27:22.233032 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:28:10.235089 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-d65e7135-4c8d-4bb8-bdee-368491e503ac req-73b1c9b4-daea-4f2e-a68a-3591da7667c3 tempest-TestVolumeBootPattern-1165351049 None] Terminate volume connection completed successfully. Feb 19 21:28:10.235829 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-d65e7135-4c8d-4bb8-bdee-368491e503ac req-73b1c9b4-daea-4f2e-a68a-3591da7667c3 tempest-TestVolumeBootPattern-1165351049 None] Deleting attachment a3834f42-a174-40ef-a189-5a8b1105bc6a. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:28:11.865172 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-225a4431-80e4-4370-855f-47fb1bf2d21a tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-2fb22bc4-5b5a-4c49-8ee0-26772c8d7020-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:28:11.904804 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-225a4431-80e4-4370-855f-47fb1bf2d21a tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:28:11.997876 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-225a4431-80e4-4370-855f-47fb1bf2d21a tempest-TestVolumeBootPattern-1165351049 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:28:12.007140 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-225a4431-80e4-4370-855f-47fb1bf2d21a tempest-TestVolumeBootPattern-1165351049 None] deleting rbd volume volume-2fb22bc4-5b5a-4c49-8ee0-26772c8d7020 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:28:12.374619 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-225a4431-80e4-4370-855f-47fb1bf2d21a tempest-TestVolumeBootPattern-1165351049 None] Created reservations ['b314df47-8196-46e0-b47d-8e031d3d2ec6', '1b3ad03e-6afd-4bf2-8093-04c05cd856f3', '612bafd0-6202-4a1f-8b5c-45545c3a4afa', '758cbe13-4681-4564-82a7-324b2e99271f'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:28:12.428860 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-225a4431-80e4-4370-855f-47fb1bf2d21a tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:28:12.463090 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-225a4431-80e4-4370-855f-47fb1bf2d21a tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:28:12.503656 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-225a4431-80e4-4370-855f-47fb1bf2d21a tempest-TestVolumeBootPattern-1165351049 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:28:12.509586 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-225a4431-80e4-4370-855f-47fb1bf2d21a tempest-TestVolumeBootPattern-1165351049 None] Deleted volume successfully. Feb 19 21:28:12.524779 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-225a4431-80e4-4370-855f-47fb1bf2d21a tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-2fb22bc4-5b5a-4c49-8ee0-26772c8d7020-delete_volume'" released by "delete_volume" :: held 0.660s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:28:12.997688 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-355323d5-d243-4d16-b1c6-78fdd474c9af tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-ebd215e7-b598-475a-954e-90e45e168833-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:28:12.999853 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-355323d5-d243-4d16-b1c6-78fdd474c9af tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:28:22.188413 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:28:22.189621 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:28:22.210626 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:28:22.251504 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:28:43.173934 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-355323d5-d243-4d16-b1c6-78fdd474c9af tempest-TestVolumeBootPattern-1165351049 None] Created reservations ['1861ab6b-006f-4850-872f-528183dfb388', '732ae70f-5a7a-4051-a13f-20f85f5632a2', '0d23df5b-dc98-454a-aaf5-a6e5beb31131', 'd842c6c9-7110-4678-8af6-2cecb599c6ba'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:28:43.209716 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-355323d5-d243-4d16-b1c6-78fdd474c9af tempest-TestVolumeBootPattern-1165351049 None] Delete snapshot completed successfully. Feb 19 21:28:43.214344 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-355323d5-d243-4d16-b1c6-78fdd474c9af tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-ebd215e7-b598-475a-954e-90e45e168833-delete_snapshot'" released by "delete_snapshot" :: held 30.217s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:28:47.289887 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-1596cd40-3e3e-4fe9-a518-9a90c67b9075 req-a8b3520d-a815-4516-a29b-b221c8074135 tempest-TestVolumeBootPattern-1165351049 None] Terminate volume connection completed successfully. Feb 19 21:28:47.290508 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-1596cd40-3e3e-4fe9-a518-9a90c67b9075 req-a8b3520d-a815-4516-a29b-b221c8074135 tempest-TestVolumeBootPattern-1165351049 None] Deleting attachment 36a910d9-2062-4e0e-b5c7-d4a7d3c18b5b. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:28:49.228251 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a70c2a45-884f-4168-ac54-c07366ea993c tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-f7b8b771-4b05-452c-b7b9-907ea4593f17-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:28:49.263311 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a70c2a45-884f-4168-ac54-c07366ea993c tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:28:49.325013 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a70c2a45-884f-4168-ac54-c07366ea993c tempest-TestVolumeBootPattern-1165351049 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:28:49.331485 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a70c2a45-884f-4168-ac54-c07366ea993c tempest-TestVolumeBootPattern-1165351049 None] deleting rbd volume volume-f7b8b771-4b05-452c-b7b9-907ea4593f17 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:28:49.557474 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a70c2a45-884f-4168-ac54-c07366ea993c tempest-TestVolumeBootPattern-1165351049 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:28:49.587968 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a70c2a45-884f-4168-ac54-c07366ea993c tempest-TestVolumeBootPattern-1165351049 None] deleting parent snapshot volume-f7b8b771-4b05-452c-b7b9-907ea4593f17.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:28:50.556199 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-a70c2a45-884f-4168-ac54-c07366ea993c tempest-TestVolumeBootPattern-1165351049 None] Created reservations ['6c168d9c-494f-4ce4-be4e-6867992d1e93', '55f25970-fdc1-4a33-a15a-ecb11f58fab6', '308da7f5-0c5c-4227-8de1-3059e82b5a80', 'abdd1197-2c75-4fda-96ab-2273adc9e568'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:28:50.597821 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a70c2a45-884f-4168-ac54-c07366ea993c tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:28:50.620230 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-a70c2a45-884f-4168-ac54-c07366ea993c tempest-TestVolumeBootPattern-1165351049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:28:50.642587 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-a70c2a45-884f-4168-ac54-c07366ea993c tempest-TestVolumeBootPattern-1165351049 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:28:50.646853 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-a70c2a45-884f-4168-ac54-c07366ea993c tempest-TestVolumeBootPattern-1165351049 None] Deleted volume successfully. Feb 19 21:28:50.658873 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-a70c2a45-884f-4168-ac54-c07366ea993c tempest-TestVolumeBootPattern-1165351049 None] Lock "b'cinder-f7b8b771-4b05-452c-b7b9-907ea4593f17-delete_volume'" released by "delete_volume" :: held 1.431s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:29:22.186446 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:29:22.187080 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:29:22.209015 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:29:22.231880 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:30:22.187530 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:30:22.188719 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:30:22.210127 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:30:22.231472 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:31:22.186985 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:31:22.187854 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:31:22.225220 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:31:22.263484 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:32:07.912874 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:32:07.916397 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:32:07.916880 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:32:07.937738 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Flow 'volume_create_manager' (00812d6b-5ce9-4017-bfe2-7d5cb2c54629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:32:07.944704 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4897ddf4-fce6-45b1-a1b0-00d046b1c154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:32:07.951731 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:32:07.967399 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4897ddf4-fce6-45b1-a1b0-00d046b1c154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1858935996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8ef288d9-4908-4e07-8642-09ca661890e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f5105ec09c4f3c82c087633532c76a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:32:08Z,use_quota=True,user_id='f489d295f12b43719f3ba84f7d2dc683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:32:07.973649 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7372a37e-b6da-4bfe-ad2f-e6c454922f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:32:07.977835 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7372a37e-b6da-4bfe-ad2f-e6c454922f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:32:07.983047 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87251c13-265c-483e-8772-f8a56eed4fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:32:08.066776 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87251c13-265c-483e-8772-f8a56eed4fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8ef288d9-4908-4e07-8642-09ca661890e3', 'volume_name': 'volume-8ef288d9-4908-4e07-8642-09ca661890e3', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:32:08.072019 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec27664-2455-4b5c-875e-33d690cdb052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:32:08.076114 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec27664-2455-4b5c-875e-33d690cdb052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:32:08.081738 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62569d89-9961-41f6-9dcf-3745808d7417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:32:08.082859 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Volume 8ef288d9-4908-4e07-8642-09ca661890e3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8ef288d9-4908-4e07-8642-09ca661890e3', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 21:32:08.083534 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Cloning 8ef288d9-4908-4e07-8642-09ca661890e3 from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 21:32:08.092376 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:32:08.102348 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 32, 8, 96496)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:32:08.102911 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:32:08.103315 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Found cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 19 21:32:08.107426 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:32:08.108310 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 21:32:08.113836 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 32, 8, 111683)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:32:08.114245 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:32:08.114629 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Creating from source image-volume d609c16c-1e31-4237-8163-d85a8fcc768b {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 19 21:32:08.126044 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:32:08.175380 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] creating snapshot='volume-8ef288d9-4908-4e07-8642-09ca661890e3.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:32:08.869572 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] cloning 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b@volume-8ef288d9-4908-4e07-8642-09ca661890e3.clone_snap' to 'volume-8ef288d9-4908-4e07-8642-09ca661890e3' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:32:09.034149 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71.deleted is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:32:09.035196 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:32:09.035568 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:32:09.052344 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:32:09.052961 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Marking volume 8ef288d9-4908-4e07-8642-09ca661890e3 as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:32:09.060463 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to 8ef288d9-4908-4e07-8642-09ca661890e3. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 21:32:09.060891 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Creating volume glance metadata for volume 8ef288d9-4908-4e07-8642-09ca661890e3 backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 21:32:09.111677 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62569d89-9961-41f6-9dcf-3745808d7417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef288d9-4908-4e07-8642-09ca661890e3', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:32:09.116425 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66db8d66-d76a-4392-8d31-97227d7e0ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:32:09.125515 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Volume volume-8ef288d9-4908-4e07-8642-09ca661890e3 (8ef288d9-4908-4e07-8642-09ca661890e3): created successfully Feb 19 21:32:09.129183 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66db8d66-d76a-4392-8d31-97227d7e0ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:32:09.134794 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Flow 'volume_create_manager' (00812d6b-5ce9-4017-bfe2-7d5cb2c54629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:32:09.142866 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-bd663b49-3b2b-4aca-8441-f9224fe7ce18 tempest-TestVolumeBackupRestore-808817250 None] Created volume successfully. Feb 19 21:32:10.252271 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8cbc2389-d8a3-4b05-ad9b-2f6cfabef208 tempest-TestVolumeBackupRestore-808817250 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-19T21:32:10Z,data_timestamp=2022-02-19T21:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=f0df62d4-2f93-4fe0-acec-5a1cbed6c181,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='72f5105ec09c4f3c82c087633532c76a',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f489d295f12b43719f3ba84f7d2dc683',volume_id=8ef288d9-4908-4e07-8642-09ca661890e3) Feb 19 21:32:10.253002 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.backup.rpcapi [None req-8cbc2389-d8a3-4b05-ad9b-2f6cfabef208 tempest-TestVolumeBackupRestore-808817250 None] continue_backup in rpcapi backup_id f0df62d4-2f93-4fe0-acec-5a1cbed6c181 {{(pid=129319) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 19 21:32:10.373046 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-8cbc2389-d8a3-4b05-ad9b-2f6cfabef208 tempest-TestVolumeBackupRestore-808817250 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:32:11.031580 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-8cbc2389-d8a3-4b05-ad9b-2f6cfabef208 tempest-TestVolumeBackupRestore-808817250 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.658s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:32:11.032607 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-8cbc2389-d8a3-4b05-ad9b-2f6cfabef208 tempest-TestVolumeBackupRestore-808817250 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8ef288d9-4908-4e07-8642-09ca661890e3', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '8ef288d9-4908-4e07-8642-09ca661890e3', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:32:11.047912 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8cbc2389-d8a3-4b05-ad9b-2f6cfabef208 tempest-TestVolumeBackupRestore-808817250 None] Initialize volume connection completed successfully. Feb 19 21:32:16.809465 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8cbc2389-d8a3-4b05-ad9b-2f6cfabef208 tempest-TestVolumeBackupRestore-808817250 None] Terminate volume connection completed successfully. Feb 19 21:32:16.827779 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-8cbc2389-d8a3-4b05-ad9b-2f6cfabef208 tempest-TestVolumeBackupRestore-808817250 None] Remove volume export completed successfully. Feb 19 21:32:17.775656 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:32:17.779398 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:32:17.779886 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:32:17.799517 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Flow 'volume_create_manager' (56d651f5-cbaa-481f-b5d8-57ab6ce41523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:32:17.806159 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b02e64-1821-4839-a526-3c4164f4cd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:32:17.814750 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:32:17.833241 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b02e64-1821-4839-a526-3c4164f4cd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:32:18Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_f0df62d4-2f93-4fe0-acec-5a1cbed6c181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=78bcad5a-4a24-4ba3-af4e-0ce1c804279c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f5105ec09c4f3c82c087633532c76a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:32:18Z,use_quota=True,user_id='f489d295f12b43719f3ba84f7d2dc683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:32:17.838642 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8750f9-ed87-4717-a0bd-ede88d2b0121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:32:17.842809 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8750f9-ed87-4717-a0bd-ede88d2b0121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:32:17.847953 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e71522-1a81-47df-8ad1-45aab94558eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:32:17.852150 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e71522-1a81-47df-8ad1-45aab94558eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78bcad5a-4a24-4ba3-af4e-0ce1c804279c', 'volume_name': 'volume-78bcad5a-4a24-4ba3-af4e-0ce1c804279c', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:32:17.857173 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d8cd73-bae9-4146-958b-122d459babe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:32:17.861244 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d8cd73-bae9-4146-958b-122d459babe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:32:17.866062 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57ad728-7391-4008-aa38-e81cb5c227fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:32:17.867136 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Volume 78bcad5a-4a24-4ba3-af4e-0ce1c804279c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78bcad5a-4a24-4ba3-af4e-0ce1c804279c', 'volume_size': 1} Feb 19 21:32:17.867541 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] creating volume 'volume-78bcad5a-4a24-4ba3-af4e-0ce1c804279c' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:32:17.868666 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:32:17.919441 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:32:17.919777 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:32:17.923604 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57ad728-7391-4008-aa38-e81cb5c227fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78bcad5a-4a24-4ba3-af4e-0ce1c804279c', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:32:17.928256 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68300dc9-9c7f-4085-8637-0f546e5bd7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:32:17.936851 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Volume volume-78bcad5a-4a24-4ba3-af4e-0ce1c804279c (78bcad5a-4a24-4ba3-af4e-0ce1c804279c): created successfully Feb 19 21:32:17.940887 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68300dc9-9c7f-4085-8637-0f546e5bd7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:32:17.946374 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Flow 'volume_create_manager' (56d651f5-cbaa-481f-b5d8-57ab6ce41523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:32:17.954498 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Created volume successfully. Feb 19 21:32:18.850027 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:32:19.486131 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.636s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:32:19.486828 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-78bcad5a-4a24-4ba3-af4e-0ce1c804279c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '78bcad5a-4a24-4ba3-af4e-0ce1c804279c', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:32:19.502908 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Initialize volume connection completed successfully. Feb 19 21:32:22.189423 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:32:22.190582 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:32:22.228564 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:32:22.259686 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:32:23.018102 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Terminate volume connection completed successfully. Feb 19 21:32:23.033104 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-d969a2d2-cbf6-45bd-bcbc-6882d801c959 tempest-TestVolumeBackupRestore-808817250 None] Remove volume export completed successfully. Feb 19 21:32:26.957124 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-dcc14f3a-f071-4571-bbda-ee018ee39156 req-f50f11f1-2c9b-4d2c-9465-17928f4e07c7 tempest-TestVolumeBackupRestore-808817250 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:32:27.627955 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-dcc14f3a-f071-4571-bbda-ee018ee39156 req-f50f11f1-2c9b-4d2c-9465-17928f4e07c7 tempest-TestVolumeBackupRestore-808817250 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.671s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:32:27.628893 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-dcc14f3a-f071-4571-bbda-ee018ee39156 req-f50f11f1-2c9b-4d2c-9465-17928f4e07c7 tempest-TestVolumeBackupRestore-808817250 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-78bcad5a-4a24-4ba3-af4e-0ce1c804279c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '78bcad5a-4a24-4ba3-af4e-0ce1c804279c', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:32:27.653410 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-dcc14f3a-f071-4571-bbda-ee018ee39156 req-f50f11f1-2c9b-4d2c-9465-17928f4e07c7 tempest-TestVolumeBackupRestore-808817250 None] Connection info returned from driver {'name': 'volumes/volume-78bcad5a-4a24-4ba3-af4e-0ce1c804279c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '78bcad5a-4a24-4ba3-af4e-0ce1c804279c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e4991b9b-f161-49b8-a194-559b8cd17938'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:32:27.709078 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-dcc14f3a-f071-4571-bbda-ee018ee39156 req-f50f11f1-2c9b-4d2c-9465-17928f4e07c7 tempest-TestVolumeBackupRestore-808817250 None] attachment_update completed successfully. Feb 19 21:33:21.464028 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-5372d310-c256-43f8-9b73-8f1c01a7b3c6 req-3822033a-16cd-4d5e-9baa-2c006281cbdb tempest-TestVolumeBackupRestore-808817250 None] Terminate volume connection completed successfully. Feb 19 21:33:21.464702 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-5372d310-c256-43f8-9b73-8f1c01a7b3c6 req-3822033a-16cd-4d5e-9baa-2c006281cbdb tempest-TestVolumeBackupRestore-808817250 None] Deleting attachment e4991b9b-f161-49b8-a194-559b8cd17938. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:33:22.186269 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:33:22.187028 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:33:22.210002 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:33:22.232080 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:33:22.862476 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-9d9be507-7733-4f7b-892f-460062945d85 tempest-TestVolumeBackupRestore-808817250 None] Lock "b'cinder-78bcad5a-4a24-4ba3-af4e-0ce1c804279c-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:33:22.893057 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9d9be507-7733-4f7b-892f-460062945d85 tempest-TestVolumeBackupRestore-808817250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:33:23.858037 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9d9be507-7733-4f7b-892f-460062945d85 tempest-TestVolumeBackupRestore-808817250 None] Volume volume-78bcad5a-4a24-4ba3-af4e-0ce1c804279c is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:33:23.873828 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9d9be507-7733-4f7b-892f-460062945d85 tempest-TestVolumeBackupRestore-808817250 None] deleting rbd volume volume-78bcad5a-4a24-4ba3-af4e-0ce1c804279c {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:33:23.888182 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-5c394d90-f16f-4a92-8f5b-af019bb7af3a tempest-TestVolumeBackupRestore-808817250 None] Lock "b'cinder-8ef288d9-4908-4e07-8642-09ca661890e3-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:33:23.922151 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5c394d90-f16f-4a92-8f5b-af019bb7af3a tempest-TestVolumeBackupRestore-808817250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:33:24.874515 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5c394d90-f16f-4a92-8f5b-af019bb7af3a tempest-TestVolumeBackupRestore-808817250 None] deleting rbd volume volume-8ef288d9-4908-4e07-8642-09ca661890e3 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:33:24.916243 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-9d9be507-7733-4f7b-892f-460062945d85 tempest-TestVolumeBackupRestore-808817250 None] Created reservations ['3354c967-21ae-4cdc-93f8-df6d79e1d371', 'f0ed457c-e446-43bb-9576-e881717e026a', 'ca94db16-e712-4830-999e-64c667801202', '55ab2f17-ec06-4e89-97a7-adeebc07add9'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:33:24.961594 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9d9be507-7733-4f7b-892f-460062945d85 tempest-TestVolumeBackupRestore-808817250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:33:24.992574 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9d9be507-7733-4f7b-892f-460062945d85 tempest-TestVolumeBackupRestore-808817250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:33:25.020380 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-9d9be507-7733-4f7b-892f-460062945d85 tempest-TestVolumeBackupRestore-808817250 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:33:25.024736 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-9d9be507-7733-4f7b-892f-460062945d85 tempest-TestVolumeBackupRestore-808817250 None] Deleted volume successfully. Feb 19 21:33:25.037703 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-9d9be507-7733-4f7b-892f-460062945d85 tempest-TestVolumeBackupRestore-808817250 None] Lock "b'cinder-78bcad5a-4a24-4ba3-af4e-0ce1c804279c-delete_volume'" released by "delete_volume" :: held 2.175s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:33:25.039468 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5c394d90-f16f-4a92-8f5b-af019bb7af3a tempest-TestVolumeBackupRestore-808817250 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 21:33:25.074334 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5c394d90-f16f-4a92-8f5b-af019bb7af3a tempest-TestVolumeBackupRestore-808817250 None] deleting parent snapshot volume-8ef288d9-4908-4e07-8642-09ca661890e3.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 21:33:25.927063 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-5c394d90-f16f-4a92-8f5b-af019bb7af3a tempest-TestVolumeBackupRestore-808817250 None] Created reservations ['631a3ffb-449a-4a4f-8535-cfaf8fcd78dd', 'ac54a37a-8cec-4693-b611-91bbdcd41dec', 'cd0b22dc-9e81-4e34-bab0-0dfffdf50c21', '862449f0-c9c4-48d6-ae5c-b67cb2b0099f'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:33:25.967069 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5c394d90-f16f-4a92-8f5b-af019bb7af3a tempest-TestVolumeBackupRestore-808817250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:33:25.989481 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-5c394d90-f16f-4a92-8f5b-af019bb7af3a tempest-TestVolumeBackupRestore-808817250 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:33:26.012103 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-5c394d90-f16f-4a92-8f5b-af019bb7af3a tempest-TestVolumeBackupRestore-808817250 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:33:26.016081 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-5c394d90-f16f-4a92-8f5b-af019bb7af3a tempest-TestVolumeBackupRestore-808817250 None] Deleted volume successfully. Feb 19 21:33:26.027830 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-5c394d90-f16f-4a92-8f5b-af019bb7af3a tempest-TestVolumeBackupRestore-808817250 None] Lock "b'cinder-8ef288d9-4908-4e07-8642-09ca661890e3-delete_volume'" released by "delete_volume" :: held 2.140s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:34:22.187011 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:34:22.187669 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:34:22.209087 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:34:22.231651 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:35:22.188156 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:35:22.188854 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:35:22.210231 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:35:22.234662 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:36:22.189596 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:36:22.190286 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:36:22.213220 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:36:22.243352 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:37:22.189118 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:37:22.189805 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:37:22.211320 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:37:22.233578 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:38:22.189038 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:38:22.189809 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:38:22.212523 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:38:22.240193 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:39:14.476777 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:39:14.481297 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:39:14.482000 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:39:14.502814 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Flow 'volume_create_manager' (7ed5ffeb-6a0b-43af-9869-6338ff757d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:39:14.509600 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b7ab37-e7ce-4821-a89b-8c73c55db856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:39:14.517231 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:39:14.532616 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b7ab37-e7ce-4821-a89b-8c73c55db856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-65343511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a6ad45be-0d7e-46fe-8519-8b43631515d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6be5d4ae2946bb9304ae0a31f2c325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:39:14Z,use_quota=True,user_id='f14d8011b7c241f7b5ecdee4c3f44ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:39:14.538520 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b92d90e-d7e1-4907-8529-7c895498b657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:39:14.542961 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b92d90e-d7e1-4907-8529-7c895498b657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:39:14.548366 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8a3990-de93-48ab-973e-b983ffec25d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:39:14.552705 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8a3990-de93-48ab-973e-b983ffec25d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6ad45be-0d7e-46fe-8519-8b43631515d7', 'volume_name': 'volume-a6ad45be-0d7e-46fe-8519-8b43631515d7', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:39:14.557784 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ab953b-3277-4b8b-a9b7-8a809151e4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:39:14.562381 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ab953b-3277-4b8b-a9b7-8a809151e4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:39:14.567389 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45475bd-03cb-4ca6-ae10-dad7153578c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:39:14.568506 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Volume a6ad45be-0d7e-46fe-8519-8b43631515d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6ad45be-0d7e-46fe-8519-8b43631515d7', 'volume_size': 1} Feb 19 21:39:14.569065 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] creating volume 'volume-a6ad45be-0d7e-46fe-8519-8b43631515d7' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:39:14.570200 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:39:14.628616 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:39:14.629233 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:39:14.633385 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45475bd-03cb-4ca6-ae10-dad7153578c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6ad45be-0d7e-46fe-8519-8b43631515d7', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:39:14.638940 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773cbeab-d195-494a-acf7-675d188dbf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:39:14.649976 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Volume volume-a6ad45be-0d7e-46fe-8519-8b43631515d7 (a6ad45be-0d7e-46fe-8519-8b43631515d7): created successfully Feb 19 21:39:14.654202 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773cbeab-d195-494a-acf7-675d188dbf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:39:14.659862 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Flow 'volume_create_manager' (7ed5ffeb-6a0b-43af-9869-6338ff757d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:39:14.673269 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-9a477ad4-71a6-4b10-a0f6-d5a622d2aa7c tempest-ServerActionsTestJSON-859315114 None] Created volume successfully. Feb 19 21:39:16.019487 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-fbbd5651-c171-4799-8f6f-503dd50d2f96 req-bdba54e6-ec5f-4024-8a18-a7611119dde7 tempest-ServerActionsTestJSON-859315114 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:39:16.667135 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-fbbd5651-c171-4799-8f6f-503dd50d2f96 req-bdba54e6-ec5f-4024-8a18-a7611119dde7 tempest-ServerActionsTestJSON-859315114 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.647s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:39:16.667986 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-fbbd5651-c171-4799-8f6f-503dd50d2f96 req-bdba54e6-ec5f-4024-8a18-a7611119dde7 tempest-ServerActionsTestJSON-859315114 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a6ad45be-0d7e-46fe-8519-8b43631515d7', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'a6ad45be-0d7e-46fe-8519-8b43631515d7', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:39:16.691036 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-fbbd5651-c171-4799-8f6f-503dd50d2f96 req-bdba54e6-ec5f-4024-8a18-a7611119dde7 tempest-ServerActionsTestJSON-859315114 None] Connection info returned from driver {'name': 'volumes/volume-a6ad45be-0d7e-46fe-8519-8b43631515d7', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a6ad45be-0d7e-46fe-8519-8b43631515d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3cde3c5a-e7c6-4e58-b785-9b9765d7b10e'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:39:16.738083 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-fbbd5651-c171-4799-8f6f-503dd50d2f96 req-bdba54e6-ec5f-4024-8a18-a7611119dde7 tempest-ServerActionsTestJSON-859315114 None] attachment_update completed successfully. Feb 19 21:39:22.191078 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:39:22.192094 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:39:22.216571 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:39:22.238386 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:39:38.541399 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf req-8535b85c-ae95-4810-843b-8a69931d661e tempest-ServerActionsTestJSON-859315114 None] Terminate volume connection completed successfully. Feb 19 21:39:38.542092 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf req-8535b85c-ae95-4810-843b-8a69931d661e tempest-ServerActionsTestJSON-859315114 None] Deleting attachment 3cde3c5a-e7c6-4e58-b785-9b9765d7b10e. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:39:40.314713 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf req-5cb87623-548d-42b6-a89c-89bbe0356d23 tempest-ServerActionsTestJSON-859315114 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:39:40.943603 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf req-5cb87623-548d-42b6-a89c-89bbe0356d23 tempest-ServerActionsTestJSON-859315114 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.629s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:39:40.944459 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf req-5cb87623-548d-42b6-a89c-89bbe0356d23 tempest-ServerActionsTestJSON-859315114 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a6ad45be-0d7e-46fe-8519-8b43631515d7', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'a6ad45be-0d7e-46fe-8519-8b43631515d7', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:39:40.967842 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf req-5cb87623-548d-42b6-a89c-89bbe0356d23 tempest-ServerActionsTestJSON-859315114 None] Connection info returned from driver {'name': 'volumes/volume-a6ad45be-0d7e-46fe-8519-8b43631515d7', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a6ad45be-0d7e-46fe-8519-8b43631515d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5e78d2bc-779d-4979-a68f-73731fc3f940'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:39:41.010619 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf req-5cb87623-548d-42b6-a89c-89bbe0356d23 tempest-ServerActionsTestJSON-859315114 None] attachment_update completed successfully. Feb 19 21:39:46.733213 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 req-a1305bd6-1be8-4d1f-b48c-9ffd2053dc29 tempest-ServerActionsTestJSON-859315114 None] Terminate volume connection completed successfully. Feb 19 21:39:46.733918 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 req-a1305bd6-1be8-4d1f-b48c-9ffd2053dc29 tempest-ServerActionsTestJSON-859315114 None] Deleting attachment 5e78d2bc-779d-4979-a68f-73731fc3f940. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:39:48.914303 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 req-c52aa959-d3e0-4a17-84d4-0c2e004b1722 tempest-ServerActionsTestJSON-859315114 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:39:49.542715 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 req-c52aa959-d3e0-4a17-84d4-0c2e004b1722 tempest-ServerActionsTestJSON-859315114 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.628s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:39:49.543589 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 req-c52aa959-d3e0-4a17-84d4-0c2e004b1722 tempest-ServerActionsTestJSON-859315114 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a6ad45be-0d7e-46fe-8519-8b43631515d7', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'a6ad45be-0d7e-46fe-8519-8b43631515d7', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:39:49.566229 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 req-c52aa959-d3e0-4a17-84d4-0c2e004b1722 tempest-ServerActionsTestJSON-859315114 None] Connection info returned from driver {'name': 'volumes/volume-a6ad45be-0d7e-46fe-8519-8b43631515d7', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a6ad45be-0d7e-46fe-8519-8b43631515d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3f77c662-b420-4fd0-aa11-305688dea317'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:39:49.613125 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 req-c52aa959-d3e0-4a17-84d4-0c2e004b1722 tempest-ServerActionsTestJSON-859315114 None] attachment_update completed successfully. Feb 19 21:39:57.427321 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-0929b150-6478-4d4d-a3f9-370155f56f77 req-f082d43f-1fa6-479d-b0c8-fdc38ff802f0 tempest-ServerActionsTestJSON-859315114 None] Terminate volume connection completed successfully. Feb 19 21:39:57.427991 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-0929b150-6478-4d4d-a3f9-370155f56f77 req-f082d43f-1fa6-479d-b0c8-fdc38ff802f0 tempest-ServerActionsTestJSON-859315114 None] Deleting attachment 3f77c662-b420-4fd0-aa11-305688dea317. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:39:58.313254 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-f86ee885-6759-4e73-a1d2-4d9314ca51a5 tempest-ServerActionsTestJSON-859315114 None] Lock "b'cinder-a6ad45be-0d7e-46fe-8519-8b43631515d7-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:39:58.352559 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f86ee885-6759-4e73-a1d2-4d9314ca51a5 tempest-ServerActionsTestJSON-859315114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:39:58.396314 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f86ee885-6759-4e73-a1d2-4d9314ca51a5 tempest-ServerActionsTestJSON-859315114 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:39:58.396805 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f86ee885-6759-4e73-a1d2-4d9314ca51a5 tempest-ServerActionsTestJSON-859315114 None] Volume volume-a6ad45be-0d7e-46fe-8519-8b43631515d7 is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:39:58.401155 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f86ee885-6759-4e73-a1d2-4d9314ca51a5 tempest-ServerActionsTestJSON-859315114 None] deleting rbd volume volume-a6ad45be-0d7e-46fe-8519-8b43631515d7 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:39:58.618091 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-f86ee885-6759-4e73-a1d2-4d9314ca51a5 tempest-ServerActionsTestJSON-859315114 None] Created reservations ['4e5deae9-2eec-4fa7-b264-7938a90c8cf4', 'b1b2d496-31cb-4aaf-b76c-e8baf347bf9a', '48a9378f-66c9-437d-9e5e-b8eaed093986', 'a70d94d8-b100-4640-9161-b169f156c1d5'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:39:58.664256 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f86ee885-6759-4e73-a1d2-4d9314ca51a5 tempest-ServerActionsTestJSON-859315114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:39:58.686488 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-f86ee885-6759-4e73-a1d2-4d9314ca51a5 tempest-ServerActionsTestJSON-859315114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:39:58.710675 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-f86ee885-6759-4e73-a1d2-4d9314ca51a5 tempest-ServerActionsTestJSON-859315114 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:39:58.714972 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-f86ee885-6759-4e73-a1d2-4d9314ca51a5 tempest-ServerActionsTestJSON-859315114 None] Deleted volume successfully. Feb 19 21:39:58.725740 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-f86ee885-6759-4e73-a1d2-4d9314ca51a5 tempest-ServerActionsTestJSON-859315114 None] Lock "b'cinder-a6ad45be-0d7e-46fe-8519-8b43631515d7-delete_volume'" released by "delete_volume" :: held 0.413s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:40:22.193698 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:40:22.194347 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:40:22.215696 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:40:22.237845 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:41:22.193667 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:41:22.194444 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:41:22.223309 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:41:22.249979 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:41:31.416056 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:41:31.419672 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:41:31.420146 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:41:31.441265 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Flow 'volume_create_manager' (cd341917-acfa-4ea7-be22-a7d83f7d9032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:41:31.450220 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832a8b7f-cc88-45f3-b314-6cec1e87753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:41:31.459140 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:41:31.481162 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832a8b7f-cc88-45f3-b314-6cec1e87753e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1814685829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0917b9de-7f28-499b-8836-aa0ebe87910d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff3f023fc254bbea87959ce0e95a1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:41:31Z,use_quota=True,user_id='9e9155525bc1486da02f94f41e30fc4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:41:31.486657 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a845c0-05a6-4354-a321-f2a04d881e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:41:31.490808 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a845c0-05a6-4354-a321-f2a04d881e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:41:31.495938 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1045d48f-88c7-4a44-984b-43cf17e41bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:41:31.500676 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1045d48f-88c7-4a44-984b-43cf17e41bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0917b9de-7f28-499b-8836-aa0ebe87910d', 'volume_name': 'volume-0917b9de-7f28-499b-8836-aa0ebe87910d', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:41:31.506104 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe8974e-9075-48a6-bcf7-b8e75e6376c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:41:31.510091 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe8974e-9075-48a6-bcf7-b8e75e6376c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:41:31.515397 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3198e13d-5be2-43f8-bb39-52359ecafdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:41:31.516492 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Volume 0917b9de-7f28-499b-8836-aa0ebe87910d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0917b9de-7f28-499b-8836-aa0ebe87910d', 'volume_size': 1} Feb 19 21:41:31.516884 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] creating volume 'volume-0917b9de-7f28-499b-8836-aa0ebe87910d' {{(pid=129319) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 19 21:41:31.517871 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:41:31.564353 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:41:31.564738 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:41:31.568432 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3198e13d-5be2-43f8-bb39-52359ecafdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0917b9de-7f28-499b-8836-aa0ebe87910d', 'volume_size': 1}' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:41:31.573470 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51eedc4-d33f-4be4-a182-a90a28a21d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:41:31.583315 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Volume volume-0917b9de-7f28-499b-8836-aa0ebe87910d (0917b9de-7f28-499b-8836-aa0ebe87910d): created successfully Feb 19 21:41:31.587044 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51eedc4-d33f-4be4-a182-a90a28a21d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:41:31.592583 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Flow 'volume_create_manager' (cd341917-acfa-4ea7-be22-a7d83f7d9032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:41:31.600522 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-b18f894f-d2c3-4cd7-9dc4-783e50f2140e tempest-TestMinimumBasicScenario-58086540 None] Created volume successfully. Feb 19 21:41:32.959624 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-1a97b876-4aa4-4ed0-8342-cb741f0aac7d req-d601b9fd-594e-43cb-a0f6-b5aebef6e6a7 tempest-TestMinimumBasicScenario-58086540 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:41:33.714976 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-1a97b876-4aa4-4ed0-8342-cb741f0aac7d req-d601b9fd-594e-43cb-a0f6-b5aebef6e6a7 tempest-TestMinimumBasicScenario-58086540 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.755s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:41:33.715779 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-1a97b876-4aa4-4ed0-8342-cb741f0aac7d req-d601b9fd-594e-43cb-a0f6-b5aebef6e6a7 tempest-TestMinimumBasicScenario-58086540 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0917b9de-7f28-499b-8836-aa0ebe87910d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': '0917b9de-7f28-499b-8836-aa0ebe87910d', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:41:33.738514 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-1a97b876-4aa4-4ed0-8342-cb741f0aac7d req-d601b9fd-594e-43cb-a0f6-b5aebef6e6a7 tempest-TestMinimumBasicScenario-58086540 None] Connection info returned from driver {'name': 'volumes/volume-0917b9de-7f28-499b-8836-aa0ebe87910d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0917b9de-7f28-499b-8836-aa0ebe87910d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '55bfb360-c366-4f40-a56d-a8042167c6f2'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:41:33.782620 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-1a97b876-4aa4-4ed0-8342-cb741f0aac7d req-d601b9fd-594e-43cb-a0f6-b5aebef6e6a7 tempest-TestMinimumBasicScenario-58086540 None] attachment_update completed successfully. Feb 19 21:42:22.195587 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:42:22.196655 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:42:22.219882 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:42:22.242352 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:43:22.198699 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:43:22.199439 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:43:22.220302 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:43:22.242567 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:43:59.242535 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-72269831-200c-4339-a1c0-fb609a77ea10 req-e32d463e-c75f-40d1-b2be-f6a1b0404931 tempest-TestMinimumBasicScenario-58086540 None] Terminate volume connection completed successfully. Feb 19 21:43:59.243221 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-72269831-200c-4339-a1c0-fb609a77ea10 req-e32d463e-c75f-40d1-b2be-f6a1b0404931 tempest-TestMinimumBasicScenario-58086540 None] Deleting attachment 55bfb360-c366-4f40-a56d-a8042167c6f2. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 21:43:59.793390 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-2532f659-eae9-46fd-8abb-36dc4942741a tempest-TestMinimumBasicScenario-58086540 None] Lock "b'cinder-0917b9de-7f28-499b-8836-aa0ebe87910d-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:43:59.825728 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2532f659-eae9-46fd-8abb-36dc4942741a tempest-TestMinimumBasicScenario-58086540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:43:59.863128 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2532f659-eae9-46fd-8abb-36dc4942741a tempest-TestMinimumBasicScenario-58086540 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 21:43:59.863575 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2532f659-eae9-46fd-8abb-36dc4942741a tempest-TestMinimumBasicScenario-58086540 None] Volume volume-0917b9de-7f28-499b-8836-aa0ebe87910d is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:43:59.868180 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2532f659-eae9-46fd-8abb-36dc4942741a tempest-TestMinimumBasicScenario-58086540 None] deleting rbd volume volume-0917b9de-7f28-499b-8836-aa0ebe87910d {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 21:44:00.048831 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [None req-2532f659-eae9-46fd-8abb-36dc4942741a tempest-TestMinimumBasicScenario-58086540 None] Created reservations ['6ec9d914-b890-4411-aacb-596114f594ed', '3eedd588-a8e7-44ee-b7a8-24db73565e84', '0efb6e91-83e5-4caf-8e9c-3dfbef3c3483', '187ae1f6-2018-4c01-acdc-60e0315809f4'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 21:44:00.090976 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2532f659-eae9-46fd-8abb-36dc4942741a tempest-TestMinimumBasicScenario-58086540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:44:00.113720 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-2532f659-eae9-46fd-8abb-36dc4942741a tempest-TestMinimumBasicScenario-58086540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:44:00.136724 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-2532f659-eae9-46fd-8abb-36dc4942741a tempest-TestMinimumBasicScenario-58086540 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:44:00.140957 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-2532f659-eae9-46fd-8abb-36dc4942741a tempest-TestMinimumBasicScenario-58086540 None] Deleted volume successfully. Feb 19 21:44:00.152134 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-2532f659-eae9-46fd-8abb-36dc4942741a tempest-TestMinimumBasicScenario-58086540 None] Lock "b'cinder-0917b9de-7f28-499b-8836-aa0ebe87910d-delete_volume'" released by "delete_volume" :: held 0.359s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:44:22.197840 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:44:22.199512 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:44:22.243314 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:44:22.298272 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:45:22.194199 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:45:22.195131 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:45:22.248256 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:45:22.302651 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:46:22.191421 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:46:22.192082 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:46:22.223433 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:46:22.245254 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:47:22.190012 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:47:22.190665 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:47:22.212822 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:47:22.234148 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:48:22.189861 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:48:22.190565 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:48:22.213009 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:48:22.234854 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:49:22.189600 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:49:22.190254 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:49:22.213525 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:49:22.234887 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:50:22.190413 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:50:22.191069 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:50:22.212466 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:50:22.234325 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:51:22.189698 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:51:22.190364 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:51:22.214893 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:51:22.237758 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:52:22.193221 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:52:22.193915 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:52:22.215999 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:52:22.239701 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:53:22.195099 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:53:22.196125 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:53:22.224284 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:53:22.251106 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:54:22.196832 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:54:22.197500 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:54:22.219168 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:54:22.241194 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:55:22.199609 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:55:22.200300 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:55:22.222229 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:55:22.243692 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:56:22.198809 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:56:22.199561 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:56:22.221608 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:56:22.243753 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:57:22.198879 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:57:22.199647 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:57:22.225183 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:57:22.250150 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:58:22.202334 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:58:22.203389 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:58:22.243520 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:58:22.281351 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 21:58:27.963515 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129319) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 19 21:58:27.967647 ncdv-master-1 cinder-volume[129319]: WARNING stevedore.named [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 19 21:58:27.968133 ncdv-master-1 cinder-volume[129319]: WARNING castellan.key_manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 19 21:58:27.988255 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Flow 'volume_create_manager' (35a63799-9be7-43e9-afdd-c3d5a8d591b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:58:27.995077 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d35b998-4c2d-4d5b-866d-b4023507fd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:58:28.003245 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_db.sqlalchemy.engines [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 21:58:28.019809 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d35b998-4c2d-4d5b-866d-b4023507fd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-19T21:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1234931576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fa69f814-9e36-4b8f-984f-b625d340f350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f56cec0383d41f097d9ec75bbddc499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-19T21:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-19T21:58:28Z,use_quota=True,user_id='e56dfa82fd8f439fabb876411484f2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3959e0-7862-44bf-8d0e-18095bf7c9d3),volume_type_id=6b3959e0-7862-44bf-8d0e-18095bf7c9d3)' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:58:28.025401 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3528c8cc-b080-410c-b6f7-ec07fd40616b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:58:28.030252 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3528c8cc-b080-410c-b6f7-ec07fd40616b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:58:28.035504 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bbf64a-9f98-431a-9976-c33b9e2fd84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:58:28.124753 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bbf64a-9f98-431a-9976-c33b9e2fd84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa69f814-9e36-4b8f-984f-b625d340f350', 'volume_name': 'volume-fa69f814-9e36-4b8f-984f-b625d340f350', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:58:28.129814 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80b23b6-d660-456f-b723-5e4665b6de6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:58:28.134098 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80b23b6-d660-456f-b723-5e4665b6de6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:58:28.139363 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3183d7-e394-4e9f-aac0-4ecfbb79db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:58:28.140515 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Volume fa69f814-9e36-4b8f-984f-b625d340f350: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa69f814-9e36-4b8f-984f-b625d340f350', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 19 21:58:28.141080 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Cloning fa69f814-9e36-4b8f-984f-b625d340f350 from image f75529b9-2911-475e-b974-4af06053c17c at location (None, None). {{(pid=129319) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 19 21:58:28.157243 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 21:58:28.173795 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 58, 28, 166564)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:58:28.174434 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:58:28.175295 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Found cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 19 21:58:28.181275 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Lock "b'cinder-f75529b9-2911-475e-b974-4af06053c17c'" released by "_prepare_image_cache_entry" :: held 0.024s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 21:58:28.182264 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Attempting to retrieve cache entry for image = f75529b9-2911-475e-b974-4af06053c17c on host ncdv-master-1@ceph#ceph. {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 19 21:58:28.188166 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Found image-volume cache entry: {'id': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'volume_id': 'd609c16c-1e31-4237-8163-d85a8fcc768b', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36), 'last_used': datetime.datetime(2022, 2, 19, 21, 58, 28, 185942)}. {{(pid=129319) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 19 21:58:28.188614 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.image.cache [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Image-volume cache entry image_update_at = 2022-02-19 20:41:36+00:00, requested image updated_at = 2022-02-19 20:41:36+00:00. {{(pid=129319) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 19 21:58:28.189341 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Creating from source image-volume d609c16c-1e31-4237-8163-d85a8fcc768b {{(pid=129319) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 19 21:58:28.202874 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:58:28.263189 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] creating snapshot='volume-fa69f814-9e36-4b8f-984f-b625d340f350.clone_snap' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 19 21:58:28.898280 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] cloning 'volume-d609c16c-1e31-4237-8163-d85a8fcc768b@volume-fa69f814-9e36-4b8f-984f-b625d340f350.clone_snap' to 'volume-fa69f814-9e36-4b8f-984f-b625d340f350' {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 19 21:58:29.060391 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Volume volume-03b5535c-cf30-4b6c-9466-5ea912a33e71.deleted is not a clone. {{(pid=129319) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 19 21:58:29.061632 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 19 21:58:29.062011 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129319) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 19 21:58:29.080935 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] clone created successfully {{(pid=129319) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 19 21:58:29.081729 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.volume_utils [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Marking volume fa69f814-9e36-4b8f-984f-b625d340f350 as bootable. {{(pid=129319) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 19 21:58:29.089338 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Copying metadata from image f75529b9-2911-475e-b974-4af06053c17c to fa69f814-9e36-4b8f-984f-b625d340f350. {{(pid=129319) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 19 21:58:29.089753 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Creating volume glance metadata for volume fa69f814-9e36-4b8f-984f-b625d340f350 backed by image f75529b9-2911-475e-b974-4af06053c17c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129319) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 19 21:58:29.141466 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3183d7-e394-4e9f-aac0-4ecfbb79db62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa69f814-9e36-4b8f-984f-b625d340f350', 'volume_size': 1, 'image_id': 'f75529b9-2911-475e-b974-4af06053c17c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8848562c8fea4a5fbbab0bbfcc0a45f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'f75529b9-2911-475e-b974-4af06053c17c', 'created_at': datetime.datetime(2022, 2, 19, 20, 41, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 19, 20, 41, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f75529b9-2911-475e-b974-4af06053c17c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:58:29.146246 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2b5732-0e84-448e-9bf1-b4f9ab16cbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 19 21:58:29.155636 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.flows.manager.create_volume [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Volume volume-fa69f814-9e36-4b8f-984f-b625d340f350 (fa69f814-9e36-4b8f-984f-b625d340f350): created successfully Feb 19 21:58:29.159369 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2b5732-0e84-448e-9bf1-b4f9ab16cbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129319) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 19 21:58:29.164853 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Flow 'volume_create_manager' (35a63799-9be7-43e9-afdd-c3d5a8d591b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129319) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 19 21:58:29.173614 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [None req-e1ed7ae6-e1d8-4569-996e-073c05d968b5 tempest-TestShelveInstance-2110534879 None] Created volume successfully. Feb 19 21:58:37.296397 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-9570e031-ecf8-4685-bf42-f440f5a02c21 req-73d13827-2d66-4603-853a-2d0e06fac999 tempest-TestShelveInstance-2110534879 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:58:38.054271 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-9570e031-ecf8-4685-bf42-f440f5a02c21 req-73d13827-2d66-4603-853a-2d0e06fac999 tempest-TestShelveInstance-2110534879 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.757s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:58:38.055220 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-9570e031-ecf8-4685-bf42-f440f5a02c21 req-73d13827-2d66-4603-853a-2d0e06fac999 tempest-TestShelveInstance-2110534879 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fa69f814-9e36-4b8f-984f-b625d340f350', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'fa69f814-9e36-4b8f-984f-b625d340f350', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 21:58:38.085999 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-9570e031-ecf8-4685-bf42-f440f5a02c21 req-73d13827-2d66-4603-853a-2d0e06fac999 tempest-TestShelveInstance-2110534879 None] Connection info returned from driver {'name': 'volumes/volume-fa69f814-9e36-4b8f-984f-b625d340f350', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fa69f814-9e36-4b8f-984f-b625d340f350', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'de0aa4de-b0a0-482b-b78a-868710279b9b'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 21:58:38.185218 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-9570e031-ecf8-4685-bf42-f440f5a02c21 req-73d13827-2d66-4603-853a-2d0e06fac999 tempest-TestShelveInstance-2110534879 None] attachment_update completed successfully. Feb 19 21:59:22.208257 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 21:59:22.209587 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:59:22.241941 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 21:59:22.278721 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:00:22.206142 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:00:22.206872 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:00:22.230201 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:00:22.254636 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:01:15.876205 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-bbbd83a7-a4c9-420d-9a73-3df718a03689 req-32fcfdbd-f104-4c15-88d0-c44e68f1c783 tempest-TestShelveInstance-2110534879 None] Terminate volume connection completed successfully. Feb 19 22:01:15.876959 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-bbbd83a7-a4c9-420d-9a73-3df718a03689 req-32fcfdbd-f104-4c15-88d0-c44e68f1c783 tempest-TestShelveInstance-2110534879 None] Deleting attachment de0aa4de-b0a0-482b-b78a-868710279b9b. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 22:01:19.915671 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-61a75d87-623b-4990-aeef-5c5019ec4c72 req-ecd29b13-592e-4422-a1a9-a80bbdd8655c tempest-TestShelveInstance-2110534879 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 22:01:20.568880 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_concurrency.processutils [req-61a75d87-623b-4990-aeef-5c5019ec4c72 req-ecd29b13-592e-4422-a1a9-a80bbdd8655c tempest-TestShelveInstance-2110534879 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.653s {{(pid=129319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 22:01:20.569698 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-61a75d87-623b-4990-aeef-5c5019ec4c72 req-ecd29b13-592e-4422-a1a9-a80bbdd8655c tempest-TestShelveInstance-2110534879 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fa69f814-9e36-4b8f-984f-b625d340f350', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '167b51cb-458c-4c19-8d8b-544fd33b1dfd', 'volume_id': 'fa69f814-9e36-4b8f-984f-b625d340f350', 'discard': True}} {{(pid=129319) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 19 22:01:20.594292 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-61a75d87-623b-4990-aeef-5c5019ec4c72 req-ecd29b13-592e-4422-a1a9-a80bbdd8655c tempest-TestShelveInstance-2110534879 None] Connection info returned from driver {'name': 'volumes/volume-fa69f814-9e36-4b8f-984f-b625d340f350', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fa69f814-9e36-4b8f-984f-b625d340f350', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '59586886-a6b4-4202-aa24-927207f479dd'} {{(pid=129319) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 19 22:01:20.641836 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-61a75d87-623b-4990-aeef-5c5019ec4c72 req-ecd29b13-592e-4422-a1a9-a80bbdd8655c tempest-TestShelveInstance-2110534879 None] attachment_update completed successfully. Feb 19 22:01:22.211005 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:01:22.211870 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:01:22.238167 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:01:22.264926 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:02:22.211034 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:02:22.211757 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:02:22.234915 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:02:22.257367 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:02:55.848504 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-087a3573-d144-4f42-8927-4720658701b7 req-9e6b781b-bb37-4516-92e8-8738709f85fb tempest-TestShelveInstance-2110534879 None] Terminate volume connection completed successfully. Feb 19 22:02:55.850504 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.manager [req-087a3573-d144-4f42-8927-4720658701b7 req-9e6b781b-bb37-4516-92e8-8738709f85fb tempest-TestShelveInstance-2110534879 None] Deleting attachment 59586886-a6b4-4202-aa24-927207f479dd. {{(pid=129319) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 19 22:02:55.976497 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-087a3573-d144-4f42-8927-4720658701b7 req-f9981910-333a-42a8-a070-235db6f99425 tempest-TestShelveInstance-2110534879 None] Lock "b'cinder-fa69f814-9e36-4b8f-984f-b625d340f350-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 19 22:02:56.009103 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-087a3573-d144-4f42-8927-4720658701b7 req-f9981910-333a-42a8-a070-235db6f99425 tempest-TestShelveInstance-2110534879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:02:56.106770 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-087a3573-d144-4f42-8927-4720658701b7 req-f9981910-333a-42a8-a070-235db6f99425 tempest-TestShelveInstance-2110534879 None] volume has no backup snaps {{(pid=129319) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 19 22:02:56.115963 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-087a3573-d144-4f42-8927-4720658701b7 req-f9981910-333a-42a8-a070-235db6f99425 tempest-TestShelveInstance-2110534879 None] deleting rbd volume volume-fa69f814-9e36-4b8f-984f-b625d340f350 {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 19 22:02:56.453352 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-087a3573-d144-4f42-8927-4720658701b7 req-f9981910-333a-42a8-a070-235db6f99425 tempest-TestShelveInstance-2110534879 None] volume is a clone so cleaning references {{(pid=129319) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 19 22:02:56.510573 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-087a3573-d144-4f42-8927-4720658701b7 req-f9981910-333a-42a8-a070-235db6f99425 tempest-TestShelveInstance-2110534879 None] deleting parent snapshot volume-fa69f814-9e36-4b8f-984f-b625d340f350.clone_snap {{(pid=129319) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 19 22:02:57.299097 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.quota [req-087a3573-d144-4f42-8927-4720658701b7 req-f9981910-333a-42a8-a070-235db6f99425 tempest-TestShelveInstance-2110534879 None] Created reservations ['536a375d-9aa5-4971-9068-5cb6ec1b0559', '9829c351-fdf7-44a3-b221-2b02ef1ce670', '6f75f5c6-249c-4a06-8de0-8ebc96ac4eee', '24b4117d-3d35-4803-83f4-d2c179498ca5'] {{(pid=129319) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 19 22:02:57.346491 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-087a3573-d144-4f42-8927-4720658701b7 req-f9981910-333a-42a8-a070-235db6f99425 tempest-TestShelveInstance-2110534879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:02:57.373509 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [req-087a3573-d144-4f42-8927-4720658701b7 req-f9981910-333a-42a8-a070-235db6f99425 tempest-TestShelveInstance-2110534879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:02:57.401550 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [req-087a3573-d144-4f42-8927-4720658701b7 req-f9981910-333a-42a8-a070-235db6f99425 tempest-TestShelveInstance-2110534879 None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:02:57.407786 ncdv-master-1 cinder-volume[129319]: INFO cinder.volume.manager [req-087a3573-d144-4f42-8927-4720658701b7 req-f9981910-333a-42a8-a070-235db6f99425 tempest-TestShelveInstance-2110534879 None] Deleted volume successfully. Feb 19 22:02:57.422273 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.coordination [req-087a3573-d144-4f42-8927-4720658701b7 req-f9981910-333a-42a8-a070-235db6f99425 tempest-TestShelveInstance-2110534879 None] Lock "b'cinder-fa69f814-9e36-4b8f-984f-b625d340f350-delete_volume'" released by "delete_volume" :: held 1.446s {{(pid=129319) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 19 22:03:22.212545 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:03:22.213256 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:03:22.249546 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:03:22.285712 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:04:22.212001 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:04:22.212725 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:04:22.233757 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:04:22.257665 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:06:22.214195 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:06:22.214952 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:06:22.236585 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:06:22.260825 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:07:22.216143 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:07:22.216957 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:07:22.240162 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:07:22.270866 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:08:22.217738 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:08:22.218429 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:08:22.240493 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:08:22.262166 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:09:22.218196 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:09:22.219012 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:09:22.242311 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:09:22.269181 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:10:22.214245 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:10:22.215135 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:10:22.243349 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:10:22.271281 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:11:22.217033 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:11:22.218076 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:11:22.240990 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:11:22.262941 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:12:22.219542 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:12:22.220243 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:12:22.244232 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:12:22.273036 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:13:22.218921 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:13:22.219640 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:13:22.243897 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:13:22.268591 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:14:22.223999 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:14:22.224691 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:14:22.246652 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:14:22.268436 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:15:22.223844 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:15:22.224658 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:15:22.246686 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:15:22.272457 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:16:22.229112 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:16:22.229841 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:16:22.252190 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:16:22.275755 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 19 22:17:22.231744 ncdv-master-1 cinder-volume[129319]: DEBUG oslo_service.periodic_task [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129319) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 19 22:17:22.232478 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:17:22.256934 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.volume.drivers.rbd [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129319) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 19 22:17:22.282382 ncdv-master-1 cinder-volume[129319]: DEBUG cinder.manager [None req-3a38c722-d2f1-4472-bfe1-f362effc54a9 None None] Notifying Schedulers of capabilities ... {{(pid=129319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}