-- Logs begin at Sat 2022-01-29 20:01:13 UTC, end at Sat 2022-01-29 22:24:04 UTC. -- Jan 29 20:37:26.821228 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Jan 29 20:37:30.247938 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=134110) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 29 20:37:30.248732 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=134110) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 29 20:37:30.628524 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_db.sqlalchemy.engines [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:37:30.936409 ncdv-master-1 cinder-volume[134110]: INFO cinder.rpc [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jan 29 20:37:30.940943 ncdv-master-1 cinder-volume[134110]: INFO cinder.rpc [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jan 29 20:37:30.950820 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_db.sqlalchemy.engines [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:37:31.019246 ncdv-master-1 cinder-volume[134110]: INFO cinder.volume.manager [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Determined volume DB was empty at startup. Jan 29 20:37:31.020104 ncdv-master-1 cinder-volume[134110]: DEBUG cinder.volume.manager [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=134110) __init__ /opt/stack/cinder/cinder/volume/manager.py:281}} Jan 29 20:37:31.030351 ncdv-master-1 cinder-volume[134110]: INFO cinder.volume.manager [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Service not found for updating active_backend_id, assuming default for driver init. Jan 29 20:37:31.031478 ncdv-master-1 cinder-volume[134110]: WARNING stevedore.named [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:37:31.032083 ncdv-master-1 cinder-volume[134110]: WARNING castellan.key_manager [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:37:31.034536 ncdv-master-1 cinder-volume[134110]: WARNING cinder.keymgr.conf_key_mgr [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:37:31.053545 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_db.sqlalchemy.engines [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:37:31.058662 ncdv-master-1 cinder-volume[134110]: INFO cinder.rpc [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jan 29 20:37:31.063697 ncdv-master-1 cinder-volume[134110]: INFO cinder.rpc [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Automatically selected cinder-volume RPC version 3.16 as minimum service version. Jan 29 20:37:31.064597 ncdv-master-1 cinder-volume[134110]: WARNING stevedore.named [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:37:31.065210 ncdv-master-1 cinder-volume[134110]: WARNING castellan.key_manager [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:37:31.067273 ncdv-master-1 cinder-volume[134110]: INFO cinder.volume.manager [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Image-volume cache enabled for host ncdv-master-1@ceph. Jan 29 20:37:31.073809 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_db.sqlalchemy.engines [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:37:31.095059 ncdv-master-1 cinder-volume[134110]: INFO oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Starting 1 workers Jan 29 20:37:31.101018 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Started child 134283 {{(pid=134110) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jan 29 20:37:31.102516 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Full set of CONF: {{(pid=134110) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Jan 29 20:37:31.103074 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ******************************************************************************** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 29 20:37:31.103545 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] Configuration options gathered from: {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 29 20:37:31.104041 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 29 20:37:31.104800 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 29 20:37:31.105287 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ================================================================================ {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 29 20:37:31.106202 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] allow_availability_zone_fallback = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.106748 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] allow_compression_on_image_upload = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.107428 ncdv-master-1 cinder-volume[134283]: INFO cinder.service [-] Starting cinder-volume node (version 19.1.0) Jan 29 20:37:31.108086 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] allowed_direct_url_schemes = [] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.108806 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] api_rate_limit = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.109454 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] auth_strategy = keystone {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.110045 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] az_cache_duration = 3600 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.110592 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_availability_zone = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.111320 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_host = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.111843 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_name = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.112377 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_stats_polling_interval = 60 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.112937 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backup_api_class = cinder.backup.api.API {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.113524 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.114106 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backup_name_template = backup-%s {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.114637 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backup_use_same_host = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.115157 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backup_use_temp_snapshot = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.115726 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] chap_password = **** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.116237 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] chap_username = {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.116779 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.117362 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cinder_internal_tenant_project_id = 190d9901ea4943389237dfe2aab638ae {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.117881 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cinder_internal_tenant_user_id = b545067a01a24e70a9e19abc1cc76392 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.118735 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cloned_volume_same_az = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.119256 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cluster = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.119829 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] compression_format = gzip {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.120377 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] compute_api_class = cinder.compute.nova.API {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.120945 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] config_dir = [] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.122328 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.123064 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] config_source = [] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.123801 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.124570 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] control_exchange = openstack {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.125253 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] debug = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.125600 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] default_availability_zone = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.126101 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] default_group_type = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.126928 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.127729 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] default_volume_type = ceph {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.128222 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] driver_client_cert = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.129024 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] driver_client_cert_key = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.129536 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] driver_data_namespace = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.130017 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] driver_ssl_cert_path = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.130532 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] driver_ssl_cert_verify = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.131015 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] driver_use_ssl = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.131658 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] enable_force_upload = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.132117 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] enable_new_services = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.132631 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] enable_unsupported_driver = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.133221 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] enabled_backends = ['ceph'] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.133753 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] enforce_multipath_for_image_xfer = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.134229 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] filter_function = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.134708 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] glance_api_insecure = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.135205 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] glance_api_servers = ['http://10.222.0.20/image'] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.135725 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] glance_api_ssl_compression = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.136192 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] glance_ca_certificates_file = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.136700 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] glance_catalog_info = image:glance:publicURL {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.137891 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] glance_certfile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.139682 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.140181 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] glance_keyfile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.140674 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] glance_num_retries = 3 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.141193 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] glance_request_timeout = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.141801 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] goodness_function = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.142379 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] graceful_shutdown_timeout = 5 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.142929 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] group_api_class = cinder.group.api.API {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.143347 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] host = ncdv-master-1 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.143902 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] iet_conf = /etc/iet/ietd.conf {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.144413 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] image_compress_on_upload = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.144955 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] image_conversion_address_space_limit = 1 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.145480 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] image_conversion_cpu_limit = 60 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.145833 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] Starting volume driver RBDDriver (1.2.0) Jan 29 20:37:31.146296 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.146792 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] image_upload_use_cinder_backend = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.147312 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] image_upload_use_internal_tenant = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.147809 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] image_volume_cache_enabled = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.147924 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:37:31.148418 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] image_volume_cache_max_count = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.149289 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] image_volume_cache_max_size_gb = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.149803 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] init_host_max_objects_retrieval = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.150342 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] instance_format = [instance: %(uuid)s] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.150835 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.151394 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] iscsi_iotype = fileio {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.152048 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] iscsi_secondary_ip_addresses = [] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.152546 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] iscsi_target_flags = {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.153127 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] iscsi_write_cache = on {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.153668 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] iser_helper = tgtadm {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.154428 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] iser_ip_address = 10.222.0.20 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.154975 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] iser_port = 3260 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.155525 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.156014 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] log_config_append = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.156601 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.157133 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] log_dir = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.157614 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] log_file = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.158124 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] log_options = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.158697 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] log_rotate_interval = 1 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.159657 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] log_rotate_interval_type = days {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.160269 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] log_rotation_type = none {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.160761 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.161285 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.162011 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.162584 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.163069 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.163697 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] max_age = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.164258 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] max_logfile_count = 30 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.164809 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] max_logfile_size_mb = 200 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.165440 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] max_over_subscription_ratio = 20.0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.166040 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] message_reap_interval = 86400 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.166597 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] message_ttl = 2592000 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.167178 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] migration_create_volume_timeout_secs = 300 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.167777 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] monkey_patch = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.168344 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] monkey_patch_modules = [] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.168891 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] my_ip = 10.222.0.20 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.169775 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] no_snapshot_gb_quota = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.170353 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] num_iser_scan_tries = 3 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.170933 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] num_shell_tries = 3 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.171759 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] num_volume_device_scan_tries = 3 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.172461 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] nvmet_ns_id = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.173047 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] nvmet_port_id = 1 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.173658 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] osapi_max_limit = 1000 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.174210 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] osapi_volume_ext_list = [] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.174830 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.175398 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.175963 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] osapi_volume_listen_port = 8776 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.176528 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] osapi_volume_use_ssl = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.177147 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] osapi_volume_workers = 2 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.177691 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] per_volume_size_limit = -1 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.178235 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] periodic_fuzzy_delay = 60 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.178882 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] periodic_interval = 60 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.179603 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] public_endpoint = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.180324 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] publish_errors = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.180886 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] quota_backup_gigabytes = 1000 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.181501 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] quota_backups = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.182040 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] quota_consistencygroups = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.182720 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.183285 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] quota_gigabytes = 1000 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.183827 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] quota_groups = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.184910 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] quota_snapshots = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.185610 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] quota_volumes = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.186193 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] rate_limit_burst = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.186759 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] rate_limit_except_level = CRITICAL {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.187307 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] rate_limit_interval = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.187861 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] reinit_driver_count = 3 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.188449 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] replication_device = **** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.189025 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] report_discard_supported = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.189726 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] report_interval = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.190533 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] reservation_clean_interval = 86400 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.191020 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] reservation_expire = 86400 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.192139 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] reserved_percentage = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.192828 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.194046 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.194645 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] rpc_response_timeout = 120 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.195169 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] run_external_periodic_tasks = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.195704 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.196281 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] scst_target_driver = iscsi {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.196634 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] scst_target_iqn_name = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.196919 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] service_down_time = 60 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.197060 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:37:31.198388 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] snapshot_name_template = snapshot-%s {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.198906 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] snapshot_same_host = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.199423 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] split_loggers = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.200055 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] state_path = /opt/stack/data/cinder {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.200550 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] storage_availability_zone = nova {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.200905 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] storage_protocol = iscsi {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.201473 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] syslog_log_facility = LOG_USER {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.201832 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] target_helper = lioadm {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.202279 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] target_ip_address = 10.222.0.20 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.202661 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] target_port = 3260 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.203012 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.203360 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] target_protocol = iscsi {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.203701 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] trace_flags = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.204068 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.204418 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] transport_url = **** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.204758 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] until_refresh = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.205130 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] use_chap_auth = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.205624 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] use_default_quota_class = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.206098 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] use_eventlog = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.206581 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] use_journal = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.208043 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] use_json = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.209526 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] use_multipath_for_image_xfer = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.210154 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] use_stderr = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.210689 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] use_syslog = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.211093 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] verify_glance_signatures = enabled {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.211442 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] volume_api_class = cinder.volume.api.API {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.211791 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] volume_backend_name = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.212166 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] volume_clear = zero {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.212495 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] volume_clear_ionice = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.213023 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] volume_clear_size = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.213528 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.214029 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] volume_copy_bps_limit = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.214386 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] volume_dd_blocksize = 1M {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.214744 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.215092 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] volume_name_template = volume-%s {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.215953 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] volume_service_inithost_offload = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.216304 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] volume_usage_audit_period = month {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.217437 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.218025 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] watch_log_file = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.218607 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] zoning_mode = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 29 20:37:31.219403 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.219830 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.220232 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_policy.enforce_new_defaults = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.221772 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_policy.enforce_scope = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.223120 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_policy.policy_default_rule = default {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.224153 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.224956 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_policy.policy_file = policy.yaml {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.225433 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.227230 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.227230 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.227439 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.227795 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.228192 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_concurrency.disable_process_locking = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.228566 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.229659 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.admin_password = **** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.229659 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.230877 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.admin_token = **** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.231257 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:37:31.231463 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.admin_user = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.231853 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.232214 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.232583 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.auth_port = 35357 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.234274 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.auth_protocol = https {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.234926 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.auth_section = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.235496 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.auth_type = password {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.235872 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.auth_uri = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.236215 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.auth_version = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.236554 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.cache = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.236911 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.237425 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.certfile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.237920 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.238450 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.238823 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.239184 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.239525 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.identity_uri = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.239866 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.include_service_catalog = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.240211 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.insecure = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.240598 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.interface = public {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.240956 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.keyfile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.241500 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.241860 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.242200 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.242543 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.242882 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.243225 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.243604 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.243947 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.244400 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.244673 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.region_name = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.245219 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.245809 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.246355 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.service_type = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.247451 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.248013 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.248528 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.backend = dogpile.cache.null {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.249099 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.backend_argument = **** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.249266 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.config_prefix = cache.oslo {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.249790 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.debug_cache_backend = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.250132 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.enabled = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.250491 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.expiration_time = 600 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.250833 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.memcache_dead_retry = 300 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.252016 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.252518 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.253060 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.memcache_pool_maxsize = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.253566 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.254129 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.254556 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.memcache_socket_timeout = 1.0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.254906 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.proxies = [] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.255263 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.tls_allowed_ciphers = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.255603 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.tls_cafile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.256100 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.tls_certfile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.256452 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.tls_enabled = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.256789 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cache.tls_keyfile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.257203 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] coordination.backend_url = etcd3+http://10.222.0.20:2379 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.257647 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.backend = sqlalchemy {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.258806 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.connection = **** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.258806 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.connection_debug = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.258806 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.connection_parameters = {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.259032 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.connection_recycle_time = 3600 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.259335 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.connection_trace = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.259672 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.db_inc_retry_interval = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.260009 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.db_max_retries = 20 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.260343 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.db_max_retry_interval = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.260684 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.db_retry_interval = 1 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.261280 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.max_overflow = 50 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.261631 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.max_pool_size = 5 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.263584 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.max_retries = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.266095 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.mysql_enable_ndb = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.266479 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.267681 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.pool_timeout = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.268713 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.retry_interval = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.268713 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.slave_connection = **** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.269131 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.sqlite_synchronous = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.269902 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] database.use_db_reconnect = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.271049 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.271629 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.272866 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.273334 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.273759 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.274029 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.driver [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] Driver hasn't implemented _init_vendor_properties() Jan 29 20:37:31.274289 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] profiler.connection_string = messaging:// {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.274597 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.driver [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:39de64bc-eb6d-4b6f-a981-9da4a74249ad:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134283) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:820}} Jan 29 20:37:31.274721 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] profiler.enabled = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.275074 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] profiler.es_doc_type = notification {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.275487 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] profiler.es_scroll_size = 10000 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.275925 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] profiler.es_scroll_time = 2m {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.276332 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] profiler.filter_error_trace = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.277470 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] profiler.hmac_keys = SECRET_KEY {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.277470 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] profiler.sentinel_service_name = mymaster {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.277638 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] profiler.socket_timeout = 0.1 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.277950 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] profiler.trace_sqlalchemy = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.278415 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] privsep_osbrick.capabilities = [21] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.278848 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] privsep_osbrick.group = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.279273 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] privsep_osbrick.helper_command = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.279720 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.280129 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.280537 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] privsep_osbrick.user = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.281515 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.281515 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cinder_sys_admin.group = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.281720 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cinder_sys_admin.helper_command = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.282199 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.282601 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.282999 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] cinder_sys_admin.user = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.283440 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] service_user.auth_section = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.283837 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] service_user.auth_type = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.284405 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] service_user.cafile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.284971 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] service_user.certfile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.285614 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] service_user.collect_timing = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.285733 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] service_user.insecure = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.286130 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] service_user.keyfile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.286617 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] service_user.send_service_user_token = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.287128 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] service_user.split_loggers = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.287463 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] service_user.timeout = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.287867 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.backend_availability_zone = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.288213 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.288550 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.288907 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.chap_password = **** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.289287 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.chap_username = {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.289763 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:37:31.290100 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.290625 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.291121 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.291640 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.driver_client_cert = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.292137 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.driver_client_cert_key = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.292476 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.driver_data_namespace = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.292818 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.293228 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.294101 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.driver_use_ssl = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.294444 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.enable_deferred_deletion = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.294786 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.295172 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.295525 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.extra_capabilities = {} {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.295858 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.filter_function = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.296189 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.goodness_function = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.296791 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.297171 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.297505 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.298348 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.298348 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.298798 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.299163 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.iscsi_iotype = fileio {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.299527 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.299887 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.iscsi_target_flags = {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.300529 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.iscsi_write_cache = on {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.300647 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.iser_helper = tgtadm {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.301160 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.iser_ip_address = 10.222.0.20 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.301510 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.iser_port = 3260 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.301864 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.302223 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.302572 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.302918 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.num_shell_tries = 3 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.303277 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.303628 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.303967 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.304824 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.304824 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.rados_connection_interval = 5 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.305188 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.rados_connection_retries = 3 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.305394 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.rbd_ceph_conf = {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.305750 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.306097 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.306451 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.306796 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.307149 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.rbd_pool = rbd {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.307488 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.rbd_secret_uuid = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.307828 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.308485 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.rbd_user = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.308838 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.309781 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.replication_device = **** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.310127 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.report_discard_supported = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.310465 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.310803 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.reserved_percentage = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.311157 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.311500 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.311851 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.storage_protocol = iscsi {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.312189 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.312543 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.target_helper = tgtadm {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.313906 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.target_ip_address = 10.222.0.20 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.313906 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.target_port = 3260 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.313906 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.314143 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.target_protocol = iscsi {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.314384 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.trace_flags = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.314720 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.unique_fqdn_network = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.315054 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.use_chap_auth = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.315389 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.315722 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.volume_backend_name = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.316077 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.volume_clear = zero {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.316421 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.volume_clear_ionice = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.316751 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.volume_clear_size = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.317671 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.317671 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.317943 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.318264 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.319312 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.319312 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_reports.file_event_handler = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.319483 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.319787 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_reports.log_dir = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.320164 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.backend_availability_zone = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.320497 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.backend_host = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.320836 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.backend_native_threads_pool_size = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.321189 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.backup_use_temp_snapshot = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.321687 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.chap_password = **** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.322153 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.chap_username = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.322645 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.chiscsi_conf = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.322985 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.deferred_deletion_delay = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.323319 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.deferred_deletion_purge_interval = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.323653 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.driver_client_cert = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.323981 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.driver_client_cert_key = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.324340 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.driver_data_namespace = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.324746 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.driver_ssl_cert_path = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.326006 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.driver_ssl_cert_verify = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.326006 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.driver_use_ssl = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.326006 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.enable_deferred_deletion = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.326280 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.enable_unsupported_driver = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.326393 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.326923 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.extra_capabilities = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.327276 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.filter_function = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.327609 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.goodness_function = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.327940 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.iet_conf = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.328771 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.image_upload_use_cinder_backend = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.328771 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.image_upload_use_internal_tenant = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.328939 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.image_volume_cache_enabled = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.329295 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.image_volume_cache_max_count = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.329628 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.329958 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.iscsi_iotype = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.330294 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.330626 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.iscsi_target_flags = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.331112 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.iscsi_write_cache = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.331278 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.iser_helper = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.332286 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.iser_ip_address = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.332286 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.iser_port = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.332286 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.iser_target_prefix = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.332608 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.max_over_subscription_ratio = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.332913 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.num_iser_scan_tries = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.333275 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.num_shell_tries = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.333610 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.num_volume_device_scan_tries = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.333939 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.nvmet_ns_id = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.334269 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.nvmet_port_id = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.334621 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.rados_connect_timeout = -1 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.334964 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.rados_connection_interval = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.335291 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.rados_connection_retries = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.335636 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.335793 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.db.sqlalchemy.api [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] Building query based on filter {{(pid=134283) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3156}} Jan 29 20:37:31.335969 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.rbd_cluster_name = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.336298 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.336670 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.337039 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.rbd_max_clone_depth = 5 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.337390 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.rbd_pool = volumes {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.337731 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.rbd_secret_uuid = 06567dee-8a50-4d7b-8f19-020a28eac1ad {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.338087 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.rbd_store_chunk_size = 4 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.338435 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.rbd_user = cinder {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.338772 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.replication_connect_timeout = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.339105 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.replication_device = **** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.339435 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.report_discard_supported = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.339766 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.report_dynamic_total_capacity = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.341770 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.reserved_percentage = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.341770 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.scst_target_driver = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.341770 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.scst_target_iqn_name = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.341770 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.storage_protocol = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.341770 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.341770 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.target_helper = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.342607 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.target_ip_address = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.342607 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.target_port = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.342876 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.target_prefix = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.343118 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.target_protocol = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.343381 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.trace_flags = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.344116 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.unique_fqdn_network = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.344116 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.use_chap_auth = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.344431 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.use_multipath_for_image_xfer = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.344688 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.volume_backend_name = ceph {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.345050 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.volume_clear = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.345372 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.volume_clear_ionice = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.345713 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.volume_clear_size = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.346043 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.346601 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.volume_copy_bps_limit = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.346773 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.volume_dd_blocksize = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.347177 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.347445 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ceph.volumes_dir = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.347817 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.348171 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.348529 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.348864 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.349408 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.349895 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.350394 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.350904 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.351255 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.351599 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.352002 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.352342 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.352862 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.353381 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.353871 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.354397 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.354735 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.355161 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.355509 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.355760 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.356625 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.357943 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.ssl = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.357943 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.358279 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.image_utils [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=134283) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Jan 29 20:37:31.358522 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.358522 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.358522 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.358925 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_notifications.driver = [] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.359492 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_notifications.retry = -1 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.359492 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.359814 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.360163 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.360372 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] key_manager.fixed_key = **** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.360753 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.362459 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.barbican_api_version = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.362459 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.barbican_endpoint = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.362459 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.barbican_endpoint_type = public {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.362459 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.barbican_region_name = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.362459 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.cafile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.363222 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.certfile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.363222 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.collect_timing = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.363536 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.insecure = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.363758 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.keyfile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.364544 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.number_of_retries = 60 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.364714 ncdv-master-1 cinder-volume[134283]: INFO cinder.keymgr.migration [None req-607eaf3c-a8c7-4c80-9198-ab16fb7bc2dd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jan 29 20:37:31.364856 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.retry_delay = 1 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.364856 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.send_service_user_token = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.365208 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.split_loggers = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.365574 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.timeout = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.365742 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.verify_ssl = True {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.366025 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican.verify_ssl_path = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.366371 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican_service_user.auth_section = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.366705 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican_service_user.auth_type = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.367031 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican_service_user.cafile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.367706 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican_service_user.certfile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.367706 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican_service_user.collect_timing = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.367988 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican_service_user.insecure = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.368311 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican_service_user.keyfile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.368642 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican_service_user.split_loggers = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.369002 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] barbican_service_user.timeout = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.369345 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.approle_role_id = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.369668 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.approle_secret_id = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.370000 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.cafile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.370334 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.certfile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.370671 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.collect_timing = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.371013 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.insecure = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.371325 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.keyfile = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.371918 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.kv_mountpoint = secret {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.372258 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.kv_version = 2 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.372441 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:37:31.372625 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.namespace = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.372907 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.root_token_id = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.373278 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.split_loggers = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.373608 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.ssl_ca_crt_file = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.373968 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.timeout = None {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.374273 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.use_ssl = False {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.374625 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 29 20:37:31.374911 ncdv-master-1 cinder-volume[134110]: DEBUG oslo_service.service [None req-5172f7f9-2386-4f20-a61e-217aa094f2a3 None None] ******************************************************************************** {{(pid=134110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 29 20:37:31.400687 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:37:31.435255 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:37:31.462126 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] Driver initialization completed successfully. Jan 29 20:37:31.472863 ncdv-master-1 cinder-volume[134283]: INFO cinder.manager [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] Initiating service 3 cleanup Jan 29 20:37:31.479606 ncdv-master-1 cinder-volume[134283]: INFO cinder.manager [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] Service 3 cleanup completed. Jan 29 20:37:31.479929 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.service [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] Creating RPC server for service cinder-volume {{(pid=134283) start /opt/stack/cinder/cinder/service.py:231}} Jan 29 20:37:31.486004 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.service [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=134283) start /opt/stack/cinder/cinder/service.py:237}} Jan 29 20:37:31.538950 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Jan 29 20:37:31.540389 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:37:31.567969 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:37:31.620287 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-8802527d-6162-40cb-9f6a-9e6fb25e1fda None None] Driver post RPC initialization completed successfully. Jan 29 20:39:28.623191 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:39:28.623969 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:39:28.646636 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:39:28.669230 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:40:28.625032 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:40:28.625683 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:40:28.648269 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:40:28.670969 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:41:28.625806 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:41:28.626423 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:41:28.646678 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:41:28.668580 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:42:28.623509 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:42:28.624152 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:42:28.644350 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:42:28.667000 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:43:28.622986 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:43:28.623762 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:43:28.645075 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:43:28.666469 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:44:28.621294 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:44:28.621951 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:44:28.643895 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:44:28.666274 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:45:28.621948 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:45:28.623950 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:45:28.651715 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:45:28.675113 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:46:28.619949 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:46:28.620764 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:46:28.687998 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:46:28.760323 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:47:28.624841 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:47:28.625734 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:47:28.647942 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:47:28.671269 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:48:27.094165 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:48:27.115098 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:48:27.122378 ncdv-master-1 cinder-volume[134283]: INFO cinder.rpc [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Jan 29 20:48:27.127886 ncdv-master-1 cinder-volume[134283]: INFO cinder.rpc [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Automatically selected cinder-backup RPC version 2.2 as minimum service version. Jan 29 20:48:27.129961 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:48:27.130604 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:48:27.184036 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Flow 'volume_create_manager' (6ff5e4ad-023d-4599-be64-3ea563566ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:48:27.192123 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680b780e-2261-419e-b6a8-94fe9b72959c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:48:27.215102 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:48:27.274929 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680b780e-2261-419e-b6a8-94fe9b72959c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1082819964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f30ed55-0acd-4ecb-ab85-59809b7d14bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27ae2dd26ab24bf3acb67351b313e4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:48:27Z,use_quota=True,user_id='ab5606b982cb4732967b829984de2d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:48:27.279919 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aada28f-f641-4912-ae40-f4c108b40b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:48:27.283711 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aada28f-f641-4912-ae40-f4c108b40b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:48:27.289359 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0c3ab5-e0f7-4b47-a572-9b5e0772e2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:48:27.293574 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0c3ab5-e0f7-4b47-a572-9b5e0772e2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f30ed55-0acd-4ecb-ab85-59809b7d14bd', 'volume_name': 'volume-2f30ed55-0acd-4ecb-ab85-59809b7d14bd', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:48:27.298770 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e054371-fefa-4ad7-ac59-b9812a5615ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:48:27.302724 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e054371-fefa-4ad7-ac59-b9812a5615ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:48:27.306940 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1ea509-a14c-4f12-8d85-e48b498198b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:48:27.307974 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Volume 2f30ed55-0acd-4ecb-ab85-59809b7d14bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f30ed55-0acd-4ecb-ab85-59809b7d14bd', 'volume_size': 1} Jan 29 20:48:27.308397 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] creating volume 'volume-2f30ed55-0acd-4ecb-ab85-59809b7d14bd' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:48:27.309414 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:48:27.472007 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:48:27.472505 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:48:27.477644 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1ea509-a14c-4f12-8d85-e48b498198b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f30ed55-0acd-4ecb-ab85-59809b7d14bd', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:48:27.482476 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c66b4e-5834-435a-b2fd-6343c851ca5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:48:27.495481 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Volume volume-2f30ed55-0acd-4ecb-ab85-59809b7d14bd (2f30ed55-0acd-4ecb-ab85-59809b7d14bd): created successfully Jan 29 20:48:27.503640 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c66b4e-5834-435a-b2fd-6343c851ca5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:48:27.514843 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Flow 'volume_create_manager' (6ff5e4ad-023d-4599-be64-3ea563566ae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:48:27.529109 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d820364e-286b-47f4-9bb4-4c69f673c56f tempest-LiveMigrationTest-1795257779 None] Created volume successfully. Jan 29 20:48:28.626573 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:48:28.628037 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:48:28.693886 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:48:28.754166 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:48:29.425739 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-f4f717fa-27d9-4751-8c2d-8b646b9e8ae8 req-6be7de1c-5308-49b0-8b2a-d265b77096ca tempest-LiveMigrationTest-1795257779 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:48:30.822783 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-f4f717fa-27d9-4751-8c2d-8b646b9e8ae8 req-6be7de1c-5308-49b0-8b2a-d265b77096ca tempest-LiveMigrationTest-1795257779 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.396s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:48:30.824048 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-f4f717fa-27d9-4751-8c2d-8b646b9e8ae8 req-6be7de1c-5308-49b0-8b2a-d265b77096ca tempest-LiveMigrationTest-1795257779 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2f30ed55-0acd-4ecb-ab85-59809b7d14bd', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '2f30ed55-0acd-4ecb-ab85-59809b7d14bd', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:48:30.887831 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-f4f717fa-27d9-4751-8c2d-8b646b9e8ae8 req-6be7de1c-5308-49b0-8b2a-d265b77096ca tempest-LiveMigrationTest-1795257779 None] Connection info returned from driver {'name': 'volumes/volume-2f30ed55-0acd-4ecb-ab85-59809b7d14bd', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2f30ed55-0acd-4ecb-ab85-59809b7d14bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2f410d3b-1e4f-42fc-b809-4a305e6936bd'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:48:31.062226 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-f4f717fa-27d9-4751-8c2d-8b646b9e8ae8 req-6be7de1c-5308-49b0-8b2a-d265b77096ca tempest-LiveMigrationTest-1795257779 None] attachment_update completed successfully. Jan 29 20:48:38.350940 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-c2c27733-1ed1-48bf-b6e9-d22be3a51305 req-53569442-c663-4773-9006-d4549ae9d040 tempest-LiveMigrationTest-825023025 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:48:39.367492 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-c2c27733-1ed1-48bf-b6e9-d22be3a51305 req-53569442-c663-4773-9006-d4549ae9d040 tempest-LiveMigrationTest-825023025 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.017s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:48:39.369098 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-c2c27733-1ed1-48bf-b6e9-d22be3a51305 req-53569442-c663-4773-9006-d4549ae9d040 tempest-LiveMigrationTest-825023025 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2f30ed55-0acd-4ecb-ab85-59809b7d14bd', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '2f30ed55-0acd-4ecb-ab85-59809b7d14bd', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:48:39.407448 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-c2c27733-1ed1-48bf-b6e9-d22be3a51305 req-53569442-c663-4773-9006-d4549ae9d040 tempest-LiveMigrationTest-825023025 None] Connection info returned from driver {'name': 'volumes/volume-2f30ed55-0acd-4ecb-ab85-59809b7d14bd', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2f30ed55-0acd-4ecb-ab85-59809b7d14bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c33d32b3-718e-4f1f-9358-dfffeb6c86d1'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:48:39.556402 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-c2c27733-1ed1-48bf-b6e9-d22be3a51305 req-53569442-c663-4773-9006-d4549ae9d040 tempest-LiveMigrationTest-825023025 None] attachment_update completed successfully. Jan 29 20:48:54.692692 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-c2c27733-1ed1-48bf-b6e9-d22be3a51305 req-63f02795-6082-4b17-a76f-493be6c1973f tempest-LiveMigrationTest-825023025 None] Terminate volume connection completed successfully. Jan 29 20:48:54.693978 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-c2c27733-1ed1-48bf-b6e9-d22be3a51305 req-63f02795-6082-4b17-a76f-493be6c1973f tempest-LiveMigrationTest-825023025 None] Deleting attachment 2f410d3b-1e4f-42fc-b809-4a305e6936bd. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:49:08.377335 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-6c180c84-1cc8-4e03-9730-d87cfdabd157 req-2ecd9e25-9c9e-44a7-83fc-070354530b1c tempest-LiveMigrationTest-1795257779 None] Terminate volume connection completed successfully. Jan 29 20:49:08.377931 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c180c84-1cc8-4e03-9730-d87cfdabd157 req-2ecd9e25-9c9e-44a7-83fc-070354530b1c tempest-LiveMigrationTest-1795257779 None] Deleting attachment c33d32b3-718e-4f1f-9358-dfffeb6c86d1. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:49:10.775738 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:49:10.780204 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:49:10.780937 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:49:10.803893 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Flow 'volume_create_manager' (67a5db69-1f26-442a-b280-6d1481fa979d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:49:10.813234 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cdda084-108a-48a2-b411-157bce7ee1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:49:10.820515 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:49:10.844542 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cdda084-108a-48a2-b411-157bce7ee1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1189139705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3751bb46-9a8b-4302-9c63-b2bed6fccd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27ae2dd26ab24bf3acb67351b313e4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:49:11Z,use_quota=True,user_id='ab5606b982cb4732967b829984de2d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:49:10.852927 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c76720e-5852-4e8d-b9e6-0f8d9965c398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:49:10.858514 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c76720e-5852-4e8d-b9e6-0f8d9965c398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:49:10.864293 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42985b4-fabd-4e9e-9d17-5071409fd69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:49:10.996533 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42985b4-fabd-4e9e-9d17-5071409fd69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3751bb46-9a8b-4302-9c63-b2bed6fccd8d', 'volume_name': 'volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:49:11.019904 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65ac3be-037a-43c3-b32b-937a6528db8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:49:11.027336 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65ac3be-037a-43c3-b32b-937a6528db8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:49:11.041041 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (358dc080-da23-44fc-8c6a-3aee10b34074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:49:11.043671 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Volume 3751bb46-9a8b-4302-9c63-b2bed6fccd8d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 20:49:11.044506 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Cloning 3751bb46-9a8b-4302-9c63-b2bed6fccd8d from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 20:49:11.056504 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:49:11.071869 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Preparing cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Jan 29 20:49:11.073728 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 20:49:27.664189 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.image_utils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph, size 616.00 MB, duration 16.58 sec {{(pid=134283) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Jan 29 20:49:27.664924 ncdv-master-1 cinder-volume[134283]: INFO cinder.image.image_utils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Image download 616.00 MB at 37.15 MB/s Jan 29 20:49:27.710118 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:49:27.868726 ncdv-master-1 sudo[144894]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph Jan 29 20:49:27.871377 ncdv-master-1 sudo[144894]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 29 20:49:28.631708 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:49:28.634333 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:49:28.682015 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:49:28.716811 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:49:29.164312 ncdv-master-1 sudo[144894]: pam_unix(sudo:session): session closed for user root Jan 29 20:49:29.166190 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph" returned: 0 in 1.456s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:49:29.173681 ncdv-master-1 cinder-volume[134283]: WARNING py.warnings [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jan 29 20:49:29.173681 ncdv-master-1 cinder-volume[134283]: debtcollector.deprecate( Jan 29 20:49:29.173681 ncdv-master-1 cinder-volume[134283]: Jan 29 20:49:29.174393 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.image_utils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Temporary image 2d84033c-0eee-4684-85d5-5f7610b2b616 is fetched for user ab5606b982cb4732967b829984de2d4e. {{(pid=134283) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Jan 29 20:49:29.262572 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:49:29.352305 ncdv-master-1 sudo[144934]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph Jan 29 20:49:29.353117 ncdv-master-1 sudo[144934]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 29 20:49:30.363802 ncdv-master-1 sudo[144934]: pam_unix(sudo:session): session closed for user root Jan 29 20:49:30.366543 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph" returned: 0 in 1.104s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:49:30.367528 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] creating volume 'volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:49:30.369374 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:49:30.427376 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:49:30.427758 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:49:30.449114 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Attempting download of 2d84033c-0eee-4684-85d5-5f7610b2b616 ((None, None)) to volume 3751bb46-9a8b-4302-9c63-b2bed6fccd8d. {{(pid=134283) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1228}} Jan 29 20:49:30.501070 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_2d84033c-0eee-4684-85d5-5f7610b2b616_8bf8d7a8 {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:49:30.600110 ncdv-master-1 sudo[144955]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_2d84033c-0eee-4684-85d5-5f7610b2b616_8bf8d7a8 Jan 29 20:49:30.600902 ncdv-master-1 sudo[144955]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 29 20:49:31.616423 ncdv-master-1 sudo[144955]: pam_unix(sudo:session): session closed for user root Jan 29 20:49:31.618583 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_2d84033c-0eee-4684-85d5-5f7610b2b616_8bf8d7a8" returned: 0 in 1.117s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:49:31.620106 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:49:31.715817 ncdv-master-1 sudo[144962]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph Jan 29 20:49:31.716842 ncdv-master-1 sudo[144962]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 29 20:49:32.809492 ncdv-master-1 sudo[144962]: pam_unix(sudo:session): session closed for user root Jan 29 20:49:32.812128 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph" returned: 0 in 1.191s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:49:32.813697 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.image_utils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] 2d84033c-0eee-4684-85d5-5f7610b2b616 was vhdx, converting to raw {{(pid=134283) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Jan 29 20:49:32.814313 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpru1krljh {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:49:32.842870 ncdv-master-1 sudo[144973]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpru1krljh Jan 29 20:49:32.844302 ncdv-master-1 sudo[144973]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 29 20:49:35.551109 ncdv-master-1 sudo[144973]: pam_unix(sudo:session): session closed for user root Jan 29 20:49:35.554231 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpru1krljh" returned: 0 in 2.740s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:49:35.556640 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:49:35.687148 ncdv-master-1 sudo[144995]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph Jan 29 20:49:35.688621 ncdv-master-1 sudo[144995]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 29 20:49:37.144635 ncdv-master-1 sudo[144995]: pam_unix(sudo:session): session closed for user root Jan 29 20:49:37.146925 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph" returned: 0 in 1.591s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:49:37.147660 ncdv-master-1 cinder-volume[134283]: WARNING py.warnings [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jan 29 20:49:37.147660 ncdv-master-1 cinder-volume[134283]: debtcollector.deprecate( Jan 29 20:49:37.147660 ncdv-master-1 cinder-volume[134283]: Jan 29 20:49:37.148637 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.image_utils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d84033c-0eee-4684-85d5-5f7610b2b616_6puvwq8xncdv-master-1@ceph, size 700.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/conversion/tmpru1krljh {{(pid=134283) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Jan 29 20:49:37.149207 ncdv-master-1 cinder-volume[134283]: INFO cinder.image.image_utils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Converted 700.00 MB image at 255.32 MB/s Jan 29 20:49:37.150744 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:49:37.300693 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:49:37.310372 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:49:37.344333 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] deleting rbd volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:49:37.596367 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpru1krljh volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:49:41.310760 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpru1krljh volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 3.714s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:49:41.435255 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:49:41.545456 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:49:41.546818 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:49:41.547493 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Downloaded image 2d84033c-0eee-4684-85d5-5f7610b2b616 ((None, None)) to volume 3751bb46-9a8b-4302-9c63-b2bed6fccd8d successfully. {{(pid=134283) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1268}} Jan 29 20:49:41.621275 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.image_utils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Temporary image 2d84033c-0eee-4684-85d5-5f7610b2b616 for user ab5606b982cb4732967b829984de2d4e is deleted. {{(pid=134283) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Jan 29 20:49:41.680566 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Jan 29 20:49:41.682067 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Jan 29 20:49:41.802852 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Created reservations ['4c65b280-509a-466a-a482-6e92cb86b098', '687b7916-7bd9-481f-a696-99a7e2a059d0', 'c676c640-22a2-4a8f-b0f4-f3ba31d734d1', 'b0a40d56-447d-4e43-99a7-dd75a55d10fb'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:49:41.816689 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Creating image volume entry: {'bootable': False, 'volume_metadata': [], 'availability_zone': 'nova', 'shared_targets': True, 'display_description': None, 'updated_at': datetime.datetime(2022, 1, 29, 20, 49, 11, tzinfo=datetime.timezone.utc), 'previous_status': None, 'ec2_id': None, 'encryption_key_id': None, 'metadata': {}, 'deleted_at': None, 'project_id': '190d9901ea4943389237dfe2aab638ae', 'terminated_at': None, 'user_id': 'ab5606b982cb4732967b829984de2d4e', 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'provider_auth': None, 'host': 'ncdv-master-1@ceph#ceph', 'provider_location': None, 'created_at': datetime.datetime(2022, 1, 29, 20, 49, 11, tzinfo=datetime.timezone.utc), 'volume_admin_metadata': [], 'display_name': 'image-2d84033c-0eee-4684-85d5-5f7610b2b616', 'scheduled_at': datetime.datetime(2022, 1, 29, 20, 49, 11, tzinfo=datetime.timezone.utc), 'size': 1, 'cluster_name': None, 'provider_geometry': None, 'launched_at': None, 'replication_extended_status': None, 'group_id': None, 'deleted': False, 'multiattach': False, 'volume_type_id': '2b4c3582-289d-40dd-a858-34e3868bf0dc', 'consistencygroup_id': None, 'replication_driver_data': None, 'replication_status': None, 'provider_id': None, 'service_uuid': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '3751bb46-9a8b-4302-9c63-b2bed6fccd8d'}. {{(pid=134283) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1615}} Jan 29 20:49:41.914243 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Volume reschedule parameters: False retry: None {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:49:41.920712 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:49:41.921606 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:49:41.979958 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Flow 'volume_create_manager' (4b49a2ff-fe7c-4e57-a98e-4e110ad4bb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:49:41.998091 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c81e1e0-934b-45ca-90c5-bb40689a55b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:49:42.012001 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:49:42.040397 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c81e1e0-934b-45ca-90c5-bb40689a55b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='image-2d84033c-0eee-4684-85d5-5f7610b2b616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0404edc2-cca2-48a4-afe8-a1f41b283dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190d9901ea4943389237dfe2aab638ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3751bb46-9a8b-4302-9c63-b2bed6fccd8d,status='creating',terminated_at=None,updated_at=2022-01-29T20:49:11Z,use_quota=True,user_id='ab5606b982cb4732967b829984de2d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:49:42.050565 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7592d5c6-13d1-4c49-baf4-df418c10664b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:49:42.054828 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7592d5c6-13d1-4c49-baf4-df418c10664b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:49:42.062040 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfef27c-d03d-433f-a0a5-4f070e0c5fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:49:42.079117 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfef27c-d03d-433f-a0a5-4f070e0c5fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'volume_name': 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'volume_size': 1, 'source_volid': '3751bb46-9a8b-4302-9c63-b2bed6fccd8d', 'source_volstatus': 'downloading'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:49:42.084682 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12039ffb-15ba-49ae-ac9e-4a6fe97e2328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:49:42.090917 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12039ffb-15ba-49ae-ac9e-4a6fe97e2328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:49:42.096295 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb1e232-d30d-437c-b9ba-88209d383f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:49:42.097592 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'volume_size': 1, 'source_volid': '3751bb46-9a8b-4302-9c63-b2bed6fccd8d', 'source_volstatus': 'downloading'} Jan 29 20:49:42.113565 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:49:42.190523 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] creating snapshot='volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 20:49:42.656019 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] cloning 'volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d@volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe.clone_snap' to 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 20:49:42.759428 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:49:42.760817 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:49:42.761403 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:49:42.780665 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 20:49:42.787345 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb1e232-d30d-437c-b9ba-88209d383f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'volume_size': 1, 'source_volid': '3751bb46-9a8b-4302-9c63-b2bed6fccd8d', 'source_volstatus': 'downloading'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:49:42.795729 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41822703-0dd7-486b-82f7-259be9f7745d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:49:42.807126 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Volume volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe (0404edc2-cca2-48a4-afe8-a1f41b283dbe): created successfully Jan 29 20:49:42.813199 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41822703-0dd7-486b-82f7-259be9f7745d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:49:42.820231 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Flow 'volume_create_manager' (4b49a2ff-fe7c-4e57-a98e-4e110ad4bb53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:49:42.832131 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Created volume successfully. Jan 29 20:49:42.876551 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Creating new image-volume cache entry for image 2d84033c-0eee-4684-85d5-5f7610b2b616 on ncdv-master-1@ceph#ceph {{(pid=134283) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Jan 29 20:49:42.885019 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] New image-volume cache entry created: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 20, 49, 42, 879833)}. {{(pid=134283) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Jan 29 20:49:42.892383 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 31.836s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:49:42.892903 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Marking volume 3751bb46-9a8b-4302-9c63-b2bed6fccd8d as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 20:49:42.901955 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to 3751bb46-9a8b-4302-9c63-b2bed6fccd8d. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 20:49:42.902460 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Creating volume glance metadata for volume 3751bb46-9a8b-4302-9c63-b2bed6fccd8d backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 20:49:42.977359 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (358dc080-da23-44fc-8c6a-3aee10b34074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:49:42.983284 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8dcdec-ae04-4013-bc84-c76f84280831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:49:42.993925 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d (3751bb46-9a8b-4302-9c63-b2bed6fccd8d): created successfully Jan 29 20:49:42.998219 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8dcdec-ae04-4013-bc84-c76f84280831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:49:43.005218 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Flow 'volume_create_manager' (67a5db69-1f26-442a-b280-6d1481fa979d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:49:43.014485 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-bb362a0d-7d74-4e21-b76e-405dd46bda98 tempest-LiveMigrationTest-1795257779 None] Created volume successfully. Jan 29 20:49:46.762645 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-9a2efc13-1ce2-4bf4-8672-a1ea6d8a4a87 req-7b5e26f7-f084-4802-b006-873588e6d04f tempest-LiveMigrationTest-1795257779 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:49:47.511570 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-9a2efc13-1ce2-4bf4-8672-a1ea6d8a4a87 req-7b5e26f7-f084-4802-b006-873588e6d04f tempest-LiveMigrationTest-1795257779 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.749s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:49:47.512389 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-9a2efc13-1ce2-4bf4-8672-a1ea6d8a4a87 req-7b5e26f7-f084-4802-b006-873588e6d04f tempest-LiveMigrationTest-1795257779 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '3751bb46-9a8b-4302-9c63-b2bed6fccd8d', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:49:47.535956 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-9a2efc13-1ce2-4bf4-8672-a1ea6d8a4a87 req-7b5e26f7-f084-4802-b006-873588e6d04f tempest-LiveMigrationTest-1795257779 None] Connection info returned from driver {'name': 'volumes/volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3751bb46-9a8b-4302-9c63-b2bed6fccd8d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '382a3a5d-ed9e-4779-88d3-dd0ac951fd6b'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:49:47.582206 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-9a2efc13-1ce2-4bf4-8672-a1ea6d8a4a87 req-7b5e26f7-f084-4802-b006-873588e6d04f tempest-LiveMigrationTest-1795257779 None] attachment_update completed successfully. Jan 29 20:50:06.237222 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-f0786e5a-79d1-4eb2-8ae0-e439988fe3ff req-ec8b6c25-e9b3-4d72-8648-580cc7b1395e tempest-LiveMigrationTest-825023025 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:50:07.047490 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-f0786e5a-79d1-4eb2-8ae0-e439988fe3ff req-ec8b6c25-e9b3-4d72-8648-580cc7b1395e tempest-LiveMigrationTest-825023025 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.810s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:50:07.048072 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-f0786e5a-79d1-4eb2-8ae0-e439988fe3ff req-ec8b6c25-e9b3-4d72-8648-580cc7b1395e tempest-LiveMigrationTest-825023025 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '3751bb46-9a8b-4302-9c63-b2bed6fccd8d', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:50:07.075856 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-f0786e5a-79d1-4eb2-8ae0-e439988fe3ff req-ec8b6c25-e9b3-4d72-8648-580cc7b1395e tempest-LiveMigrationTest-825023025 None] Connection info returned from driver {'name': 'volumes/volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3751bb46-9a8b-4302-9c63-b2bed6fccd8d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '59f03037-296f-4b75-9b68-db3ebd2fb5c0'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:50:07.137315 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-f0786e5a-79d1-4eb2-8ae0-e439988fe3ff req-ec8b6c25-e9b3-4d72-8648-580cc7b1395e tempest-LiveMigrationTest-825023025 None] attachment_update completed successfully. Jan 29 20:50:14.631398 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-f0786e5a-79d1-4eb2-8ae0-e439988fe3ff req-ed148b12-cfdf-4cc5-bacf-38d4145bd4de tempest-LiveMigrationTest-825023025 None] Terminate volume connection completed successfully. Jan 29 20:50:14.632071 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-f0786e5a-79d1-4eb2-8ae0-e439988fe3ff req-ed148b12-cfdf-4cc5-bacf-38d4145bd4de tempest-LiveMigrationTest-825023025 None] Deleting attachment 382a3a5d-ed9e-4779-88d3-dd0ac951fd6b. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:50:26.890184 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-b487f55a-46f9-42d5-94f2-29092a5418a7 req-0c5cfc43-d90e-4120-9375-8cfcd80f049c tempest-LiveMigrationTest-1795257779 None] Terminate volume connection completed successfully. Jan 29 20:50:26.890893 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-b487f55a-46f9-42d5-94f2-29092a5418a7 req-0c5cfc43-d90e-4120-9375-8cfcd80f049c tempest-LiveMigrationTest-1795257779 None] Deleting attachment 59f03037-296f-4b75-9b68-db3ebd2fb5c0. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:50:27.060829 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-b487f55a-46f9-42d5-94f2-29092a5418a7 req-265fc938-a886-4419-b9cd-1f615294f20a tempest-LiveMigrationTest-1795257779 None] Lock "b'cinder-3751bb46-9a8b-4302-9c63-b2bed6fccd8d-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:50:27.105465 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b487f55a-46f9-42d5-94f2-29092a5418a7 req-265fc938-a886-4419-b9cd-1f615294f20a tempest-LiveMigrationTest-1795257779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:50:27.167228 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b487f55a-46f9-42d5-94f2-29092a5418a7 req-265fc938-a886-4419-b9cd-1f615294f20a tempest-LiveMigrationTest-1795257779 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:50:27.167693 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b487f55a-46f9-42d5-94f2-29092a5418a7 req-265fc938-a886-4419-b9cd-1f615294f20a tempest-LiveMigrationTest-1795257779 None] volume has clone snapshot(s) {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1208}} Jan 29 20:50:27.169114 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b487f55a-46f9-42d5-94f2-29092a5418a7 req-265fc938-a886-4419-b9cd-1f615294f20a tempest-LiveMigrationTest-1795257779 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:50:27.312526 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [req-b487f55a-46f9-42d5-94f2-29092a5418a7 req-265fc938-a886-4419-b9cd-1f615294f20a tempest-LiveMigrationTest-1795257779 None] Created reservations ['8ad4ee13-a8de-4040-b2d8-2c68a1c319dc', '6b791aea-21fb-442e-bf8c-644f1d99abec', 'c290f5c6-98f5-44ae-89e0-841375f641d2', '891c91e3-5aa9-42c8-937e-77bc611597cc'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:50:27.372824 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b487f55a-46f9-42d5-94f2-29092a5418a7 req-265fc938-a886-4419-b9cd-1f615294f20a tempest-LiveMigrationTest-1795257779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:50:27.425612 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b487f55a-46f9-42d5-94f2-29092a5418a7 req-265fc938-a886-4419-b9cd-1f615294f20a tempest-LiveMigrationTest-1795257779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:50:27.473826 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [req-b487f55a-46f9-42d5-94f2-29092a5418a7 req-265fc938-a886-4419-b9cd-1f615294f20a tempest-LiveMigrationTest-1795257779 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:50:27.485250 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-b487f55a-46f9-42d5-94f2-29092a5418a7 req-265fc938-a886-4419-b9cd-1f615294f20a tempest-LiveMigrationTest-1795257779 None] Deleted volume successfully. Jan 29 20:50:27.491224 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-2048bc0b-c83a-4118-9811-3c5a049dc351 tempest-LiveMigrationTest-1795257779 None] Lock "b'cinder-2f30ed55-0acd-4ecb-ab85-59809b7d14bd-delete_volume'" acquired by "delete_volume" :: waited 0.124s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:50:27.508636 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-b487f55a-46f9-42d5-94f2-29092a5418a7 req-265fc938-a886-4419-b9cd-1f615294f20a tempest-LiveMigrationTest-1795257779 None] Lock "b'cinder-3751bb46-9a8b-4302-9c63-b2bed6fccd8d-delete_volume'" released by "delete_volume" :: held 0.448s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:50:27.529877 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2048bc0b-c83a-4118-9811-3c5a049dc351 tempest-LiveMigrationTest-1795257779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:50:27.569524 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2048bc0b-c83a-4118-9811-3c5a049dc351 tempest-LiveMigrationTest-1795257779 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:50:27.569950 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2048bc0b-c83a-4118-9811-3c5a049dc351 tempest-LiveMigrationTest-1795257779 None] Volume volume-2f30ed55-0acd-4ecb-ab85-59809b7d14bd is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:50:27.575986 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2048bc0b-c83a-4118-9811-3c5a049dc351 tempest-LiveMigrationTest-1795257779 None] deleting rbd volume volume-2f30ed55-0acd-4ecb-ab85-59809b7d14bd {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:50:27.786849 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-2048bc0b-c83a-4118-9811-3c5a049dc351 tempest-LiveMigrationTest-1795257779 None] Created reservations ['f575b572-2f01-4556-89a0-ee7e2a8d672c', '31296069-7c49-48a5-b1f5-ce960e3ec53e', '99b09471-cc25-4496-842d-bb4afc110b44', '71e8fa52-1cbb-4a31-be3b-3d5a641c4a7f'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:50:27.830232 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2048bc0b-c83a-4118-9811-3c5a049dc351 tempest-LiveMigrationTest-1795257779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:50:27.866503 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2048bc0b-c83a-4118-9811-3c5a049dc351 tempest-LiveMigrationTest-1795257779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:50:27.897219 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-2048bc0b-c83a-4118-9811-3c5a049dc351 tempest-LiveMigrationTest-1795257779 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:50:27.902201 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-2048bc0b-c83a-4118-9811-3c5a049dc351 tempest-LiveMigrationTest-1795257779 None] Deleted volume successfully. Jan 29 20:50:27.915866 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-2048bc0b-c83a-4118-9811-3c5a049dc351 tempest-LiveMigrationTest-1795257779 None] Lock "b'cinder-2f30ed55-0acd-4ecb-ab85-59809b7d14bd-delete_volume'" released by "delete_volume" :: held 0.425s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:50:28.633031 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:50:28.633781 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:50:28.668671 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:50:28.699628 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:51:28.631579 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:51:28.633297 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:51:28.706042 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:51:28.819566 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:51:30.780530 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:51:30.801976 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:51:30.802476 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:51:30.878791 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Flow 'volume_create_manager' (cb9fa0c5-50e2-4036-a376-1829e8e86c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:51:30.890635 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fb4175-2454-454d-bfda-1850d98f2a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:30.900589 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:51:30.923545 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fb4175-2454-454d-bfda-1850d98f2a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1680032634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e6aa71d9-a127-48b1-970e-9f81c4708995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac70dcf16a4b4e00ba28de03cee01584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:51:31Z,use_quota=True,user_id='ba4b794aba7645ac8624701859f3ded4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:30.930321 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d144441-3712-47d6-ab63-609f5bca562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:30.935295 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d144441-3712-47d6-ab63-609f5bca562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:30.942088 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ba4130-367c-45dd-94b1-90cb13dbe837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:31.064427 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ba4130-367c-45dd-94b1-90cb13dbe837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e6aa71d9-a127-48b1-970e-9f81c4708995', 'volume_name': 'volume-e6aa71d9-a127-48b1-970e-9f81c4708995', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:31.079457 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c387e643-a4a6-4de0-8a9e-d9ea28e0d233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:31.091097 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c387e643-a4a6-4de0-8a9e-d9ea28e0d233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:31.100709 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e369f165-1bb9-4e58-9949-408dc8e1da8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:31.104468 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Volume e6aa71d9-a127-48b1-970e-9f81c4708995: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e6aa71d9-a127-48b1-970e-9f81c4708995', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 20:51:31.107744 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Cloning e6aa71d9-a127-48b1-970e-9f81c4708995 from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 20:51:31.125634 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:51:31.152058 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 20, 51, 31, 141659)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 20:51:31.152780 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 20:51:31.153421 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Found cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 29 20:51:31.163011 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 0.039s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:51:31.165935 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 20:51:31.191680 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 20, 51, 31, 186709)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 20:51:31.192120 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 20:51:31.192523 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Creating from source image-volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 29 20:51:31.220357 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:51:31.338706 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] creating snapshot='volume-e6aa71d9-a127-48b1-970e-9f81c4708995.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 20:51:32.384144 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] cloning 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe@volume-e6aa71d9-a127-48b1-970e-9f81c4708995.clone_snap' to 'volume-e6aa71d9-a127-48b1-970e-9f81c4708995' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 20:51:32.589476 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:51:32.593162 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:51:32.593947 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:51:32.631782 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 20:51:32.632411 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Marking volume e6aa71d9-a127-48b1-970e-9f81c4708995 as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 20:51:32.646620 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to e6aa71d9-a127-48b1-970e-9f81c4708995. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 20:51:32.647053 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Creating volume glance metadata for volume e6aa71d9-a127-48b1-970e-9f81c4708995 backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 20:51:32.773810 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e369f165-1bb9-4e58-9949-408dc8e1da8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6aa71d9-a127-48b1-970e-9f81c4708995', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:32.779334 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb15c21-8cfa-44c9-81d9-ca135fa1a06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:32.798416 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Volume volume-e6aa71d9-a127-48b1-970e-9f81c4708995 (e6aa71d9-a127-48b1-970e-9f81c4708995): created successfully Jan 29 20:51:32.803538 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb15c21-8cfa-44c9-81d9-ca135fa1a06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:32.828446 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Flow 'volume_create_manager' (cb9fa0c5-50e2-4036-a376-1829e8e86c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:51:32.848365 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-3ba8ab12-5b15-4f9d-8c4d-cc8aad8293e8 tempest-TaggedBootDevicesTest-118627551 None] Created volume successfully. Jan 29 20:51:33.512765 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:51:33.518374 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:51:33.519120 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:51:33.553982 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Flow 'volume_create_manager' (9df0254e-574b-4d2c-b033-568a88fd7dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:51:33.561371 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe2a45b-269f-476c-b58a-f4905d346b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:33.572004 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:51:33.595131 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe2a45b-269f-476c-b58a-f4905d346b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1641684231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=df2202d3-1e91-4d32-839e-da53c4019911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac70dcf16a4b4e00ba28de03cee01584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:51:33Z,use_quota=True,user_id='ba4b794aba7645ac8624701859f3ded4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:33.607741 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17630865-b5f0-4a62-926e-e0999366231a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:33.614775 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17630865-b5f0-4a62-926e-e0999366231a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:33.617778 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb04e7a-3b94-4c6d-95e4-66fa2d465b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:33.622207 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb04e7a-3b94-4c6d-95e4-66fa2d465b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df2202d3-1e91-4d32-839e-da53c4019911', 'volume_name': 'volume-df2202d3-1e91-4d32-839e-da53c4019911', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:33.627805 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecdb27e-cd39-4d23-b17b-81a1cfea2194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:33.632020 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecdb27e-cd39-4d23-b17b-81a1cfea2194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:33.637381 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a5386e-3cbd-4f29-ad48-66424f4e2347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:33.638533 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Volume df2202d3-1e91-4d32-839e-da53c4019911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df2202d3-1e91-4d32-839e-da53c4019911', 'volume_size': 1} Jan 29 20:51:33.638935 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] creating volume 'volume-df2202d3-1e91-4d32-839e-da53c4019911' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:51:33.639979 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:51:33.742022 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:51:33.742473 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:51:33.746795 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a5386e-3cbd-4f29-ad48-66424f4e2347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df2202d3-1e91-4d32-839e-da53c4019911', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:33.752703 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1f617e-cfaa-4561-bad0-a0e55c26f3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:33.762955 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Volume volume-df2202d3-1e91-4d32-839e-da53c4019911 (df2202d3-1e91-4d32-839e-da53c4019911): created successfully Jan 29 20:51:33.767580 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1f617e-cfaa-4561-bad0-a0e55c26f3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:33.777051 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Flow 'volume_create_manager' (9df0254e-574b-4d2c-b033-568a88fd7dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:51:33.787815 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d8879ca5-1c14-423e-a4d6-ef650a290c9a tempest-TaggedBootDevicesTest-118627551 None] Created volume successfully. Jan 29 20:51:35.300199 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:51:35.309718 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:51:35.311003 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:51:35.345320 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Flow 'volume_create_manager' (cb6a2e87-829d-499b-a4db-725fcd872fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:51:35.355099 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25837fd-1d78-4a92-b005-f64a8fc575a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:35.362805 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:51:35.409283 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25837fd-1d78-4a92-b005-f64a8fc575a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-167514095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8f8de57e-73fc-421f-a710-ee64037e006f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac70dcf16a4b4e00ba28de03cee01584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:51:35Z,use_quota=True,user_id='ba4b794aba7645ac8624701859f3ded4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:35.418098 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e5a723-ca1f-4b57-a8b6-26c980e035ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:35.424266 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e5a723-ca1f-4b57-a8b6-26c980e035ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:35.438319 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c2c5cd-b145-42a4-8d04-3e2b25037714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:35.446938 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c2c5cd-b145-42a4-8d04-3e2b25037714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f8de57e-73fc-421f-a710-ee64037e006f', 'volume_name': 'volume-8f8de57e-73fc-421f-a710-ee64037e006f', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:35.466013 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ef41f3-548d-4263-b24d-ad3548bc2317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:35.470306 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ef41f3-548d-4263-b24d-ad3548bc2317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:35.476595 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e48728-8dfc-41ca-b215-504d9e28ce5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:35.479125 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Volume 8f8de57e-73fc-421f-a710-ee64037e006f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f8de57e-73fc-421f-a710-ee64037e006f', 'volume_size': 1} Jan 29 20:51:35.479713 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] creating volume 'volume-8f8de57e-73fc-421f-a710-ee64037e006f' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:51:35.481601 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:51:35.577977 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:51:35.578510 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:51:35.583011 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e48728-8dfc-41ca-b215-504d9e28ce5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f8de57e-73fc-421f-a710-ee64037e006f', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:35.592697 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dc71a2-d4dd-4dd8-aecf-fb2eff3681fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:51:35.607465 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Volume volume-8f8de57e-73fc-421f-a710-ee64037e006f (8f8de57e-73fc-421f-a710-ee64037e006f): created successfully Jan 29 20:51:35.613638 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dc71a2-d4dd-4dd8-aecf-fb2eff3681fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:51:35.621532 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Flow 'volume_create_manager' (cb6a2e87-829d-499b-a4db-725fcd872fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:51:35.657902 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f326d788-7638-4937-a88a-3dd694e02a79 tempest-TaggedBootDevicesTest-118627551 None] Created volume successfully. Jan 29 20:51:56.292685 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-5edad4bc-bcf9-4d3f-8fc9-7360f4d7d89d req-0bc7689f-7ad8-4515-be31-bad34c096876 tempest-TaggedBootDevicesTest-118627551 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:51:57.275163 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-5edad4bc-bcf9-4d3f-8fc9-7360f4d7d89d req-0bc7689f-7ad8-4515-be31-bad34c096876 tempest-TaggedBootDevicesTest-118627551 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.983s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:51:57.275918 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-5edad4bc-bcf9-4d3f-8fc9-7360f4d7d89d req-0bc7689f-7ad8-4515-be31-bad34c096876 tempest-TaggedBootDevicesTest-118627551 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e6aa71d9-a127-48b1-970e-9f81c4708995', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'e6aa71d9-a127-48b1-970e-9f81c4708995', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:51:57.316007 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-5edad4bc-bcf9-4d3f-8fc9-7360f4d7d89d req-0bc7689f-7ad8-4515-be31-bad34c096876 tempest-TaggedBootDevicesTest-118627551 None] Connection info returned from driver {'name': 'volumes/volume-e6aa71d9-a127-48b1-970e-9f81c4708995', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e6aa71d9-a127-48b1-970e-9f81c4708995', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd994e969-5eea-443a-9a2f-4ca59ab2bef7'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:51:57.415926 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-5edad4bc-bcf9-4d3f-8fc9-7360f4d7d89d req-0bc7689f-7ad8-4515-be31-bad34c096876 tempest-TaggedBootDevicesTest-118627551 None] attachment_update completed successfully. Jan 29 20:51:57.986657 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-5edad4bc-bcf9-4d3f-8fc9-7360f4d7d89d req-32ebe24b-c468-4461-bf99-8c6116e54e34 tempest-TaggedBootDevicesTest-118627551 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:51:58.878510 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-5edad4bc-bcf9-4d3f-8fc9-7360f4d7d89d req-32ebe24b-c468-4461-bf99-8c6116e54e34 tempest-TaggedBootDevicesTest-118627551 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.892s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:51:58.879839 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-5edad4bc-bcf9-4d3f-8fc9-7360f4d7d89d req-32ebe24b-c468-4461-bf99-8c6116e54e34 tempest-TaggedBootDevicesTest-118627551 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-df2202d3-1e91-4d32-839e-da53c4019911', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'df2202d3-1e91-4d32-839e-da53c4019911', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:51:58.922001 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-5edad4bc-bcf9-4d3f-8fc9-7360f4d7d89d req-32ebe24b-c468-4461-bf99-8c6116e54e34 tempest-TaggedBootDevicesTest-118627551 None] Connection info returned from driver {'name': 'volumes/volume-df2202d3-1e91-4d32-839e-da53c4019911', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'df2202d3-1e91-4d32-839e-da53c4019911', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '052ba1a9-311e-4ae9-8178-f7b207c2eb8c'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:51:58.984365 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-5edad4bc-bcf9-4d3f-8fc9-7360f4d7d89d req-32ebe24b-c468-4461-bf99-8c6116e54e34 tempest-TaggedBootDevicesTest-118627551 None] attachment_update completed successfully. Jan 29 20:51:59.291244 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-5edad4bc-bcf9-4d3f-8fc9-7360f4d7d89d req-b844f7f0-05f6-498e-91ff-b6d250f99201 tempest-TaggedBootDevicesTest-118627551 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:52:00.255914 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-5edad4bc-bcf9-4d3f-8fc9-7360f4d7d89d req-b844f7f0-05f6-498e-91ff-b6d250f99201 tempest-TaggedBootDevicesTest-118627551 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.964s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:52:00.257020 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-5edad4bc-bcf9-4d3f-8fc9-7360f4d7d89d req-b844f7f0-05f6-498e-91ff-b6d250f99201 tempest-TaggedBootDevicesTest-118627551 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8f8de57e-73fc-421f-a710-ee64037e006f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '8f8de57e-73fc-421f-a710-ee64037e006f', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:52:00.281388 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-5edad4bc-bcf9-4d3f-8fc9-7360f4d7d89d req-b844f7f0-05f6-498e-91ff-b6d250f99201 tempest-TaggedBootDevicesTest-118627551 None] Connection info returned from driver {'name': 'volumes/volume-8f8de57e-73fc-421f-a710-ee64037e006f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8f8de57e-73fc-421f-a710-ee64037e006f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3030d941-5c31-4f94-b442-78faca2abfbf'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:52:00.334656 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-5edad4bc-bcf9-4d3f-8fc9-7360f4d7d89d req-b844f7f0-05f6-498e-91ff-b6d250f99201 tempest-TaggedBootDevicesTest-118627551 None] attachment_update completed successfully. Jan 29 20:52:28.636294 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:52:28.637458 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:52:28.663636 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:52:28.689008 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:52:33.013905 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:52:33.018263 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:52:33.018659 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:52:33.049471 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Flow 'volume_create_manager' (a80ef422-5cd6-4947-b789-3c94fa9e8d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:52:33.056713 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ed5255-8d23-448e-b723-9fa8f5eca477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:52:33.064459 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:52:33.080021 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ed5255-8d23-448e-b723-9fa8f5eca477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1791913770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6c560ce9-ca43-42d1-be95-bbfd958bfa47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc76ddf545b849e38210bf8f5072d043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:52:33Z,use_quota=True,user_id='18c90183ce6047f29995927a1e5cadbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:52:33.085737 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd7d2ad-cf2e-4f16-a369-47f5a36fc853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:52:33.089867 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd7d2ad-cf2e-4f16-a369-47f5a36fc853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:52:33.095063 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9893734-23c9-4cf7-8e02-eb526b774cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:52:33.099259 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9893734-23c9-4cf7-8e02-eb526b774cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c560ce9-ca43-42d1-be95-bbfd958bfa47', 'volume_name': 'volume-6c560ce9-ca43-42d1-be95-bbfd958bfa47', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:52:33.104222 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd519d6-f371-4cf4-bca6-e8395b21b25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:52:33.108154 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd519d6-f371-4cf4-bca6-e8395b21b25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:52:33.112973 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c183b52-3f37-4a82-8dba-dca8dd6909fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:52:33.114094 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Volume 6c560ce9-ca43-42d1-be95-bbfd958bfa47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c560ce9-ca43-42d1-be95-bbfd958bfa47', 'volume_size': 1} Jan 29 20:52:33.114497 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] creating volume 'volume-6c560ce9-ca43-42d1-be95-bbfd958bfa47' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:52:33.115494 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:52:33.189447 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:52:33.189913 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:52:33.194432 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c183b52-3f37-4a82-8dba-dca8dd6909fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c560ce9-ca43-42d1-be95-bbfd958bfa47', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:52:33.199175 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabdb002-7f42-477b-86f2-cb24cfda126a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:52:33.209682 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Volume volume-6c560ce9-ca43-42d1-be95-bbfd958bfa47 (6c560ce9-ca43-42d1-be95-bbfd958bfa47): created successfully Jan 29 20:52:33.214761 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabdb002-7f42-477b-86f2-cb24cfda126a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:52:33.227511 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Flow 'volume_create_manager' (a80ef422-5cd6-4947-b789-3c94fa9e8d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:52:33.237004 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-38044330-250a-4902-9da3-50a9228b6c9a tempest-AttachVolumeNegativeTest-797842704 None] Created volume successfully. Jan 29 20:52:34.440590 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-8405dd60-af4d-4ea1-9a9a-5acc422fbbf1 req-c52ff6cc-a676-418b-a0ec-7b98b45baa7d tempest-AttachVolumeNegativeTest-797842704 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:52:35.093904 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-8405dd60-af4d-4ea1-9a9a-5acc422fbbf1 req-c52ff6cc-a676-418b-a0ec-7b98b45baa7d tempest-AttachVolumeNegativeTest-797842704 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.652s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:52:35.094612 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-8405dd60-af4d-4ea1-9a9a-5acc422fbbf1 req-c52ff6cc-a676-418b-a0ec-7b98b45baa7d tempest-AttachVolumeNegativeTest-797842704 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6c560ce9-ca43-42d1-be95-bbfd958bfa47', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '6c560ce9-ca43-42d1-be95-bbfd958bfa47', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:52:35.118003 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-8405dd60-af4d-4ea1-9a9a-5acc422fbbf1 req-c52ff6cc-a676-418b-a0ec-7b98b45baa7d tempest-AttachVolumeNegativeTest-797842704 None] Connection info returned from driver {'name': 'volumes/volume-6c560ce9-ca43-42d1-be95-bbfd958bfa47', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6c560ce9-ca43-42d1-be95-bbfd958bfa47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '590272f4-028e-47a1-8866-d7b6e81e373a'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:52:35.163011 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-8405dd60-af4d-4ea1-9a9a-5acc422fbbf1 req-c52ff6cc-a676-418b-a0ec-7b98b45baa7d tempest-AttachVolumeNegativeTest-797842704 None] attachment_update completed successfully. Jan 29 20:52:55.912826 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-71ef3e31-9f5b-41bb-a3d5-1fbedd794460 req-328977c2-b44c-419f-8955-b072ac17dba7 tempest-AttachVolumeNegativeTest-797842704 None] Terminate volume connection completed successfully. Jan 29 20:52:55.913464 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-71ef3e31-9f5b-41bb-a3d5-1fbedd794460 req-328977c2-b44c-419f-8955-b072ac17dba7 tempest-AttachVolumeNegativeTest-797842704 None] Deleting attachment 590272f4-028e-47a1-8866-d7b6e81e373a. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:53:12.722887 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:53:12.727350 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:53:12.727983 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:53:12.747256 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Flow 'volume_create_manager' (c41f0322-1c55-4a3e-9f30-8c43a3007c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:53:12.754504 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bedb2e65-2ec3-4394-b7ff-cbd28ec26659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:12.761921 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:53:12.777044 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bedb2e65-2ec3-4394-b7ff-cbd28ec26659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-105371566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ef59658d-41bf-47d8-a839-a18c04f15d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc76ddf545b849e38210bf8f5072d043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:53:13Z,use_quota=True,user_id='18c90183ce6047f29995927a1e5cadbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:12.782487 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0fd586-d2e8-43d3-812a-09a9063cc200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:12.786630 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0fd586-d2e8-43d3-812a-09a9063cc200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:12.791817 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf8e9a1-b283-4326-80d1-9870fb0af12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:12.796328 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf8e9a1-b283-4326-80d1-9870fb0af12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef59658d-41bf-47d8-a839-a18c04f15d92', 'volume_name': 'volume-ef59658d-41bf-47d8-a839-a18c04f15d92', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:12.801259 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de496e2-0b59-45b7-928f-0a8ed9cfc4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:12.805296 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de496e2-0b59-45b7-928f-0a8ed9cfc4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:12.810111 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7d2303-eca4-48f9-8d4f-c0008861c0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:12.811226 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Volume ef59658d-41bf-47d8-a839-a18c04f15d92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef59658d-41bf-47d8-a839-a18c04f15d92', 'volume_size': 1} Jan 29 20:53:12.812185 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] creating volume 'volume-ef59658d-41bf-47d8-a839-a18c04f15d92' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:53:12.813592 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:53:12.884780 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:53:12.885557 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:53:12.889434 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7d2303-eca4-48f9-8d4f-c0008861c0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef59658d-41bf-47d8-a839-a18c04f15d92', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:12.894851 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63ff638-bd5b-4417-8007-de525e36535c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:12.905236 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Volume volume-ef59658d-41bf-47d8-a839-a18c04f15d92 (ef59658d-41bf-47d8-a839-a18c04f15d92): created successfully Jan 29 20:53:12.909921 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63ff638-bd5b-4417-8007-de525e36535c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:12.915438 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Flow 'volume_create_manager' (c41f0322-1c55-4a3e-9f30-8c43a3007c01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:53:12.924374 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6dd2cf8f-da5b-488b-99e8-e8a06a9ea89b tempest-AttachVolumeNegativeTest-797842704 None] Created volume successfully. Jan 29 20:53:14.299265 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-1670a0b0-a982-467e-9839-b83e4b373dcc req-46dbc7e3-5bc8-4f52-b33b-8dfe437df4b0 tempest-AttachVolumeNegativeTest-797842704 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:53:15.050859 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-1670a0b0-a982-467e-9839-b83e4b373dcc req-46dbc7e3-5bc8-4f52-b33b-8dfe437df4b0 tempest-AttachVolumeNegativeTest-797842704 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.751s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:53:15.051656 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-1670a0b0-a982-467e-9839-b83e4b373dcc req-46dbc7e3-5bc8-4f52-b33b-8dfe437df4b0 tempest-AttachVolumeNegativeTest-797842704 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ef59658d-41bf-47d8-a839-a18c04f15d92', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'ef59658d-41bf-47d8-a839-a18c04f15d92', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:53:15.074602 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-1670a0b0-a982-467e-9839-b83e4b373dcc req-46dbc7e3-5bc8-4f52-b33b-8dfe437df4b0 tempest-AttachVolumeNegativeTest-797842704 None] Connection info returned from driver {'name': 'volumes/volume-ef59658d-41bf-47d8-a839-a18c04f15d92', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ef59658d-41bf-47d8-a839-a18c04f15d92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '01bafb16-5a0b-43dc-93a1-00f2a1d3b14d'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:53:15.121752 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-1670a0b0-a982-467e-9839-b83e4b373dcc req-46dbc7e3-5bc8-4f52-b33b-8dfe437df4b0 tempest-AttachVolumeNegativeTest-797842704 None] attachment_update completed successfully. Jan 29 20:53:18.696865 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-98600f37-2132-407e-975c-41661b8e48d4 req-fbaf7ff9-2245-4620-ae6d-cce520c619e1 tempest-AttachVolumeNegativeTest-797842704 None] Terminate volume connection completed successfully. Jan 29 20:53:18.697532 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-98600f37-2132-407e-975c-41661b8e48d4 req-fbaf7ff9-2245-4620-ae6d-cce520c619e1 tempest-AttachVolumeNegativeTest-797842704 None] Deleting attachment 01bafb16-5a0b-43dc-93a1-00f2a1d3b14d. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:53:22.187387 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:53:22.191549 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:53:22.192042 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:53:22.212262 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Flow 'volume_create_manager' (db05a2fe-f6c8-4169-873b-fb0c439ad42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:53:22.219893 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6384dfa8-5fce-4bc6-b38e-b66b98e13c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:22.227213 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:53:22.251725 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6384dfa8-5fce-4bc6-b38e-b66b98e13c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1262165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=19eb68a0-1d8d-4519-9ceb-4ddb7679608a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89877d145a6947f78c36c16e63c3b547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:53:22Z,use_quota=True,user_id='2d39b6d670c34dae82697b73af5f8416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:22.261011 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e960cd-97f9-432f-a50b-3f8c65ff771e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:22.267631 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e960cd-97f9-432f-a50b-3f8c65ff771e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:22.275308 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd33436-e2cc-40ff-b95e-1e87423004a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:22.280692 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd33436-e2cc-40ff-b95e-1e87423004a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19eb68a0-1d8d-4519-9ceb-4ddb7679608a', 'volume_name': 'volume-19eb68a0-1d8d-4519-9ceb-4ddb7679608a', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:22.289190 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64873f5d-55d9-4752-a664-6dde19f84dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:22.299488 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64873f5d-55d9-4752-a664-6dde19f84dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:22.312593 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071f3ed2-7b82-4f60-8bcd-a8f67324a9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:22.322941 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Volume 19eb68a0-1d8d-4519-9ceb-4ddb7679608a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19eb68a0-1d8d-4519-9ceb-4ddb7679608a', 'volume_size': 1} Jan 29 20:53:22.322941 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] creating volume 'volume-19eb68a0-1d8d-4519-9ceb-4ddb7679608a' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:53:22.322941 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:53:22.433844 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:53:22.434581 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:53:22.440207 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071f3ed2-7b82-4f60-8bcd-a8f67324a9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19eb68a0-1d8d-4519-9ceb-4ddb7679608a', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:22.447084 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f7fb4f-50d0-46cc-9be9-a49e80a0cf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:22.465849 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Volume volume-19eb68a0-1d8d-4519-9ceb-4ddb7679608a (19eb68a0-1d8d-4519-9ceb-4ddb7679608a): created successfully Jan 29 20:53:22.472249 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f7fb4f-50d0-46cc-9be9-a49e80a0cf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:22.478147 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Flow 'volume_create_manager' (db05a2fe-f6c8-4169-873b-fb0c439ad42e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:53:22.501470 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-c56840a8-64fc-44a9-9d84-56f6b296a8dd tempest-DeleteServersTestJSON-1517781922 None] Created volume successfully. Jan 29 20:53:23.804263 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-b5f5a9f3-0881-451b-8517-b8f7792d42de req-95e6d9bf-c92b-4282-bbe5-f3bd1279aac9 tempest-DeleteServersTestJSON-1517781922 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:53:24.519552 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-b5f5a9f3-0881-451b-8517-b8f7792d42de req-95e6d9bf-c92b-4282-bbe5-f3bd1279aac9 tempest-DeleteServersTestJSON-1517781922 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.715s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:53:24.520781 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b5f5a9f3-0881-451b-8517-b8f7792d42de req-95e6d9bf-c92b-4282-bbe5-f3bd1279aac9 tempest-DeleteServersTestJSON-1517781922 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-19eb68a0-1d8d-4519-9ceb-4ddb7679608a', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '19eb68a0-1d8d-4519-9ceb-4ddb7679608a', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:53:24.553768 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-b5f5a9f3-0881-451b-8517-b8f7792d42de req-95e6d9bf-c92b-4282-bbe5-f3bd1279aac9 tempest-DeleteServersTestJSON-1517781922 None] Connection info returned from driver {'name': 'volumes/volume-19eb68a0-1d8d-4519-9ceb-4ddb7679608a', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '19eb68a0-1d8d-4519-9ceb-4ddb7679608a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd5a294f4-d771-4c96-bbbb-d93f37bd088c'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:53:24.611238 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-b5f5a9f3-0881-451b-8517-b8f7792d42de req-95e6d9bf-c92b-4282-bbe5-f3bd1279aac9 tempest-DeleteServersTestJSON-1517781922 None] attachment_update completed successfully. Jan 29 20:53:28.637103 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:53:28.637103 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:53:28.697577 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:53:28.729401 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:53:30.555911 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:53:30.560286 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:53:30.560840 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:53:30.583459 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Flow 'volume_create_manager' (a920ebec-4782-4672-b816-eafb587ee7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:53:30.590875 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a62e60-589f-43b2-8828-0a6f6a1bda27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:30.599552 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:53:30.616799 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a62e60-589f-43b2-8828-0a6f6a1bda27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-985973938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3fb4f9ee-4003-41af-9a26-4ac9c7192ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3b71f9bda245f89384d15b7d991443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:53:31Z,use_quota=True,user_id='e706c73f10ad41b0988463c31f9c7999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:30.622518 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e066e208-c821-46fa-b3a1-043b11ba72e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:30.627361 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e066e208-c821-46fa-b3a1-043b11ba72e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:30.632877 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503641fd-7549-4a20-aad7-0b38889def1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:30.637468 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503641fd-7549-4a20-aad7-0b38889def1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fb4f9ee-4003-41af-9a26-4ac9c7192ea0', 'volume_name': 'volume-3fb4f9ee-4003-41af-9a26-4ac9c7192ea0', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:30.642924 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1b8503-104b-43ef-8f57-06093f0f5e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:30.647370 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1b8503-104b-43ef-8f57-06093f0f5e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:30.653018 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773eeee4-43b8-412c-8d93-51a3288b7595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:30.654435 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Volume 3fb4f9ee-4003-41af-9a26-4ac9c7192ea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fb4f9ee-4003-41af-9a26-4ac9c7192ea0', 'volume_size': 1} Jan 29 20:53:30.654848 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] creating volume 'volume-3fb4f9ee-4003-41af-9a26-4ac9c7192ea0' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:53:30.655877 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:53:30.763170 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:53:30.764644 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:53:30.770756 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773eeee4-43b8-412c-8d93-51a3288b7595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb4f9ee-4003-41af-9a26-4ac9c7192ea0', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:30.779047 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a69f74-0227-41c4-a27f-d6dde4659b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:30.804749 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Volume volume-3fb4f9ee-4003-41af-9a26-4ac9c7192ea0 (3fb4f9ee-4003-41af-9a26-4ac9c7192ea0): created successfully Jan 29 20:53:30.808746 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a69f74-0227-41c4-a27f-d6dde4659b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:30.816510 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Flow 'volume_create_manager' (a920ebec-4782-4672-b816-eafb587ee7d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:53:30.830479 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-bc0c3bd6-e435-4a69-a1f9-9a4de9e47496 tempest-ServerRescueNegativeTestJSON-890494202 None] Created volume successfully. Jan 29 20:53:38.429880 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:53:38.434381 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:53:38.434820 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:53:38.454014 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Flow 'volume_create_manager' (62645262-ad77-446d-85d6-2399bddb6f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:53:38.460424 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d7728d-0702-40c9-a668-1949fced6b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:38.467337 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:53:38.489192 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d7728d-0702-40c9-a668-1949fced6b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-482059578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=41b54bf5-c6b9-44e8-bdcc-47059bf4601e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc76ddf545b849e38210bf8f5072d043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:53:38Z,use_quota=True,user_id='18c90183ce6047f29995927a1e5cadbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:38.496641 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65366dd2-6764-444c-b8ae-d9cee6256bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:38.501643 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65366dd2-6764-444c-b8ae-d9cee6256bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:38.509631 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e901a6e2-ebe2-4f05-9b14-4ee4ccb0c761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:38.514986 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e901a6e2-ebe2-4f05-9b14-4ee4ccb0c761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41b54bf5-c6b9-44e8-bdcc-47059bf4601e', 'volume_name': 'volume-41b54bf5-c6b9-44e8-bdcc-47059bf4601e', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:38.520266 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b244bb78-dffa-4a60-bd66-017faea8eaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:38.524350 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b244bb78-dffa-4a60-bd66-017faea8eaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:38.532830 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6ce780-3806-423b-80bf-9fab768c806a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:38.534401 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Volume 41b54bf5-c6b9-44e8-bdcc-47059bf4601e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41b54bf5-c6b9-44e8-bdcc-47059bf4601e', 'volume_size': 1} Jan 29 20:53:38.535027 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] creating volume 'volume-41b54bf5-c6b9-44e8-bdcc-47059bf4601e' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:53:38.536326 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:53:38.627863 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:53:38.628263 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:53:38.632654 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6ce780-3806-423b-80bf-9fab768c806a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b54bf5-c6b9-44e8-bdcc-47059bf4601e', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:38.638606 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdadab44-f9b0-4e63-b7c3-78c2eba2fcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:38.660381 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Volume volume-41b54bf5-c6b9-44e8-bdcc-47059bf4601e (41b54bf5-c6b9-44e8-bdcc-47059bf4601e): created successfully Jan 29 20:53:38.664163 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdadab44-f9b0-4e63-b7c3-78c2eba2fcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:38.669649 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Flow 'volume_create_manager' (62645262-ad77-446d-85d6-2399bddb6f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:53:38.681562 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:53:38.684689 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:53:38.685157 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:53:38.706805 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Flow 'volume_create_manager' (601361b9-1eed-4b1a-b514-991d10a6ee23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:53:38.714296 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b9b845-cc94-4eea-a4b1-4071b1a69ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:38.719723 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-bf5313fc-c10f-48e2-be36-8e60e810b847 tempest-AttachVolumeNegativeTest-797842704 None] Created volume successfully. Jan 29 20:53:38.725651 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:53:38.742266 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b9b845-cc94-4eea-a4b1-4071b1a69ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1808493536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cba11deb-d106-470d-9716-98b046d7dece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975def1272564604bcc0759fc1d44fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:53:39Z,use_quota=True,user_id='d85c81f05a1f4ce397a1dbf051dc07de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:38.747951 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f1615a-ab35-46e6-9093-5a08c996c1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:38.752193 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f1615a-ab35-46e6-9093-5a08c996c1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:38.757563 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5921c9d2-acf3-45ed-863e-0033902d1c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:38.761718 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5921c9d2-acf3-45ed-863e-0033902d1c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cba11deb-d106-470d-9716-98b046d7dece', 'volume_name': 'volume-cba11deb-d106-470d-9716-98b046d7dece', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:38.766700 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af44e102-ddb4-4984-ad5d-e793797125a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:38.770720 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af44e102-ddb4-4984-ad5d-e793797125a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:38.775539 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bfaf6da-f3c6-4d7c-a47a-14595883a2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:38.776708 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Volume cba11deb-d106-470d-9716-98b046d7dece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cba11deb-d106-470d-9716-98b046d7dece', 'volume_size': 1} Jan 29 20:53:38.777128 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] creating volume 'volume-cba11deb-d106-470d-9716-98b046d7dece' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:53:38.778122 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:53:38.850420 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:53:38.850810 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:53:38.854592 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bfaf6da-f3c6-4d7c-a47a-14595883a2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cba11deb-d106-470d-9716-98b046d7dece', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:38.859260 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339beb1f-2737-4126-96b9-bec47deabfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:38.878401 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Volume volume-cba11deb-d106-470d-9716-98b046d7dece (cba11deb-d106-470d-9716-98b046d7dece): created successfully Jan 29 20:53:38.882647 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339beb1f-2737-4126-96b9-bec47deabfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:38.888482 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Flow 'volume_create_manager' (601361b9-1eed-4b1a-b514-991d10a6ee23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:53:38.897257 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-2af516bb-e170-4cc0-8a2d-72398b6797f0 tempest-VolumesAdminNegativeTest-1930665067 None] Created volume successfully. Jan 29 20:53:39.980480 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-9d0e2390-4fc4-4f6d-adc2-b08b5d531764 req-f8da3abb-3d5c-4ffb-ac9c-68e2bc09a441 tempest-AttachVolumeNegativeTest-797842704 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:53:40.309605 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-faba6bf5-defb-4f1a-a777-15bf193885a3 req-82e86da3-01dd-4549-85a6-ecf9b1db10e2 tempest-VolumesAdminNegativeTest-1930665067 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:53:40.836316 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-9d0e2390-4fc4-4f6d-adc2-b08b5d531764 req-f8da3abb-3d5c-4ffb-ac9c-68e2bc09a441 tempest-AttachVolumeNegativeTest-797842704 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.856s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:53:40.837584 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-9d0e2390-4fc4-4f6d-adc2-b08b5d531764 req-f8da3abb-3d5c-4ffb-ac9c-68e2bc09a441 tempest-AttachVolumeNegativeTest-797842704 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-41b54bf5-c6b9-44e8-bdcc-47059bf4601e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '41b54bf5-c6b9-44e8-bdcc-47059bf4601e', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:53:40.897367 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-9d0e2390-4fc4-4f6d-adc2-b08b5d531764 req-f8da3abb-3d5c-4ffb-ac9c-68e2bc09a441 tempest-AttachVolumeNegativeTest-797842704 None] Connection info returned from driver {'name': 'volumes/volume-41b54bf5-c6b9-44e8-bdcc-47059bf4601e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '41b54bf5-c6b9-44e8-bdcc-47059bf4601e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'aaef680a-8dec-4c20-bdb8-826174ac8baf'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:53:40.992654 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-9d0e2390-4fc4-4f6d-adc2-b08b5d531764 req-f8da3abb-3d5c-4ffb-ac9c-68e2bc09a441 tempest-AttachVolumeNegativeTest-797842704 None] attachment_update completed successfully. Jan 29 20:53:41.080615 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-faba6bf5-defb-4f1a-a777-15bf193885a3 req-82e86da3-01dd-4549-85a6-ecf9b1db10e2 tempest-VolumesAdminNegativeTest-1930665067 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.771s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:53:41.081265 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-faba6bf5-defb-4f1a-a777-15bf193885a3 req-82e86da3-01dd-4549-85a6-ecf9b1db10e2 tempest-VolumesAdminNegativeTest-1930665067 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cba11deb-d106-470d-9716-98b046d7dece', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'cba11deb-d106-470d-9716-98b046d7dece', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:53:41.124283 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-faba6bf5-defb-4f1a-a777-15bf193885a3 req-82e86da3-01dd-4549-85a6-ecf9b1db10e2 tempest-VolumesAdminNegativeTest-1930665067 None] Connection info returned from driver {'name': 'volumes/volume-cba11deb-d106-470d-9716-98b046d7dece', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cba11deb-d106-470d-9716-98b046d7dece', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '91f6c124-d742-47ae-a887-59f1a9a959b9'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:53:41.197806 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-faba6bf5-defb-4f1a-a777-15bf193885a3 req-82e86da3-01dd-4549-85a6-ecf9b1db10e2 tempest-VolumesAdminNegativeTest-1930665067 None] attachment_update completed successfully. Jan 29 20:53:43.470808 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:53:43.474713 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:53:43.475203 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:53:43.495403 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Flow 'volume_create_manager' (fac73ba5-ad76-4627-8bfe-127d662e0451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:53:43.502064 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42707e2-db76-4f36-8e48-2ab4903cc310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:43.509666 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:53:43.524598 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42707e2-db76-4f36-8e48-2ab4903cc310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-423198580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3338b79e-f1f2-4a40-a449-d821ab32db3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fda3cc2fcff4f2688703cd45b2e6f68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:53:43Z,use_quota=True,user_id='34b5a574719a408db430136c8eea7e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:43.529974 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c197d7aa-65d4-42e2-b5a6-dd7ed95c6980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:43.534830 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c197d7aa-65d4-42e2-b5a6-dd7ed95c6980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:43.540283 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (528be840-25e8-4deb-8756-fc834c4a0f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:43.544503 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (528be840-25e8-4deb-8756-fc834c4a0f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3338b79e-f1f2-4a40-a449-d821ab32db3e', 'volume_name': 'volume-3338b79e-f1f2-4a40-a449-d821ab32db3e', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:43.549846 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d97397c-dcc4-4b0a-804d-14f517fc8569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:43.553741 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d97397c-dcc4-4b0a-804d-14f517fc8569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:43.558436 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619f1eb6-e5b0-4faf-bae5-50c28d7bbb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:43.559516 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Volume 3338b79e-f1f2-4a40-a449-d821ab32db3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3338b79e-f1f2-4a40-a449-d821ab32db3e', 'volume_size': 1} Jan 29 20:53:43.559921 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] creating volume 'volume-3338b79e-f1f2-4a40-a449-d821ab32db3e' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:53:43.561057 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:53:43.622335 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:53:43.622770 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:53:43.626560 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619f1eb6-e5b0-4faf-bae5-50c28d7bbb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3338b79e-f1f2-4a40-a449-d821ab32db3e', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:43.631154 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c017b8-1980-4bf6-843e-9a2f6b9d4414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:43.639616 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Volume volume-3338b79e-f1f2-4a40-a449-d821ab32db3e (3338b79e-f1f2-4a40-a449-d821ab32db3e): created successfully Jan 29 20:53:43.643717 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c017b8-1980-4bf6-843e-9a2f6b9d4414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:43.649139 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Flow 'volume_create_manager' (fac73ba5-ad76-4627-8bfe-127d662e0451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:53:43.657589 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d33d5bbd-6049-4c17-98c0-c1cd8a873394 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Created volume successfully. Jan 29 20:53:44.985457 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-b21d1121-fee5-4437-a865-fa7fa10f23b3 req-0da3d9d3-18a9-4425-8ec4-17a32176f0fc tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:53:45.637478 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-b21d1121-fee5-4437-a865-fa7fa10f23b3 req-0da3d9d3-18a9-4425-8ec4-17a32176f0fc tempest-LiveAutoBlockMigrationV225Test-1737821182 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.652s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:53:45.638337 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b21d1121-fee5-4437-a865-fa7fa10f23b3 req-0da3d9d3-18a9-4425-8ec4-17a32176f0fc tempest-LiveAutoBlockMigrationV225Test-1737821182 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3338b79e-f1f2-4a40-a449-d821ab32db3e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '3338b79e-f1f2-4a40-a449-d821ab32db3e', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:53:45.670626 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-b21d1121-fee5-4437-a865-fa7fa10f23b3 req-0da3d9d3-18a9-4425-8ec4-17a32176f0fc tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Connection info returned from driver {'name': 'volumes/volume-3338b79e-f1f2-4a40-a449-d821ab32db3e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3338b79e-f1f2-4a40-a449-d821ab32db3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '860c1924-9381-4473-bf99-6c319e73f96a'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:53:45.728749 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-b21d1121-fee5-4437-a865-fa7fa10f23b3 req-0da3d9d3-18a9-4425-8ec4-17a32176f0fc tempest-LiveAutoBlockMigrationV225Test-1737821182 None] attachment_update completed successfully. Jan 29 20:53:45.769701 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-b1781744-b190-46ce-b1f6-ef820d8eade0 req-0157818d-9a34-432f-9a90-a3a97e46669c tempest-AttachVolumeNegativeTest-797842704 None] Terminate volume connection completed successfully. Jan 29 20:53:45.770264 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-b1781744-b190-46ce-b1f6-ef820d8eade0 req-0157818d-9a34-432f-9a90-a3a97e46669c tempest-AttachVolumeNegativeTest-797842704 None] Deleting attachment aaef680a-8dec-4c20-bdb8-826174ac8baf. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:53:46.940555 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-595fe252-b69f-41f5-9e4a-7d7a85fe20f9 tempest-AttachVolumeNegativeTest-797842704 None] Lock "b'cinder-41b54bf5-c6b9-44e8-bdcc-47059bf4601e-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:53:46.971782 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-595fe252-b69f-41f5-9e4a-7d7a85fe20f9 tempest-AttachVolumeNegativeTest-797842704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:53:47.008623 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-595fe252-b69f-41f5-9e4a-7d7a85fe20f9 tempest-AttachVolumeNegativeTest-797842704 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:53:47.009151 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-595fe252-b69f-41f5-9e4a-7d7a85fe20f9 tempest-AttachVolumeNegativeTest-797842704 None] Volume volume-41b54bf5-c6b9-44e8-bdcc-47059bf4601e is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:53:47.014234 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-595fe252-b69f-41f5-9e4a-7d7a85fe20f9 tempest-AttachVolumeNegativeTest-797842704 None] deleting rbd volume volume-41b54bf5-c6b9-44e8-bdcc-47059bf4601e {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:53:47.216926 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-595fe252-b69f-41f5-9e4a-7d7a85fe20f9 tempest-AttachVolumeNegativeTest-797842704 None] Created reservations ['ef80683b-b02b-4603-9ffd-808d7f7e4a20', '78790655-d192-4dbf-bf35-425c437df806', 'bafb2519-0e40-48cd-885b-f65ad14ed563', 'e074d2e7-2d26-4382-8655-a63f31019cba'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:53:47.261600 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-595fe252-b69f-41f5-9e4a-7d7a85fe20f9 tempest-AttachVolumeNegativeTest-797842704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:53:47.284504 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-595fe252-b69f-41f5-9e4a-7d7a85fe20f9 tempest-AttachVolumeNegativeTest-797842704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:53:47.306914 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-595fe252-b69f-41f5-9e4a-7d7a85fe20f9 tempest-AttachVolumeNegativeTest-797842704 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:53:47.311186 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-595fe252-b69f-41f5-9e4a-7d7a85fe20f9 tempest-AttachVolumeNegativeTest-797842704 None] Deleted volume successfully. Jan 29 20:53:47.324051 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-595fe252-b69f-41f5-9e4a-7d7a85fe20f9 tempest-AttachVolumeNegativeTest-797842704 None] Lock "b'cinder-41b54bf5-c6b9-44e8-bdcc-47059bf4601e-delete_volume'" released by "delete_volume" :: held 0.384s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:53:53.083729 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-74b45b0a-1d6c-4fbb-af1e-7c8fbe15c32f tempest-AttachVolumeNegativeTest-797842704 None] Lock "b'cinder-ef59658d-41bf-47d8-a839-a18c04f15d92-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:53:53.125543 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-74b45b0a-1d6c-4fbb-af1e-7c8fbe15c32f tempest-AttachVolumeNegativeTest-797842704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:53:53.174490 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-74b45b0a-1d6c-4fbb-af1e-7c8fbe15c32f tempest-AttachVolumeNegativeTest-797842704 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:53:53.174915 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-74b45b0a-1d6c-4fbb-af1e-7c8fbe15c32f tempest-AttachVolumeNegativeTest-797842704 None] Volume volume-ef59658d-41bf-47d8-a839-a18c04f15d92 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:53:53.188607 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-74b45b0a-1d6c-4fbb-af1e-7c8fbe15c32f tempest-AttachVolumeNegativeTest-797842704 None] deleting rbd volume volume-ef59658d-41bf-47d8-a839-a18c04f15d92 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:53:53.490990 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-74b45b0a-1d6c-4fbb-af1e-7c8fbe15c32f tempest-AttachVolumeNegativeTest-797842704 None] Created reservations ['95edb864-d7a9-4253-ade6-406eae531ff7', 'd15d9dc5-7a38-4efc-9790-ab595d61c270', 'a884ebc0-326a-4284-aa1e-8424a8242430', 'e12844de-5f78-461b-af44-95e0335e06a8'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:53:53.535806 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-74b45b0a-1d6c-4fbb-af1e-7c8fbe15c32f tempest-AttachVolumeNegativeTest-797842704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:53:53.563609 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-74b45b0a-1d6c-4fbb-af1e-7c8fbe15c32f tempest-AttachVolumeNegativeTest-797842704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:53:53.588031 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-74b45b0a-1d6c-4fbb-af1e-7c8fbe15c32f tempest-AttachVolumeNegativeTest-797842704 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:53:53.597563 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-74b45b0a-1d6c-4fbb-af1e-7c8fbe15c32f tempest-AttachVolumeNegativeTest-797842704 None] Deleted volume successfully. Jan 29 20:53:53.609321 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-74b45b0a-1d6c-4fbb-af1e-7c8fbe15c32f tempest-AttachVolumeNegativeTest-797842704 None] Lock "b'cinder-ef59658d-41bf-47d8-a839-a18c04f15d92-delete_volume'" released by "delete_volume" :: held 0.526s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:53:55.552285 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:53:55.557409 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:53:55.557886 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:53:55.580391 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Flow 'volume_create_manager' (a0bd072c-ca91-488f-82f1-96cfa103f8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:53:55.587517 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96003720-5d6c-4feb-a064-cae88a8cc536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:55.594671 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:53:55.609462 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96003720-5d6c-4feb-a064-cae88a8cc536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1727886706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b733f2d8-6194-4e18-bbb4-55db84afbbe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3b71f9bda245f89384d15b7d991443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:53:56Z,use_quota=True,user_id='e706c73f10ad41b0988463c31f9c7999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:55.615791 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c421f9b-f305-4698-8f6b-ea4548a95a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:55.620678 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c421f9b-f305-4698-8f6b-ea4548a95a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:55.625945 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984038a3-0282-413b-a606-1447ba8acbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:55.631002 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984038a3-0282-413b-a606-1447ba8acbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b733f2d8-6194-4e18-bbb4-55db84afbbe9', 'volume_name': 'volume-b733f2d8-6194-4e18-bbb4-55db84afbbe9', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:55.636311 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1426ab56-3720-40b8-80c0-fd19805f3bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:55.640844 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1426ab56-3720-40b8-80c0-fd19805f3bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:55.646388 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bb77be-8505-4150-8b04-2ab44000dea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:55.647536 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Volume b733f2d8-6194-4e18-bbb4-55db84afbbe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b733f2d8-6194-4e18-bbb4-55db84afbbe9', 'volume_size': 1} Jan 29 20:53:55.647958 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] creating volume 'volume-b733f2d8-6194-4e18-bbb4-55db84afbbe9' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:53:55.649035 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:53:55.712413 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:53:55.712915 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:53:55.716743 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bb77be-8505-4150-8b04-2ab44000dea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b733f2d8-6194-4e18-bbb4-55db84afbbe9', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:55.722221 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb502e5f-d842-495e-bb87-4a0f8f1f8297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:53:55.734679 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Volume volume-b733f2d8-6194-4e18-bbb4-55db84afbbe9 (b733f2d8-6194-4e18-bbb4-55db84afbbe9): created successfully Jan 29 20:53:55.740770 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb502e5f-d842-495e-bb87-4a0f8f1f8297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:53:55.747008 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Flow 'volume_create_manager' (a0bd072c-ca91-488f-82f1-96cfa103f8f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:53:55.757201 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-2c3754e4-8d9c-4644-97f5-7d949e409e64 tempest-ServerRescueNegativeTestJSON-890494202 None] Created volume successfully. Jan 29 20:53:57.959941 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-7a060b55-1507-4728-9d04-1f94c4987815 req-ea2e757b-6273-4b06-94ab-b3659db825fe tempest-ServerRescueNegativeTestJSON-890494202 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:53:58.641158 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-7a060b55-1507-4728-9d04-1f94c4987815 req-ea2e757b-6273-4b06-94ab-b3659db825fe tempest-ServerRescueNegativeTestJSON-890494202 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.681s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:53:58.642021 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-7a060b55-1507-4728-9d04-1f94c4987815 req-ea2e757b-6273-4b06-94ab-b3659db825fe tempest-ServerRescueNegativeTestJSON-890494202 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b733f2d8-6194-4e18-bbb4-55db84afbbe9', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'b733f2d8-6194-4e18-bbb4-55db84afbbe9', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:53:58.688275 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-7a060b55-1507-4728-9d04-1f94c4987815 req-ea2e757b-6273-4b06-94ab-b3659db825fe tempest-ServerRescueNegativeTestJSON-890494202 None] Connection info returned from driver {'name': 'volumes/volume-b733f2d8-6194-4e18-bbb4-55db84afbbe9', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b733f2d8-6194-4e18-bbb4-55db84afbbe9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a70eb47c-7c4c-4ff9-bc60-a056df2c0fef'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:53:58.745050 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-7a060b55-1507-4728-9d04-1f94c4987815 req-ea2e757b-6273-4b06-94ab-b3659db825fe tempest-ServerRescueNegativeTestJSON-890494202 None] attachment_update completed successfully. Jan 29 20:54:03.819448 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-0d5b86ed-936a-41f6-b4a6-d05230c7a146 tempest-AttachVolumeNegativeTest-797842704 None] Lock "b'cinder-6c560ce9-ca43-42d1-be95-bbfd958bfa47-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:54:03.860547 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0d5b86ed-936a-41f6-b4a6-d05230c7a146 tempest-AttachVolumeNegativeTest-797842704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:03.913393 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0d5b86ed-936a-41f6-b4a6-d05230c7a146 tempest-AttachVolumeNegativeTest-797842704 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:54:03.914908 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0d5b86ed-936a-41f6-b4a6-d05230c7a146 tempest-AttachVolumeNegativeTest-797842704 None] Volume volume-6c560ce9-ca43-42d1-be95-bbfd958bfa47 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:54:03.925371 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0d5b86ed-936a-41f6-b4a6-d05230c7a146 tempest-AttachVolumeNegativeTest-797842704 None] deleting rbd volume volume-6c560ce9-ca43-42d1-be95-bbfd958bfa47 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:54:04.164371 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-0d5b86ed-936a-41f6-b4a6-d05230c7a146 tempest-AttachVolumeNegativeTest-797842704 None] Created reservations ['1c4004e9-60c4-4200-a614-0aac07fcfe1e', '0a00c2b4-9ac1-473a-af7f-4395e95e4098', '5024bae5-5f34-4970-bdc4-13b3dfe33bf1', 'c25b4049-df91-442e-9ee1-1ca036d86c37'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:54:04.205870 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0d5b86ed-936a-41f6-b4a6-d05230c7a146 tempest-AttachVolumeNegativeTest-797842704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:04.239509 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0d5b86ed-936a-41f6-b4a6-d05230c7a146 tempest-AttachVolumeNegativeTest-797842704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:04.276104 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-0d5b86ed-936a-41f6-b4a6-d05230c7a146 tempest-AttachVolumeNegativeTest-797842704 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:54:04.280642 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-0d5b86ed-936a-41f6-b4a6-d05230c7a146 tempest-AttachVolumeNegativeTest-797842704 None] Deleted volume successfully. Jan 29 20:54:04.297520 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-0d5b86ed-936a-41f6-b4a6-d05230c7a146 tempest-AttachVolumeNegativeTest-797842704 None] Lock "b'cinder-6c560ce9-ca43-42d1-be95-bbfd958bfa47-delete_volume'" released by "delete_volume" :: held 0.478s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:54:10.834948 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:54:10.839268 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:54:10.839762 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:54:10.880944 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Flow 'volume_create_manager' (da640750-3bc3-494a-a90e-bccc82dda436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:54:10.892866 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be733e55-798c-461f-81b7-cf54fd0f0c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:54:10.899841 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:54:10.919377 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be733e55-798c-461f-81b7-cf54fd0f0c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-566123319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=28491c2f-2836-4671-8ead-e8f1ff237637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e406424c79d4704893643377dbf6844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:54:11Z,use_quota=True,user_id='939a324e0af9496a95c46af157201ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:54:10.926374 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8647dd-20b8-4ab7-9008-f7e0c8f6f9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:54:10.931226 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8647dd-20b8-4ab7-9008-f7e0c8f6f9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:54:10.936974 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60837e58-d73d-4ba7-b2ef-fb48f51c1260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:54:10.944442 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60837e58-d73d-4ba7-b2ef-fb48f51c1260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28491c2f-2836-4671-8ead-e8f1ff237637', 'volume_name': 'volume-28491c2f-2836-4671-8ead-e8f1ff237637', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:54:10.949424 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2252d3-7703-4528-b607-d0bd545c9079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:54:10.953640 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2252d3-7703-4528-b607-d0bd545c9079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:54:10.958342 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e20eb01-d82e-4d48-b058-48d835d764f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:54:10.959424 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Volume 28491c2f-2836-4671-8ead-e8f1ff237637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28491c2f-2836-4671-8ead-e8f1ff237637', 'volume_size': 1} Jan 29 20:54:10.959817 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] creating volume 'volume-28491c2f-2836-4671-8ead-e8f1ff237637' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:54:10.960802 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:11.026187 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:54:11.026567 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:54:11.030393 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e20eb01-d82e-4d48-b058-48d835d764f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28491c2f-2836-4671-8ead-e8f1ff237637', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:54:11.035909 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2784b75f-3d3d-4ebe-8640-7aaebbaae422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:54:11.044998 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Volume volume-28491c2f-2836-4671-8ead-e8f1ff237637 (28491c2f-2836-4671-8ead-e8f1ff237637): created successfully Jan 29 20:54:11.048851 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2784b75f-3d3d-4ebe-8640-7aaebbaae422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:54:11.054453 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Flow 'volume_create_manager' (da640750-3bc3-494a-a90e-bccc82dda436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:54:11.062586 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-96ad8423-9c89-4f00-b179-df576fc6f696 req-a0be3518-5133-471a-938e-1e19ac11a89a tempest-VolumesSnapshotsTestJSON-361155042 None] Created volume successfully. Jan 29 20:54:11.484826 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-ac07d5f0-e2e5-47cb-bfed-0e82c6f83e6c req-d37d1136-d218-425b-9651-c279fc4c9175 tempest-VolumesSnapshotsTestJSON-361155042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:12.365675 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-ac07d5f0-e2e5-47cb-bfed-0e82c6f83e6c req-d37d1136-d218-425b-9651-c279fc4c9175 tempest-VolumesSnapshotsTestJSON-361155042 None] Create snapshot completed successfully Jan 29 20:54:12.719215 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-67962aff-1387-436c-9a67-323794af7869 req-68d18216-a362-43cb-93f7-d439d0f1f1b5 tempest-VolumesSnapshotsTestJSON-361155042 None] Lock "b'cinder-42b6d806-7e4c-4a28-94dc-a3d22836e9a3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:54:12.721355 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-67962aff-1387-436c-9a67-323794af7869 req-68d18216-a362-43cb-93f7-d439d0f1f1b5 tempest-VolumesSnapshotsTestJSON-361155042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:13.366414 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [req-67962aff-1387-436c-9a67-323794af7869 req-68d18216-a362-43cb-93f7-d439d0f1f1b5 tempest-VolumesSnapshotsTestJSON-361155042 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Jan 29 20:54:13.380657 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [req-67962aff-1387-436c-9a67-323794af7869 req-68d18216-a362-43cb-93f7-d439d0f1f1b5 tempest-VolumesSnapshotsTestJSON-361155042 None] Created reservations ['41279b6d-0d95-4c86-ac5b-810b6f1bf4f8', '58ccb06c-0041-4ec1-b351-b696453696b6', '3e41adcf-f619-4448-9f96-cdedec53be0b', '371eba2d-4ab8-48a8-8778-ef11bd226fdf'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:54:13.426548 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-67962aff-1387-436c-9a67-323794af7869 req-68d18216-a362-43cb-93f7-d439d0f1f1b5 tempest-VolumesSnapshotsTestJSON-361155042 None] Delete snapshot completed successfully. Jan 29 20:54:13.431111 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-67962aff-1387-436c-9a67-323794af7869 req-68d18216-a362-43cb-93f7-d439d0f1f1b5 tempest-VolumesSnapshotsTestJSON-361155042 None] Lock "b'cinder-42b6d806-7e4c-4a28-94dc-a3d22836e9a3-delete_snapshot'" released by "delete_snapshot" :: held 0.712s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:54:13.872971 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-3cbfdfdd-494d-4c8c-b307-80bb830ef990 req-b64c7c3a-3b47-47d1-97cc-2521c44f4b40 tempest-VolumesSnapshotsTestJSON-361155042 None] Lock "b'cinder-28491c2f-2836-4671-8ead-e8f1ff237637-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:54:13.914539 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-3cbfdfdd-494d-4c8c-b307-80bb830ef990 req-b64c7c3a-3b47-47d1-97cc-2521c44f4b40 tempest-VolumesSnapshotsTestJSON-361155042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:13.953801 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-3cbfdfdd-494d-4c8c-b307-80bb830ef990 req-b64c7c3a-3b47-47d1-97cc-2521c44f4b40 tempest-VolumesSnapshotsTestJSON-361155042 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:54:13.954365 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-3cbfdfdd-494d-4c8c-b307-80bb830ef990 req-b64c7c3a-3b47-47d1-97cc-2521c44f4b40 tempest-VolumesSnapshotsTestJSON-361155042 None] Volume volume-28491c2f-2836-4671-8ead-e8f1ff237637 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:54:13.961497 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-3cbfdfdd-494d-4c8c-b307-80bb830ef990 req-b64c7c3a-3b47-47d1-97cc-2521c44f4b40 tempest-VolumesSnapshotsTestJSON-361155042 None] deleting rbd volume volume-28491c2f-2836-4671-8ead-e8f1ff237637 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:54:14.148818 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [req-3cbfdfdd-494d-4c8c-b307-80bb830ef990 req-b64c7c3a-3b47-47d1-97cc-2521c44f4b40 tempest-VolumesSnapshotsTestJSON-361155042 None] Created reservations ['0b64d4d2-e84c-48fb-8de0-46e35f4bb36e', '5337372d-2313-49bc-94f6-9b359e7c786d', '0cc54cc4-2b7b-4b60-a39e-bb1c7446a9ec', '30ba346a-87db-41ab-8291-42b0a24b2b57'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:54:14.203102 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-3cbfdfdd-494d-4c8c-b307-80bb830ef990 req-b64c7c3a-3b47-47d1-97cc-2521c44f4b40 tempest-VolumesSnapshotsTestJSON-361155042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:14.230195 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-3cbfdfdd-494d-4c8c-b307-80bb830ef990 req-b64c7c3a-3b47-47d1-97cc-2521c44f4b40 tempest-VolumesSnapshotsTestJSON-361155042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:14.253901 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [req-3cbfdfdd-494d-4c8c-b307-80bb830ef990 req-b64c7c3a-3b47-47d1-97cc-2521c44f4b40 tempest-VolumesSnapshotsTestJSON-361155042 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:54:14.258189 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-3cbfdfdd-494d-4c8c-b307-80bb830ef990 req-b64c7c3a-3b47-47d1-97cc-2521c44f4b40 tempest-VolumesSnapshotsTestJSON-361155042 None] Deleted volume successfully. Jan 29 20:54:14.271117 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-3cbfdfdd-494d-4c8c-b307-80bb830ef990 req-b64c7c3a-3b47-47d1-97cc-2521c44f4b40 tempest-VolumesSnapshotsTestJSON-361155042 None] Lock "b'cinder-28491c2f-2836-4671-8ead-e8f1ff237637-delete_volume'" released by "delete_volume" :: held 0.398s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:54:22.805278 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-3aa25570-655a-496f-95a8-d101a58a5bf7 req-2672224d-48ec-4585-a5dc-7047b08fa8eb tempest-LiveAutoBlockMigrationV225Test-2050705350 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:54:24.199390 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-3aa25570-655a-496f-95a8-d101a58a5bf7 req-2672224d-48ec-4585-a5dc-7047b08fa8eb tempest-LiveAutoBlockMigrationV225Test-2050705350 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.400s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:54:24.200206 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-3aa25570-655a-496f-95a8-d101a58a5bf7 req-2672224d-48ec-4585-a5dc-7047b08fa8eb tempest-LiveAutoBlockMigrationV225Test-2050705350 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3338b79e-f1f2-4a40-a449-d821ab32db3e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '3338b79e-f1f2-4a40-a449-d821ab32db3e', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:54:24.226152 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-3aa25570-655a-496f-95a8-d101a58a5bf7 req-2672224d-48ec-4585-a5dc-7047b08fa8eb tempest-LiveAutoBlockMigrationV225Test-2050705350 None] Connection info returned from driver {'name': 'volumes/volume-3338b79e-f1f2-4a40-a449-d821ab32db3e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3338b79e-f1f2-4a40-a449-d821ab32db3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e1ea74e9-2f21-441a-abc7-6abe69b7cbed'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:54:24.331843 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-3aa25570-655a-496f-95a8-d101a58a5bf7 req-2672224d-48ec-4585-a5dc-7047b08fa8eb tempest-LiveAutoBlockMigrationV225Test-2050705350 None] attachment_update completed successfully. Jan 29 20:54:28.637340 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:54:28.638265 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:28.664336 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:28.695854 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:54:42.495519 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-bd548cf7-d989-4aa7-9025-ff74051bec58 req-cf692c23-eea8-4db3-837f-314946088dff tempest-ServerRescueNegativeTestJSON-890494202 None] Terminate volume connection completed successfully. Jan 29 20:54:42.496171 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-bd548cf7-d989-4aa7-9025-ff74051bec58 req-cf692c23-eea8-4db3-837f-314946088dff tempest-ServerRescueNegativeTestJSON-890494202 None] Deleting attachment a70eb47c-7c4c-4ff9-bc60-a056df2c0fef. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:54:42.982227 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-4fb8aaa4-9bf8-406d-8bcf-fd05104706c4 tempest-ServerRescueNegativeTestJSON-890494202 None] Lock "b'cinder-b733f2d8-6194-4e18-bbb4-55db84afbbe9-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:54:43.018472 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4fb8aaa4-9bf8-406d-8bcf-fd05104706c4 tempest-ServerRescueNegativeTestJSON-890494202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:43.060918 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4fb8aaa4-9bf8-406d-8bcf-fd05104706c4 tempest-ServerRescueNegativeTestJSON-890494202 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:54:43.061391 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4fb8aaa4-9bf8-406d-8bcf-fd05104706c4 tempest-ServerRescueNegativeTestJSON-890494202 None] Volume volume-b733f2d8-6194-4e18-bbb4-55db84afbbe9 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:54:43.068251 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4fb8aaa4-9bf8-406d-8bcf-fd05104706c4 tempest-ServerRescueNegativeTestJSON-890494202 None] deleting rbd volume volume-b733f2d8-6194-4e18-bbb4-55db84afbbe9 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:54:43.296833 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-4fb8aaa4-9bf8-406d-8bcf-fd05104706c4 tempest-ServerRescueNegativeTestJSON-890494202 None] Created reservations ['9f5c8792-bef5-4185-8259-085162874af7', 'c7baccec-62ed-4f97-9eab-9b0e8cc79d85', '17f29797-5b86-4653-b86d-337a3e65eb31', 'b0b552e0-16d4-4452-9829-38c2f697d281'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:54:43.341600 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4fb8aaa4-9bf8-406d-8bcf-fd05104706c4 tempest-ServerRescueNegativeTestJSON-890494202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:43.375315 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4fb8aaa4-9bf8-406d-8bcf-fd05104706c4 tempest-ServerRescueNegativeTestJSON-890494202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:43.401448 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-4fb8aaa4-9bf8-406d-8bcf-fd05104706c4 tempest-ServerRescueNegativeTestJSON-890494202 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:54:43.406007 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4fb8aaa4-9bf8-406d-8bcf-fd05104706c4 tempest-ServerRescueNegativeTestJSON-890494202 None] Deleted volume successfully. Jan 29 20:54:43.419557 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-4fb8aaa4-9bf8-406d-8bcf-fd05104706c4 tempest-ServerRescueNegativeTestJSON-890494202 None] Lock "b'cinder-b733f2d8-6194-4e18-bbb4-55db84afbbe9-delete_volume'" released by "delete_volume" :: held 0.437s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:54:44.102792 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-d0bacab8-498f-4769-b82d-6d68379d856f tempest-ServerRescueNegativeTestJSON-890494202 None] Lock "b'cinder-3fb4f9ee-4003-41af-9a26-4ac9c7192ea0-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:54:44.145700 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d0bacab8-498f-4769-b82d-6d68379d856f tempest-ServerRescueNegativeTestJSON-890494202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:44.189696 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d0bacab8-498f-4769-b82d-6d68379d856f tempest-ServerRescueNegativeTestJSON-890494202 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:54:44.190224 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d0bacab8-498f-4769-b82d-6d68379d856f tempest-ServerRescueNegativeTestJSON-890494202 None] Volume volume-3fb4f9ee-4003-41af-9a26-4ac9c7192ea0 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:54:44.198022 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d0bacab8-498f-4769-b82d-6d68379d856f tempest-ServerRescueNegativeTestJSON-890494202 None] deleting rbd volume volume-3fb4f9ee-4003-41af-9a26-4ac9c7192ea0 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:54:44.424723 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-d0bacab8-498f-4769-b82d-6d68379d856f tempest-ServerRescueNegativeTestJSON-890494202 None] Created reservations ['ca8c2251-b1c7-4430-b93f-38c12627e2f0', '8d26fb5b-631e-442b-a099-4bee02025424', '768b517f-a348-45d7-ba9f-aeccea8133ab', '9d02e38b-edc9-4fdb-9e1b-374f8dae21e0'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:54:44.466128 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d0bacab8-498f-4769-b82d-6d68379d856f tempest-ServerRescueNegativeTestJSON-890494202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:44.491514 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d0bacab8-498f-4769-b82d-6d68379d856f tempest-ServerRescueNegativeTestJSON-890494202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:54:44.517996 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-d0bacab8-498f-4769-b82d-6d68379d856f tempest-ServerRescueNegativeTestJSON-890494202 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:54:44.522106 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d0bacab8-498f-4769-b82d-6d68379d856f tempest-ServerRescueNegativeTestJSON-890494202 None] Deleted volume successfully. Jan 29 20:54:44.534811 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-d0bacab8-498f-4769-b82d-6d68379d856f tempest-ServerRescueNegativeTestJSON-890494202 None] Lock "b'cinder-3fb4f9ee-4003-41af-9a26-4ac9c7192ea0-delete_volume'" released by "delete_volume" :: held 0.432s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:55:01.045333 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-5c78bf10-3071-4a9d-b809-d28026500dba req-99dbcbfc-abe1-499a-87d7-8b68f3bdad00 tempest-DeleteServersTestJSON-1517781922 None] Terminate volume connection completed successfully. Jan 29 20:55:01.046427 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-5c78bf10-3071-4a9d-b809-d28026500dba req-99dbcbfc-abe1-499a-87d7-8b68f3bdad00 tempest-DeleteServersTestJSON-1517781922 None] Deleting attachment d5a294f4-d771-4c96-bbbb-d93f37bd088c. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:55:03.026352 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-339df59c-6f06-4e9b-a5b5-c96e92a6f71b req-b00fc3d1-0091-49c3-ac42-72e57895f6a3 tempest-VolumesAdminNegativeTest-1930665067 None] Terminate volume connection completed successfully. Jan 29 20:55:03.030959 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-339df59c-6f06-4e9b-a5b5-c96e92a6f71b req-b00fc3d1-0091-49c3-ac42-72e57895f6a3 tempest-VolumesAdminNegativeTest-1930665067 None] Deleting attachment 91f6c124-d742-47ae-a887-59f1a9a959b9. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:55:04.146445 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:55:04.155359 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:55:04.156561 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:55:04.198175 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Flow 'volume_create_manager' (3081d014-71de-4cb9-8228-084cf0d073de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:55:04.206501 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588b10fa-3ba5-49be-9a05-5ba97f7f80d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:55:04.227054 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:55:04.248334 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588b10fa-3ba5-49be-9a05-5ba97f7f80d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1386373715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a76b3548-ec3a-458f-b2b4-344b147fa123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975def1272564604bcc0759fc1d44fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:55:04Z,use_quota=True,user_id='d85c81f05a1f4ce397a1dbf051dc07de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:55:04.254900 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde3ad6b-e86d-4077-8127-856af1370841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:55:04.260111 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde3ad6b-e86d-4077-8127-856af1370841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:55:04.265998 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a394fea-9427-49be-8735-bfc7d0832431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:55:04.271315 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a394fea-9427-49be-8735-bfc7d0832431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a76b3548-ec3a-458f-b2b4-344b147fa123', 'volume_name': 'volume-a76b3548-ec3a-458f-b2b4-344b147fa123', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:55:04.278514 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8901edc5-35c6-4b71-b1c1-40eb972f26b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:55:04.283686 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8901edc5-35c6-4b71-b1c1-40eb972f26b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:55:04.288831 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d76fcb6-fa2d-4b49-9c3f-0d1df09068e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:55:04.290230 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Volume a76b3548-ec3a-458f-b2b4-344b147fa123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a76b3548-ec3a-458f-b2b4-344b147fa123', 'volume_size': 1} Jan 29 20:55:04.290827 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] creating volume 'volume-a76b3548-ec3a-458f-b2b4-344b147fa123' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:55:04.292013 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:55:04.395971 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:55:04.396455 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:55:04.400806 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d76fcb6-fa2d-4b49-9c3f-0d1df09068e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a76b3548-ec3a-458f-b2b4-344b147fa123', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:55:04.406659 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40820315-e90f-4783-9d34-41268e0958bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:55:04.419832 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Volume volume-a76b3548-ec3a-458f-b2b4-344b147fa123 (a76b3548-ec3a-458f-b2b4-344b147fa123): created successfully Jan 29 20:55:04.427117 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40820315-e90f-4783-9d34-41268e0958bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:55:04.436722 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Flow 'volume_create_manager' (3081d014-71de-4cb9-8228-084cf0d073de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:55:04.457223 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-b5e3d120-8a6c-45ce-87a1-9e7ccb0bdf13 tempest-VolumesAdminNegativeTest-1930665067 None] Created volume successfully. Jan 29 20:55:05.468060 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-485fa6ca-3e7c-4496-9d6c-ee744c96b93e tempest-VolumesAdminNegativeTest-1930665067 None] Lock "b'cinder-a76b3548-ec3a-458f-b2b4-344b147fa123-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:55:05.547457 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-485fa6ca-3e7c-4496-9d6c-ee744c96b93e tempest-VolumesAdminNegativeTest-1930665067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:55:05.642306 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-485fa6ca-3e7c-4496-9d6c-ee744c96b93e tempest-VolumesAdminNegativeTest-1930665067 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:55:05.642754 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-485fa6ca-3e7c-4496-9d6c-ee744c96b93e tempest-VolumesAdminNegativeTest-1930665067 None] Volume volume-a76b3548-ec3a-458f-b2b4-344b147fa123 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:55:05.659234 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-485fa6ca-3e7c-4496-9d6c-ee744c96b93e tempest-VolumesAdminNegativeTest-1930665067 None] deleting rbd volume volume-a76b3548-ec3a-458f-b2b4-344b147fa123 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:55:06.051239 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-485fa6ca-3e7c-4496-9d6c-ee744c96b93e tempest-VolumesAdminNegativeTest-1930665067 None] Created reservations ['f5dd95a8-a9a2-4089-afee-fae71a15445a', '5d403e03-4a39-4e71-b88f-3bb93ba5d4ee', '127e2fd6-1e37-45d3-add7-ed9551f0b68c', 'e9b493b9-5f58-4416-ba2b-b58be2caa284'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:55:06.154292 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-485fa6ca-3e7c-4496-9d6c-ee744c96b93e tempest-VolumesAdminNegativeTest-1930665067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:55:06.215130 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-485fa6ca-3e7c-4496-9d6c-ee744c96b93e tempest-VolumesAdminNegativeTest-1930665067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:55:06.265733 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-485fa6ca-3e7c-4496-9d6c-ee744c96b93e tempest-VolumesAdminNegativeTest-1930665067 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:55:06.273771 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-485fa6ca-3e7c-4496-9d6c-ee744c96b93e tempest-VolumesAdminNegativeTest-1930665067 None] Deleted volume successfully. Jan 29 20:55:06.300146 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-485fa6ca-3e7c-4496-9d6c-ee744c96b93e tempest-VolumesAdminNegativeTest-1930665067 None] Lock "b'cinder-a76b3548-ec3a-458f-b2b4-344b147fa123-delete_volume'" released by "delete_volume" :: held 0.834s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:55:06.643793 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e98fb16a-345c-4a4c-b489-0504f0d12a15 tempest-VolumesAdminNegativeTest-1930665067 None] Lock "b'cinder-cba11deb-d106-470d-9716-98b046d7dece-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:55:06.707201 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e98fb16a-345c-4a4c-b489-0504f0d12a15 tempest-VolumesAdminNegativeTest-1930665067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:55:06.773275 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e98fb16a-345c-4a4c-b489-0504f0d12a15 tempest-VolumesAdminNegativeTest-1930665067 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:55:06.773688 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e98fb16a-345c-4a4c-b489-0504f0d12a15 tempest-VolumesAdminNegativeTest-1930665067 None] Volume volume-cba11deb-d106-470d-9716-98b046d7dece is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:55:06.787221 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e98fb16a-345c-4a4c-b489-0504f0d12a15 tempest-VolumesAdminNegativeTest-1930665067 None] deleting rbd volume volume-cba11deb-d106-470d-9716-98b046d7dece {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:55:07.109243 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-e98fb16a-345c-4a4c-b489-0504f0d12a15 tempest-VolumesAdminNegativeTest-1930665067 None] Created reservations ['bbae21d8-f56c-484a-beec-9307965306ce', 'fa4bba8b-7be5-43b1-a9a8-3acd76f4b1ab', 'e9e866f3-a69d-444a-89b3-515af2a225d6', 'cf02f677-0e22-4bf0-a5cf-da3472f459ad'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:55:07.204809 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e98fb16a-345c-4a4c-b489-0504f0d12a15 tempest-VolumesAdminNegativeTest-1930665067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:55:07.312949 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e98fb16a-345c-4a4c-b489-0504f0d12a15 tempest-VolumesAdminNegativeTest-1930665067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:55:07.408869 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e98fb16a-345c-4a4c-b489-0504f0d12a15 tempest-VolumesAdminNegativeTest-1930665067 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:55:07.414118 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e98fb16a-345c-4a4c-b489-0504f0d12a15 tempest-VolumesAdminNegativeTest-1930665067 None] Deleted volume successfully. Jan 29 20:55:07.437523 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e98fb16a-345c-4a4c-b489-0504f0d12a15 tempest-VolumesAdminNegativeTest-1930665067 None] Lock "b'cinder-cba11deb-d106-470d-9716-98b046d7dece-delete_volume'" released by "delete_volume" :: held 0.793s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:55:12.780577 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-3aa25570-655a-496f-95a8-d101a58a5bf7 req-8124bcf9-ad39-42ab-9fb9-5d50fe96fe8a tempest-LiveAutoBlockMigrationV225Test-2050705350 None] Terminate volume connection completed successfully. Jan 29 20:55:12.781780 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-3aa25570-655a-496f-95a8-d101a58a5bf7 req-8124bcf9-ad39-42ab-9fb9-5d50fe96fe8a tempest-LiveAutoBlockMigrationV225Test-2050705350 None] Deleting attachment 860c1924-9381-4473-bf99-6c319e73f96a. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:55:20.087263 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-652e390d-59e3-4e72-9bf5-c5001d351753 req-327c9327-ff69-40d6-9978-ec5201352a98 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Terminate volume connection completed successfully. Jan 29 20:55:20.089709 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-652e390d-59e3-4e72-9bf5-c5001d351753 req-327c9327-ff69-40d6-9978-ec5201352a98 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Deleting attachment e1ea74e9-2f21-441a-abc7-6abe69b7cbed. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:55:21.660447 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:55:21.671092 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:55:21.671691 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:55:21.695199 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Flow 'volume_create_manager' (319445a6-6dd9-4755-b9b0-9e06e9be58ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:55:21.703814 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c8d1c2-8e15-4ec7-a27f-5345807c2518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:55:21.713071 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:55:21.729655 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c8d1c2-8e15-4ec7-a27f-5345807c2518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1762698332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8eda1e64-86ba-46a5-aebf-7b4f1e362b3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fda3cc2fcff4f2688703cd45b2e6f68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:55:22Z,use_quota=True,user_id='34b5a574719a408db430136c8eea7e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:55:21.736028 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b2ef8b-995e-467e-9b42-6644375abefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:55:21.741478 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b2ef8b-995e-467e-9b42-6644375abefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:55:21.756292 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0024097b-3ae7-46af-911c-5f837097fb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:55:21.921563 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0024097b-3ae7-46af-911c-5f837097fb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8eda1e64-86ba-46a5-aebf-7b4f1e362b3f', 'volume_name': 'volume-8eda1e64-86ba-46a5-aebf-7b4f1e362b3f', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:55:21.930543 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01bc8c25-c3c4-4700-bdb3-e55e6221f292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:55:21.937035 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01bc8c25-c3c4-4700-bdb3-e55e6221f292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:55:21.957274 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33062f5e-0e13-4e21-8f26-eaac9c24920e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:55:21.958716 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Volume 8eda1e64-86ba-46a5-aebf-7b4f1e362b3f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8eda1e64-86ba-46a5-aebf-7b4f1e362b3f', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 20:55:21.959620 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Cloning 8eda1e64-86ba-46a5-aebf-7b4f1e362b3f from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 20:55:21.979878 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.019s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:55:22.004421 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 20, 55, 21, 990837)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 20:55:22.005507 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 20:55:22.008290 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Found cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 29 20:55:22.019459 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 0.040s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:55:22.022910 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 20:55:22.036746 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 20, 55, 22, 31381)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 20:55:22.044087 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 20:55:22.045008 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Creating from source image-volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 29 20:55:22.073489 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:55:22.206721 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] creating snapshot='volume-8eda1e64-86ba-46a5-aebf-7b4f1e362b3f.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 20:55:22.441786 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] cloning 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe@volume-8eda1e64-86ba-46a5-aebf-7b4f1e362b3f.clone_snap' to 'volume-8eda1e64-86ba-46a5-aebf-7b4f1e362b3f' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 20:55:22.681423 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:55:22.683318 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:55:22.683737 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:55:22.719120 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 20:55:22.729594 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Marking volume 8eda1e64-86ba-46a5-aebf-7b4f1e362b3f as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 20:55:22.744919 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to 8eda1e64-86ba-46a5-aebf-7b4f1e362b3f. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 20:55:22.745380 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Creating volume glance metadata for volume 8eda1e64-86ba-46a5-aebf-7b4f1e362b3f backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 20:55:22.852256 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33062f5e-0e13-4e21-8f26-eaac9c24920e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eda1e64-86ba-46a5-aebf-7b4f1e362b3f', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:55:22.859001 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988327d6-83cc-4413-9edb-93e528d0dfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:55:22.886532 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Volume volume-8eda1e64-86ba-46a5-aebf-7b4f1e362b3f (8eda1e64-86ba-46a5-aebf-7b4f1e362b3f): created successfully Jan 29 20:55:22.897985 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988327d6-83cc-4413-9edb-93e528d0dfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:55:22.911349 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Flow 'volume_create_manager' (319445a6-6dd9-4755-b9b0-9e06e9be58ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:55:22.934915 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-bee05fc6-ef97-4e1d-9c2c-51b682a71e20 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Created volume successfully. Jan 29 20:55:28.528865 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-008b1e62-a41a-4cd5-b84c-4ae1502afca8 req-4347b1ba-9043-4027-8909-721473ea53ef tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:55:28.644176 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:55:28.646729 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:55:28.725540 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:55:28.779425 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:55:29.665453 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-008b1e62-a41a-4cd5-b84c-4ae1502afca8 req-4347b1ba-9043-4027-8909-721473ea53ef tempest-LiveAutoBlockMigrationV225Test-1737821182 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.137s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:55:29.667488 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-008b1e62-a41a-4cd5-b84c-4ae1502afca8 req-4347b1ba-9043-4027-8909-721473ea53ef tempest-LiveAutoBlockMigrationV225Test-1737821182 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8eda1e64-86ba-46a5-aebf-7b4f1e362b3f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '8eda1e64-86ba-46a5-aebf-7b4f1e362b3f', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:55:29.703785 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-008b1e62-a41a-4cd5-b84c-4ae1502afca8 req-4347b1ba-9043-4027-8909-721473ea53ef tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Connection info returned from driver {'name': 'volumes/volume-8eda1e64-86ba-46a5-aebf-7b4f1e362b3f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8eda1e64-86ba-46a5-aebf-7b4f1e362b3f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '74fde226-e768-4df4-9670-314063c57573'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:55:29.823712 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-008b1e62-a41a-4cd5-b84c-4ae1502afca8 req-4347b1ba-9043-4027-8909-721473ea53ef tempest-LiveAutoBlockMigrationV225Test-1737821182 None] attachment_update completed successfully. Jan 29 20:55:54.494862 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-dccbe3ce-14df-4009-aaba-f576df8a6d76 req-2ed023ed-fb70-4ac5-a628-80ee835b91f1 tempest-LiveAutoBlockMigrationV225Test-2050705350 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:55:56.085155 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-dccbe3ce-14df-4009-aaba-f576df8a6d76 req-2ed023ed-fb70-4ac5-a628-80ee835b91f1 tempest-LiveAutoBlockMigrationV225Test-2050705350 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.591s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:55:56.086056 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-dccbe3ce-14df-4009-aaba-f576df8a6d76 req-2ed023ed-fb70-4ac5-a628-80ee835b91f1 tempest-LiveAutoBlockMigrationV225Test-2050705350 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8eda1e64-86ba-46a5-aebf-7b4f1e362b3f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '8eda1e64-86ba-46a5-aebf-7b4f1e362b3f', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:55:56.126291 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-dccbe3ce-14df-4009-aaba-f576df8a6d76 req-2ed023ed-fb70-4ac5-a628-80ee835b91f1 tempest-LiveAutoBlockMigrationV225Test-2050705350 None] Connection info returned from driver {'name': 'volumes/volume-8eda1e64-86ba-46a5-aebf-7b4f1e362b3f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8eda1e64-86ba-46a5-aebf-7b4f1e362b3f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7676dcef-2932-4440-8a26-d6fba2a73832'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:55:56.224727 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-dccbe3ce-14df-4009-aaba-f576df8a6d76 req-2ed023ed-fb70-4ac5-a628-80ee835b91f1 tempest-LiveAutoBlockMigrationV225Test-2050705350 None] attachment_update completed successfully. Jan 29 20:56:05.747636 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-dccbe3ce-14df-4009-aaba-f576df8a6d76 req-ec7bf132-12c4-43ae-a989-43c54a54f9d0 tempest-LiveAutoBlockMigrationV225Test-2050705350 None] Terminate volume connection completed successfully. Jan 29 20:56:05.753669 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-dccbe3ce-14df-4009-aaba-f576df8a6d76 req-ec7bf132-12c4-43ae-a989-43c54a54f9d0 tempest-LiveAutoBlockMigrationV225Test-2050705350 None] Deleting attachment 74fde226-e768-4df4-9670-314063c57573. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:56:14.308157 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-866797d0-503c-48ec-a2e2-0e5b0ce1945e req-e584aa83-1e42-4a46-8367-26c5008160b4 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Terminate volume connection completed successfully. Jan 29 20:56:14.308816 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-866797d0-503c-48ec-a2e2-0e5b0ce1945e req-e584aa83-1e42-4a46-8367-26c5008160b4 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Deleting attachment 7676dcef-2932-4440-8a26-d6fba2a73832. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:56:14.466556 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-866797d0-503c-48ec-a2e2-0e5b0ce1945e req-e2a4100b-8da8-4512-9d4b-867886653f57 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Lock "b'cinder-8eda1e64-86ba-46a5-aebf-7b4f1e362b3f-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:56:14.508328 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-866797d0-503c-48ec-a2e2-0e5b0ce1945e req-e2a4100b-8da8-4512-9d4b-867886653f57 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:14.613854 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-866797d0-503c-48ec-a2e2-0e5b0ce1945e req-e2a4100b-8da8-4512-9d4b-867886653f57 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:56:14.624011 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-866797d0-503c-48ec-a2e2-0e5b0ce1945e req-e2a4100b-8da8-4512-9d4b-867886653f57 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] deleting rbd volume volume-8eda1e64-86ba-46a5-aebf-7b4f1e362b3f {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:56:14.932395 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-52cddc95-f538-4b16-b3cb-08e13eb801c0 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Lock "b'cinder-3338b79e-f1f2-4a40-a449-d821ab32db3e-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:56:14.994435 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-52cddc95-f538-4b16-b3cb-08e13eb801c0 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:15.059702 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-52cddc95-f538-4b16-b3cb-08e13eb801c0 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:56:15.060153 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-52cddc95-f538-4b16-b3cb-08e13eb801c0 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Volume volume-3338b79e-f1f2-4a40-a449-d821ab32db3e is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:56:15.080087 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-52cddc95-f538-4b16-b3cb-08e13eb801c0 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] deleting rbd volume volume-3338b79e-f1f2-4a40-a449-d821ab32db3e {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:56:15.082280 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-866797d0-503c-48ec-a2e2-0e5b0ce1945e req-e2a4100b-8da8-4512-9d4b-867886653f57 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 20:56:15.128064 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-866797d0-503c-48ec-a2e2-0e5b0ce1945e req-e2a4100b-8da8-4512-9d4b-867886653f57 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] deleting parent snapshot volume-8eda1e64-86ba-46a5-aebf-7b4f1e362b3f.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 20:56:16.192086 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [req-866797d0-503c-48ec-a2e2-0e5b0ce1945e req-e2a4100b-8da8-4512-9d4b-867886653f57 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Created reservations ['df2eda07-4bcf-4835-89da-bd2d63a56496', '6c4a547c-7e14-4871-84ce-552e2c6d19a7', '459f3cbf-b49c-48f0-aa99-fb37aca8969e', '27b55bb5-485f-4110-a15b-942d68364ccc'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:56:16.231717 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-52cddc95-f538-4b16-b3cb-08e13eb801c0 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Created reservations ['054bfdaf-1594-4286-bf3e-c56ef5399d19', '6c0ec539-391b-41b7-89bb-01f4788b55e2', '307a9135-2024-4949-96dd-4222ff9617ba', '44a0978f-d16b-4aa0-8c33-bbcd89eef9b9'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:56:16.335333 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-52cddc95-f538-4b16-b3cb-08e13eb801c0 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:16.398016 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-52cddc95-f538-4b16-b3cb-08e13eb801c0 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:16.449029 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-52cddc95-f538-4b16-b3cb-08e13eb801c0 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:56:16.475174 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-52cddc95-f538-4b16-b3cb-08e13eb801c0 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Deleted volume successfully. Jan 29 20:56:16.525242 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-52cddc95-f538-4b16-b3cb-08e13eb801c0 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Lock "b'cinder-3338b79e-f1f2-4a40-a449-d821ab32db3e-delete_volume'" released by "delete_volume" :: held 1.593s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:56:16.530464 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-866797d0-503c-48ec-a2e2-0e5b0ce1945e req-e2a4100b-8da8-4512-9d4b-867886653f57 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:16.590533 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-866797d0-503c-48ec-a2e2-0e5b0ce1945e req-e2a4100b-8da8-4512-9d4b-867886653f57 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:16.660092 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [req-866797d0-503c-48ec-a2e2-0e5b0ce1945e req-e2a4100b-8da8-4512-9d4b-867886653f57 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:56:16.666559 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-866797d0-503c-48ec-a2e2-0e5b0ce1945e req-e2a4100b-8da8-4512-9d4b-867886653f57 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Deleted volume successfully. Jan 29 20:56:16.684859 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-866797d0-503c-48ec-a2e2-0e5b0ce1945e req-e2a4100b-8da8-4512-9d4b-867886653f57 tempest-LiveAutoBlockMigrationV225Test-1737821182 None] Lock "b'cinder-8eda1e64-86ba-46a5-aebf-7b4f1e362b3f-delete_volume'" released by "delete_volume" :: held 2.218s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:56:22.377817 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:56:22.383194 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:56:22.384087 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:56:22.405032 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Flow 'volume_create_manager' (8dd67b49-0a6e-4824-bc91-d59b49a6cf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:56:22.412109 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b965c299-905b-48b3-89c0-8771e960972d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:22.419367 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:56:22.435284 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b965c299-905b-48b3-89c0-8771e960972d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2074792594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=24b5480f-5237-4f1e-b5cd-970aef5d58fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35bf9ac53cc44d078c9ede28b5a4233d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:56:22Z,use_quota=True,user_id='8d9e046d9799432bacfba8fe040ce36f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:22.445499 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91b66c7-ee19-4088-ad4a-0567d10c083e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:22.450489 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91b66c7-ee19-4088-ad4a-0567d10c083e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:22.456315 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535fc2dc-b3dc-44d6-9060-7e0668879193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:22.461141 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535fc2dc-b3dc-44d6-9060-7e0668879193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b5480f-5237-4f1e-b5cd-970aef5d58fc', 'volume_name': 'volume-24b5480f-5237-4f1e-b5cd-970aef5d58fc', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:22.470699 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdddda5-2564-4492-97d3-aa446afacd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:22.476181 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdddda5-2564-4492-97d3-aa446afacd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:22.482222 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ae9e4b-a3d8-4724-9592-2914ca47a42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:22.483566 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Volume 24b5480f-5237-4f1e-b5cd-970aef5d58fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b5480f-5237-4f1e-b5cd-970aef5d58fc', 'volume_size': 1} Jan 29 20:56:22.484346 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] creating volume 'volume-24b5480f-5237-4f1e-b5cd-970aef5d58fc' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:56:22.487981 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:22.615514 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:56:22.615898 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:56:22.619896 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ae9e4b-a3d8-4724-9592-2914ca47a42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b5480f-5237-4f1e-b5cd-970aef5d58fc', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:22.647635 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6829605b-a08a-44b6-b589-f4040f7004a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:22.668973 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Volume volume-24b5480f-5237-4f1e-b5cd-970aef5d58fc (24b5480f-5237-4f1e-b5cd-970aef5d58fc): created successfully Jan 29 20:56:22.673787 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6829605b-a08a-44b6-b589-f4040f7004a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:22.680792 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Flow 'volume_create_manager' (8dd67b49-0a6e-4824-bc91-d59b49a6cf03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:56:22.707140 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-51babce5-cc62-4032-82f2-940c6fee1f07 tempest-ServersNegativeTestJSON-1137596608 None] Created volume successfully. Jan 29 20:56:27.263334 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:56:27.280363 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:56:27.282689 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:56:27.357665 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Flow 'volume_create_manager' (b945932b-be2f-4978-be3f-66c9f121965e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:56:27.369621 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec79b6b-6d15-4d8f-a73f-6bc4a6f8e194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:27.377509 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:56:27.419347 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec79b6b-6d15-4d8f-a73f-6bc4a6f8e194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1817671377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=85612ae1-7fdd-4d0b-856b-2e8ff27c607c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35bf9ac53cc44d078c9ede28b5a4233d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:56:27Z,use_quota=True,user_id='8d9e046d9799432bacfba8fe040ce36f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:27.434532 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60836ec-ea49-46c6-affa-8dd8610c5e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:27.439398 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60836ec-ea49-46c6-affa-8dd8610c5e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:27.446772 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bf559b-a457-4644-a0d4-ba05907ab6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:27.452136 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bf559b-a457-4644-a0d4-ba05907ab6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85612ae1-7fdd-4d0b-856b-2e8ff27c607c', 'volume_name': 'volume-85612ae1-7fdd-4d0b-856b-2e8ff27c607c', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:27.460019 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a8957b-de77-49a4-a54c-87fbe0368511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:27.465101 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a8957b-de77-49a4-a54c-87fbe0368511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:27.471227 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf0e984-1998-4a01-8791-82633b75c9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:27.473130 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Volume 85612ae1-7fdd-4d0b-856b-2e8ff27c607c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85612ae1-7fdd-4d0b-856b-2e8ff27c607c', 'volume_size': 1} Jan 29 20:56:27.473773 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] creating volume 'volume-85612ae1-7fdd-4d0b-856b-2e8ff27c607c' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:56:27.475128 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:27.599314 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:56:27.599704 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:56:27.603760 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf0e984-1998-4a01-8791-82633b75c9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85612ae1-7fdd-4d0b-856b-2e8ff27c607c', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:27.617274 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8fa78c-69ff-485b-a699-0f3f09c09ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:27.634405 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Volume volume-85612ae1-7fdd-4d0b-856b-2e8ff27c607c (85612ae1-7fdd-4d0b-856b-2e8ff27c607c): created successfully Jan 29 20:56:27.638798 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8fa78c-69ff-485b-a699-0f3f09c09ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:27.647491 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Flow 'volume_create_manager' (b945932b-be2f-4978-be3f-66c9f121965e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:56:27.675339 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-adbdecbe-a7c1-45f3-bd0d-a0afedf1c26b tempest-ServersNegativeTestJSON-1137596608 None] Created volume successfully. Jan 29 20:56:28.640327 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:56:28.642333 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:28.690396 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:28.762085 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:56:33.528320 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f93752d9-6904-4c29-8174-df9f3d88c440 tempest-GroupsV314Test-273108875 None] Group tempest-GroupsV314Test-Group-1039812292: creating Jan 29 20:56:33.573978 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f93752d9-6904-4c29-8174-df9f3d88c440 tempest-GroupsV314Test-273108875 None] Group tempest-GroupsV314Test-Group-1039812292: created successfully Jan 29 20:56:33.589484 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f93752d9-6904-4c29-8174-df9f3d88c440 tempest-GroupsV314Test-273108875 None] Create group completed successfully. Jan 29 20:56:35.566585 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:56:35.574227 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:56:35.574766 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:56:35.626768 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Flow 'volume_create_manager' (e4c1aace-700a-4aef-8e65-1b5703d8e84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:56:35.639130 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3918e853-58d7-4ae1-8e83-6d2fbc878210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:35.655014 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:56:35.681974 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3918e853-58d7-4ae1-8e83-6d2fbc878210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-539374110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa26232c-9914-4b0c-93fd-ef2312606d72,host='ncdv-master-1@ceph#ceph',id=ed05ec5a-3929-4fae-b1a3-de1ae7de1393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14aaec7afa434f6fb40c2c9c3c8b5201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:56:35Z,use_quota=True,user_id='aa07a2114402431fa35baa8eb5d9a692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a980544-46b0-432b-a3f2-59d55cc31fbb),volume_type_id=6a980544-46b0-432b-a3f2-59d55cc31fbb)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:35.699129 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65a268c-d29b-4f90-9e12-3f1a4a9342d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:35.723070 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65a268c-d29b-4f90-9e12-3f1a4a9342d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:35.746141 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529833ce-4567-40cf-9ecb-6bb86fe8f2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:35.751709 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529833ce-4567-40cf-9ecb-6bb86fe8f2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed05ec5a-3929-4fae-b1a3-de1ae7de1393', 'volume_name': 'volume-ed05ec5a-3929-4fae-b1a3-de1ae7de1393', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:35.756582 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55215ee-8aca-49e8-a074-de04c25d0d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:35.769767 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55215ee-8aca-49e8-a074-de04c25d0d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:35.775282 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663663da-2c5b-44f2-be74-12a6794d790e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:35.776604 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Volume ed05ec5a-3929-4fae-b1a3-de1ae7de1393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed05ec5a-3929-4fae-b1a3-de1ae7de1393', 'volume_size': 1} Jan 29 20:56:35.777173 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] creating volume 'volume-ed05ec5a-3929-4fae-b1a3-de1ae7de1393' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:56:35.778357 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:35.977750 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] extra_specs: {} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:56:35.978130 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] extra_specs: {} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:56:35.981967 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663663da-2c5b-44f2-be74-12a6794d790e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed05ec5a-3929-4fae-b1a3-de1ae7de1393', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:35.991108 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4670792e-817c-4ffa-92a1-6194c37ef2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:36.020725 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Volume volume-ed05ec5a-3929-4fae-b1a3-de1ae7de1393 (ed05ec5a-3929-4fae-b1a3-de1ae7de1393): created successfully Jan 29 20:56:36.028313 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4670792e-817c-4ffa-92a1-6194c37ef2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:36.037281 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Flow 'volume_create_manager' (e4c1aace-700a-4aef-8e65-1b5703d8e84b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:56:36.058610 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e56d6abd-c57d-4b72-9480-ab46e8051252 tempest-GroupsV314Test-273108875 None] Created volume successfully. Jan 29 20:56:37.443760 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a14eda71-9fe7-4b7b-8433-c7770d150c2d tempest-GroupsV314Test-273108875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:37.545296 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a14eda71-9fe7-4b7b-8433-c7770d150c2d tempest-GroupsV314Test-273108875 None] creating snapshot='volume-2c051245-9954-4e81-9daf-7b291059260e.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 20:56:38.411145 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a14eda71-9fe7-4b7b-8433-c7770d150c2d tempest-GroupsV314Test-273108875 None] cloning 'volume-ed05ec5a-3929-4fae-b1a3-de1ae7de1393@volume-2c051245-9954-4e81-9daf-7b291059260e.clone_snap' to 'volume-2c051245-9954-4e81-9daf-7b291059260e' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 20:56:38.588741 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a14eda71-9fe7-4b7b-8433-c7770d150c2d tempest-GroupsV314Test-273108875 None] Volume volume-ed05ec5a-3929-4fae-b1a3-de1ae7de1393 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:56:38.599314 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a14eda71-9fe7-4b7b-8433-c7770d150c2d tempest-GroupsV314Test-273108875 None] extra_specs: {} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:56:38.600207 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a14eda71-9fe7-4b7b-8433-c7770d150c2d tempest-GroupsV314Test-273108875 None] extra_specs: {} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:56:38.640200 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a14eda71-9fe7-4b7b-8433-c7770d150c2d tempest-GroupsV314Test-273108875 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 20:56:38.777698 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-a14eda71-9fe7-4b7b-8433-c7770d150c2d tempest-GroupsV314Test-273108875 None] Create group from source-group-fa26232c-9914-4b0c-93fd-ef2312606d72 completed successfully. Jan 29 20:56:39.712731 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-24e4ccf9-2142-4edd-aad8-c41e9772f99d tempest-GroupsV314Test-273108875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:39.894122 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-24e4ccf9-2142-4edd-aad8-c41e9772f99d tempest-GroupsV314Test-273108875 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:56:39.911826 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-24e4ccf9-2142-4edd-aad8-c41e9772f99d tempest-GroupsV314Test-273108875 None] deleting rbd volume volume-2c051245-9954-4e81-9daf-7b291059260e {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:56:40.434642 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-24e4ccf9-2142-4edd-aad8-c41e9772f99d tempest-GroupsV314Test-273108875 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 20:56:40.459877 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-24e4ccf9-2142-4edd-aad8-c41e9772f99d tempest-GroupsV314Test-273108875 None] Volume volume-ed05ec5a-3929-4fae-b1a3-de1ae7de1393 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:56:40.460534 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-24e4ccf9-2142-4edd-aad8-c41e9772f99d tempest-GroupsV314Test-273108875 None] deleting parent snapshot volume-2c051245-9954-4e81-9daf-7b291059260e.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 20:56:41.711817 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-24e4ccf9-2142-4edd-aad8-c41e9772f99d tempest-GroupsV314Test-273108875 None] Created reservations ['cf8e23aa-1595-4923-ab27-2dda2b9b5212'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:56:41.801833 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-24e4ccf9-2142-4edd-aad8-c41e9772f99d tempest-GroupsV314Test-273108875 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-139946492 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-139946492, it is now deprecated. Please use the default quota class for default quota. Jan 29 20:56:41.808093 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-24e4ccf9-2142-4edd-aad8-c41e9772f99d tempest-GroupsV314Test-273108875 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-139946492 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-139946492, it is now deprecated. Please use the default quota class for default quota. Jan 29 20:56:41.939257 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-24e4ccf9-2142-4edd-aad8-c41e9772f99d tempest-GroupsV314Test-273108875 None] Created reservations ['0a48a54c-b37d-4bfe-b2aa-f65e1ed6cf08', '026ca876-255c-4048-8c58-61f1e784b558', '029f2bbb-ca3c-43e6-ad1c-89b6dfebadd1', 'b1199f31-bf01-4f46-8456-184ec5720cfd'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:56:41.985204 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-86401297-a2ba-4a82-941d-7f490fae417e req-84b9ea15-a15e-4849-9891-4dbe50d5f0f8 tempest-TaggedBootDevicesTest-118627551 None] Terminate volume connection completed successfully. Jan 29 20:56:41.985943 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-86401297-a2ba-4a82-941d-7f490fae417e req-84b9ea15-a15e-4849-9891-4dbe50d5f0f8 tempest-TaggedBootDevicesTest-118627551 None] Deleting attachment d994e969-5eea-443a-9a2f-4ca59ab2bef7. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:56:42.176505 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-24e4ccf9-2142-4edd-aad8-c41e9772f99d tempest-GroupsV314Test-273108875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:42.273371 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-24e4ccf9-2142-4edd-aad8-c41e9772f99d tempest-GroupsV314Test-273108875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:42.381306 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-24e4ccf9-2142-4edd-aad8-c41e9772f99d tempest-GroupsV314Test-273108875 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:56:42.391521 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-24e4ccf9-2142-4edd-aad8-c41e9772f99d tempest-GroupsV314Test-273108875 None] Delete group completed successfully. Jan 29 20:56:42.419750 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-86401297-a2ba-4a82-941d-7f490fae417e req-e02e81ff-92bd-4d6f-8176-de5306ef60cc tempest-TaggedBootDevicesTest-118627551 None] Terminate volume connection completed successfully. Jan 29 20:56:42.422992 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-86401297-a2ba-4a82-941d-7f490fae417e req-e02e81ff-92bd-4d6f-8176-de5306ef60cc tempest-TaggedBootDevicesTest-118627551 None] Deleting attachment 052ba1a9-311e-4ae9-8178-f7b207c2eb8c. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:56:42.674067 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-86401297-a2ba-4a82-941d-7f490fae417e req-a81e668c-46a1-4d0c-854f-5135196c1941 tempest-TaggedBootDevicesTest-118627551 None] Terminate volume connection completed successfully. Jan 29 20:56:42.674492 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-86401297-a2ba-4a82-941d-7f490fae417e req-a81e668c-46a1-4d0c-854f-5135196c1941 tempest-TaggedBootDevicesTest-118627551 None] Deleting attachment 3030d941-5c31-4f94-b442-78faca2abfbf. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:56:43.758783 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1062db69-89ba-49f4-8788-a65ac63ad4fb tempest-GroupsV314Test-273108875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:43.918739 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1062db69-89ba-49f4-8788-a65ac63ad4fb tempest-GroupsV314Test-273108875 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:56:43.919195 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1062db69-89ba-49f4-8788-a65ac63ad4fb tempest-GroupsV314Test-273108875 None] Volume volume-ed05ec5a-3929-4fae-b1a3-de1ae7de1393 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:56:43.936104 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1062db69-89ba-49f4-8788-a65ac63ad4fb tempest-GroupsV314Test-273108875 None] deleting rbd volume volume-ed05ec5a-3929-4fae-b1a3-de1ae7de1393 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:56:44.583017 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-1062db69-89ba-49f4-8788-a65ac63ad4fb tempest-GroupsV314Test-273108875 None] Created reservations ['7b91fa60-40ef-461c-a506-c9e6cf8f21da'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:56:44.709863 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-1062db69-89ba-49f4-8788-a65ac63ad4fb tempest-GroupsV314Test-273108875 None] Created reservations ['774c3c34-17ac-44d4-a95c-4ff6481d28a8', 'de10b441-d5f1-4325-b91f-485db01171d2', '09d8280a-47d6-4917-819e-7bd8c70d8709', '72f8986d-f8da-4f29-afa9-53f9923ccfa8'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:56:44.931465 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1062db69-89ba-49f4-8788-a65ac63ad4fb tempest-GroupsV314Test-273108875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:45.101647 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1062db69-89ba-49f4-8788-a65ac63ad4fb tempest-GroupsV314Test-273108875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:45.191744 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-1062db69-89ba-49f4-8788-a65ac63ad4fb tempest-GroupsV314Test-273108875 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:56:45.196876 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-1062db69-89ba-49f4-8788-a65ac63ad4fb tempest-GroupsV314Test-273108875 None] Delete group completed successfully. Jan 29 20:56:56.548370 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:56:56.556748 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:56:56.558230 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:56:56.608381 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Flow 'volume_create_manager' (82bb255c-bd51-4f44-ab75-a64d9ea34827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:56:56.623003 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9c39f6-7db0-4d3e-aa1a-91708aec8d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:56.638700 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:56:56.674816 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9c39f6-7db0-4d3e-aa1a-91708aec8d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-640856616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c295a19f-01eb-4b4f-966f-ccf98d7bd287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48a3088fc3bf4f8dbb2e2bef3ea0e6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:56:56Z,use_quota=True,user_id='c0adbfe475c245a3a99ec7cf6a1a6ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:56.691460 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ffe68b-efd2-4a55-913e-176bd47b4817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:56.705922 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ffe68b-efd2-4a55-913e-176bd47b4817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:56.719955 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ccd733-b010-4cd2-af67-c4d70225f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:56.945290 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ccd733-b010-4cd2-af67-c4d70225f28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c295a19f-01eb-4b4f-966f-ccf98d7bd287', 'volume_name': 'volume-c295a19f-01eb-4b4f-966f-ccf98d7bd287', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:56.952292 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940f7a8d-41d9-46b7-9f4d-d8f4bdb8fafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:56.957271 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940f7a8d-41d9-46b7-9f4d-d8f4bdb8fafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:56.963675 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5879ab-e5d8-40af-b293-6c4f4873e03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:56.965128 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Volume c295a19f-01eb-4b4f-966f-ccf98d7bd287: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c295a19f-01eb-4b4f-966f-ccf98d7bd287', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 20:56:56.965942 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Cloning c295a19f-01eb-4b4f-966f-ccf98d7bd287 from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 20:56:56.977681 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:56:57.010711 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 20, 56, 56, 982926)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 20:56:57.011897 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 20:56:57.013031 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Found cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 29 20:56:57.019216 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 0.042s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:56:57.020349 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 20:56:57.028110 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 20, 56, 57, 25665)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 20:56:57.028636 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 20:56:57.029198 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Creating from source image-volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 29 20:56:57.054990 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:57.204573 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] creating snapshot='volume-c295a19f-01eb-4b4f-966f-ccf98d7bd287.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 20:56:57.396959 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] cloning 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe@volume-c295a19f-01eb-4b4f-966f-ccf98d7bd287.clone_snap' to 'volume-c295a19f-01eb-4b4f-966f-ccf98d7bd287' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 20:56:57.644194 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:56:57.645296 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:56:57.645722 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:56:57.678838 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 20:56:57.679700 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Marking volume c295a19f-01eb-4b4f-966f-ccf98d7bd287 as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 20:56:57.695193 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to c295a19f-01eb-4b4f-966f-ccf98d7bd287. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 20:56:57.698334 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Creating volume glance metadata for volume c295a19f-01eb-4b4f-966f-ccf98d7bd287 backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 20:56:57.905178 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5879ab-e5d8-40af-b293-6c4f4873e03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c295a19f-01eb-4b4f-966f-ccf98d7bd287', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:57.923549 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c797df0-05ad-4626-a175-0892cfc3e713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:56:57.985351 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Volume volume-c295a19f-01eb-4b4f-966f-ccf98d7bd287 (c295a19f-01eb-4b4f-966f-ccf98d7bd287): created successfully Jan 29 20:56:57.996088 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c797df0-05ad-4626-a175-0892cfc3e713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:56:58.034662 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Flow 'volume_create_manager' (82bb255c-bd51-4f44-ab75-a64d9ea34827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:56:58.047360 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-8e11d6ba-46e6-4014-bed0-239dfc6a020e tempest-ServersTestBootFromVolume-1029629551 None] Created volume successfully. Jan 29 20:56:58.901610 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-fba8f387-43a1-41f8-9568-8c1a206b8632 tempest-TaggedBootDevicesTest-118627551 None] Lock "b'cinder-8f8de57e-73fc-421f-a710-ee64037e006f-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:56:58.965052 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fba8f387-43a1-41f8-9568-8c1a206b8632 tempest-TaggedBootDevicesTest-118627551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:59.054200 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fba8f387-43a1-41f8-9568-8c1a206b8632 tempest-TaggedBootDevicesTest-118627551 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:56:59.055018 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fba8f387-43a1-41f8-9568-8c1a206b8632 tempest-TaggedBootDevicesTest-118627551 None] Volume volume-8f8de57e-73fc-421f-a710-ee64037e006f is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:56:59.062621 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fba8f387-43a1-41f8-9568-8c1a206b8632 tempest-TaggedBootDevicesTest-118627551 None] deleting rbd volume volume-8f8de57e-73fc-421f-a710-ee64037e006f {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:56:59.424198 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-fba8f387-43a1-41f8-9568-8c1a206b8632 tempest-TaggedBootDevicesTest-118627551 None] Created reservations ['dfe1e08c-da07-4923-810b-a417438d1516', '6cf2ae1c-9327-4430-82df-7756ded04847', '1c9d6c7a-1c8f-4c0e-a542-95daf2b4c07c', '74f0d3dc-7b36-4afa-ab0f-4ba9e2a2c44b'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:56:59.476350 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fba8f387-43a1-41f8-9568-8c1a206b8632 tempest-TaggedBootDevicesTest-118627551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:59.538859 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fba8f387-43a1-41f8-9568-8c1a206b8632 tempest-TaggedBootDevicesTest-118627551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:56:59.574043 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-fba8f387-43a1-41f8-9568-8c1a206b8632 tempest-TaggedBootDevicesTest-118627551 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:56:59.580146 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-fba8f387-43a1-41f8-9568-8c1a206b8632 tempest-TaggedBootDevicesTest-118627551 None] Deleted volume successfully. Jan 29 20:56:59.595330 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-fba8f387-43a1-41f8-9568-8c1a206b8632 tempest-TaggedBootDevicesTest-118627551 None] Lock "b'cinder-8f8de57e-73fc-421f-a710-ee64037e006f-delete_volume'" released by "delete_volume" :: held 0.694s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:57:00.091197 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-df806083-895d-46ed-b287-22a7bfa4c69b tempest-TaggedBootDevicesTest-118627551 None] Lock "b'cinder-df2202d3-1e91-4d32-839e-da53c4019911-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:57:00.138313 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-df806083-895d-46ed-b287-22a7bfa4c69b tempest-TaggedBootDevicesTest-118627551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:00.202029 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-df806083-895d-46ed-b287-22a7bfa4c69b tempest-TaggedBootDevicesTest-118627551 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:57:00.202456 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-df806083-895d-46ed-b287-22a7bfa4c69b tempest-TaggedBootDevicesTest-118627551 None] Volume volume-df2202d3-1e91-4d32-839e-da53c4019911 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:57:00.214133 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-df806083-895d-46ed-b287-22a7bfa4c69b tempest-TaggedBootDevicesTest-118627551 None] deleting rbd volume volume-df2202d3-1e91-4d32-839e-da53c4019911 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:57:00.566511 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-df806083-895d-46ed-b287-22a7bfa4c69b tempest-TaggedBootDevicesTest-118627551 None] Created reservations ['da7d1580-f58e-40c7-8035-9b852e5d530e', '327074aa-3f5f-4472-8e8a-aaeb575ce3d1', '384135ad-a380-43f3-8b92-49c22a113073', 'ea7e3257-a954-491f-ae8d-ae72e0c573e7'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:57:00.614438 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-df806083-895d-46ed-b287-22a7bfa4c69b tempest-TaggedBootDevicesTest-118627551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:00.652489 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-df806083-895d-46ed-b287-22a7bfa4c69b tempest-TaggedBootDevicesTest-118627551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:00.691406 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-df806083-895d-46ed-b287-22a7bfa4c69b tempest-TaggedBootDevicesTest-118627551 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:57:00.696452 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-df806083-895d-46ed-b287-22a7bfa4c69b tempest-TaggedBootDevicesTest-118627551 None] Deleted volume successfully. Jan 29 20:57:00.710523 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-df806083-895d-46ed-b287-22a7bfa4c69b tempest-TaggedBootDevicesTest-118627551 None] Lock "b'cinder-df2202d3-1e91-4d32-839e-da53c4019911-delete_volume'" released by "delete_volume" :: held 0.619s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:57:01.285096 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-6ff48623-8a3d-4ed7-bfdd-b0bae940feec tempest-TaggedBootDevicesTest-118627551 None] Lock "b'cinder-e6aa71d9-a127-48b1-970e-9f81c4708995-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:57:01.369764 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6ff48623-8a3d-4ed7-bfdd-b0bae940feec tempest-TaggedBootDevicesTest-118627551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:01.577400 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6ff48623-8a3d-4ed7-bfdd-b0bae940feec tempest-TaggedBootDevicesTest-118627551 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:57:01.596645 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6ff48623-8a3d-4ed7-bfdd-b0bae940feec tempest-TaggedBootDevicesTest-118627551 None] deleting rbd volume volume-e6aa71d9-a127-48b1-970e-9f81c4708995 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:57:01.645742 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:57:01.650450 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:57:01.650891 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:57:01.672855 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Flow 'volume_create_manager' (d2645833-07b6-4dd9-912f-59345ebd4d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:57:01.690628 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962af491-1d73-4996-8f55-6f2895e86bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:01.705822 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:57:01.754410 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962af491-1d73-4996-8f55-6f2895e86bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1228004554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=27243503-fac0-44a6-9d77-8612827b4b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c582fb272648b1b8d62778f373a515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:57:02Z,use_quota=True,user_id='f6a1b3cf75c8489ca731bb5e55f2d167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:01.773141 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce00064-4281-4d08-96d1-bd7ef4433ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:01.780295 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce00064-4281-4d08-96d1-bd7ef4433ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:01.787023 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2776d333-fc8d-49f1-90b0-135c09f21808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:01.793364 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2776d333-fc8d-49f1-90b0-135c09f21808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27243503-fac0-44a6-9d77-8612827b4b62', 'volume_name': 'volume-27243503-fac0-44a6-9d77-8612827b4b62', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:01.798929 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661e91e7-83b6-4026-a68b-6f714f8f9bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:01.808965 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661e91e7-83b6-4026-a68b-6f714f8f9bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:01.824050 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e29803-413d-43f9-b44f-72f943193eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:01.837064 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Volume 27243503-fac0-44a6-9d77-8612827b4b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27243503-fac0-44a6-9d77-8612827b4b62', 'volume_size': 1} Jan 29 20:57:01.837064 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] creating volume 'volume-27243503-fac0-44a6-9d77-8612827b4b62' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:57:01.837064 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:02.002229 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:57:02.003665 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:57:02.010815 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e29803-413d-43f9-b44f-72f943193eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27243503-fac0-44a6-9d77-8612827b4b62', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:02.017356 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab80a516-2096-4056-8af8-2fb18cfe3a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:02.043351 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Volume volume-27243503-fac0-44a6-9d77-8612827b4b62 (27243503-fac0-44a6-9d77-8612827b4b62): created successfully Jan 29 20:57:02.054557 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab80a516-2096-4056-8af8-2fb18cfe3a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:02.070782 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Flow 'volume_create_manager' (d2645833-07b6-4dd9-912f-59345ebd4d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:57:02.081722 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-fdb042e1-a1fd-4ff5-b3ee-416eec3d1f6e tempest-SnapshotsActionsTest-1758994236 None] Created volume successfully. Jan 29 20:57:02.119022 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6ff48623-8a3d-4ed7-bfdd-b0bae940feec tempest-TaggedBootDevicesTest-118627551 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 20:57:02.161500 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6ff48623-8a3d-4ed7-bfdd-b0bae940feec tempest-TaggedBootDevicesTest-118627551 None] deleting parent snapshot volume-e6aa71d9-a127-48b1-970e-9f81c4708995.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 20:57:02.611100 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-6ff48623-8a3d-4ed7-bfdd-b0bae940feec tempest-TaggedBootDevicesTest-118627551 None] Created reservations ['e27b3a4a-c986-48c7-a800-2e2b463a1c09', 'eea8761c-d568-42dd-a15e-cc93c2ae8efa', '4d55f552-f4c3-4afe-842c-dbc2d4e1fa42', '197a0851-444a-4f23-af40-fe18dde81a42'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:57:02.682800 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6ff48623-8a3d-4ed7-bfdd-b0bae940feec tempest-TaggedBootDevicesTest-118627551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:02.738102 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6ff48623-8a3d-4ed7-bfdd-b0bae940feec tempest-TaggedBootDevicesTest-118627551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:02.806454 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-6ff48623-8a3d-4ed7-bfdd-b0bae940feec tempest-TaggedBootDevicesTest-118627551 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:57:02.822175 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6ff48623-8a3d-4ed7-bfdd-b0bae940feec tempest-TaggedBootDevicesTest-118627551 None] Deleted volume successfully. Jan 29 20:57:02.838545 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-6ff48623-8a3d-4ed7-bfdd-b0bae940feec tempest-TaggedBootDevicesTest-118627551 None] Lock "b'cinder-e6aa71d9-a127-48b1-970e-9f81c4708995-delete_volume'" released by "delete_volume" :: held 1.558s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:57:02.859134 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-aa3abf3f-4a2b-4801-b5c2-b6b1c3a0c0e8 tempest-SnapshotsActionsTest-1758994236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:02.982245 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-c3c5f5ad-8cdf-4e8e-a948-c3c220b276c4 req-e29bb6ec-cb44-4b3d-816a-f507bd892cf3 tempest-ServersTestBootFromVolume-1029629551 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 20:57:03.626889 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-aa3abf3f-4a2b-4801-b5c2-b6b1c3a0c0e8 tempest-SnapshotsActionsTest-1758994236 None] Create snapshot completed successfully Jan 29 20:57:04.080320 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-c3c5f5ad-8cdf-4e8e-a948-c3c220b276c4 req-e29bb6ec-cb44-4b3d-816a-f507bd892cf3 tempest-ServersTestBootFromVolume-1029629551 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.098s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 20:57:04.081195 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-c3c5f5ad-8cdf-4e8e-a948-c3c220b276c4 req-e29bb6ec-cb44-4b3d-816a-f507bd892cf3 tempest-ServersTestBootFromVolume-1029629551 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c295a19f-01eb-4b4f-966f-ccf98d7bd287', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'c295a19f-01eb-4b4f-966f-ccf98d7bd287', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 20:57:04.127315 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-c3c5f5ad-8cdf-4e8e-a948-c3c220b276c4 req-e29bb6ec-cb44-4b3d-816a-f507bd892cf3 tempest-ServersTestBootFromVolume-1029629551 None] Connection info returned from driver {'name': 'volumes/volume-c295a19f-01eb-4b4f-966f-ccf98d7bd287', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c295a19f-01eb-4b4f-966f-ccf98d7bd287', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c909ba91-64f4-4dc6-8356-c2a60f1b642d'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 20:57:04.239343 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-c3c5f5ad-8cdf-4e8e-a948-c3c220b276c4 req-e29bb6ec-cb44-4b3d-816a-f507bd892cf3 tempest-ServersTestBootFromVolume-1029629551 None] attachment_update completed successfully. Jan 29 20:57:04.616538 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-846b413a-09c3-4d0e-8cec-969ee882b298 tempest-SnapshotsActionsTest-1758994236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:05.317234 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-846b413a-09c3-4d0e-8cec-969ee882b298 tempest-SnapshotsActionsTest-1758994236 None] Create snapshot completed successfully Jan 29 20:57:05.788664 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-42e44afa-9570-43ca-999d-890f0cadd4c0 tempest-SnapshotsActionsTest-1230451251 None] Lock "b'cinder-2f94d9b2-828a-4bd7-979e-83e730183985-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.020s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:57:05.794461 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-42e44afa-9570-43ca-999d-890f0cadd4c0 tempest-SnapshotsActionsTest-1230451251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:06.379495 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-42e44afa-9570-43ca-999d-890f0cadd4c0 tempest-SnapshotsActionsTest-1230451251 None] Created reservations ['725ce527-fde6-414d-80fb-4ce3138bfd45', 'b94dff11-36b7-4c60-8299-3ac07e05a907', 'cac980a4-156c-4a83-b21b-55a8f9088a04', '1908edcf-a916-42d6-bd32-26e4bc9f8e95'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:57:06.467637 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-42e44afa-9570-43ca-999d-890f0cadd4c0 tempest-SnapshotsActionsTest-1230451251 None] Delete snapshot completed successfully. Jan 29 20:57:06.479801 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-42e44afa-9570-43ca-999d-890f0cadd4c0 tempest-SnapshotsActionsTest-1230451251 None] Lock "b'cinder-2f94d9b2-828a-4bd7-979e-83e730183985-delete_snapshot'" released by "delete_snapshot" :: held 0.691s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:57:07.303482 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3d647da2-86eb-475e-858e-c824a69722cb tempest-SnapshotsActionsTest-1758994236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:08.410377 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-3d647da2-86eb-475e-858e-c824a69722cb tempest-SnapshotsActionsTest-1758994236 None] Create snapshot completed successfully Jan 29 20:57:09.584511 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e173cd0a-1168-4b43-8836-9c1377071385 tempest-SnapshotsActionsTest-1230451251 None] Lock "b'cinder-ef669a47-f5d6-4d43-bdc8-e4d3e17f5098-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:57:09.587893 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e173cd0a-1168-4b43-8836-9c1377071385 tempest-SnapshotsActionsTest-1230451251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:10.357489 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-e173cd0a-1168-4b43-8836-9c1377071385 tempest-SnapshotsActionsTest-1230451251 None] Created reservations ['56887acb-1d2e-455d-8386-4cc8bcf48390', '65187126-1cbd-41c2-8b8c-6ea4023c6096', '0e549651-21a3-43ba-bc03-f90d28b534f6', 'e8ae90d3-eefd-4b9e-b45f-512153d3a748'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:57:10.426999 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e173cd0a-1168-4b43-8836-9c1377071385 tempest-SnapshotsActionsTest-1230451251 None] Delete snapshot completed successfully. Jan 29 20:57:10.436603 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e173cd0a-1168-4b43-8836-9c1377071385 tempest-SnapshotsActionsTest-1230451251 None] Lock "b'cinder-ef669a47-f5d6-4d43-bdc8-e4d3e17f5098-delete_snapshot'" released by "delete_snapshot" :: held 0.848s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:57:11.200795 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-285c3551-1542-423c-888b-dc343f4f1d2c tempest-SnapshotsActionsTest-1758994236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:11.561148 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-285c3551-1542-423c-888b-dc343f4f1d2c tempest-SnapshotsActionsTest-1758994236 None] Create snapshot completed successfully Jan 29 20:57:12.525110 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-7a9f8782-12a7-4e4e-9e82-6c6e5d55d5b5 tempest-SnapshotsActionsTest-1230451251 None] Lock "b'cinder-2bf7ca64-29ef-4846-bf87-c4440af32ddd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:57:12.551627 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7a9f8782-12a7-4e4e-9e82-6c6e5d55d5b5 tempest-SnapshotsActionsTest-1230451251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:13.592420 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-7a9f8782-12a7-4e4e-9e82-6c6e5d55d5b5 tempest-SnapshotsActionsTest-1230451251 None] Created reservations ['970d2e3e-dd47-4e9f-b4d6-d8285afacdfd', 'a3fc5ed9-f177-47a7-a3a7-16cbeaf59562', '6276ca4b-3144-4153-aea5-5444e4dca795', '89b17600-e76c-42aa-b9fc-929bcb85a6bb'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:57:13.672519 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-7a9f8782-12a7-4e4e-9e82-6c6e5d55d5b5 tempest-SnapshotsActionsTest-1230451251 None] Delete snapshot completed successfully. Jan 29 20:57:13.678969 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-7a9f8782-12a7-4e4e-9e82-6c6e5d55d5b5 tempest-SnapshotsActionsTest-1230451251 None] Lock "b'cinder-2bf7ca64-29ef-4846-bf87-c4440af32ddd-delete_snapshot'" released by "delete_snapshot" :: held 1.154s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:57:15.097986 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d12f8c8e-782c-439a-bbfe-eaeced866289 tempest-SnapshotsActionsTest-1758994236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:16.297005 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d12f8c8e-782c-439a-bbfe-eaeced866289 tempest-SnapshotsActionsTest-1758994236 None] Create snapshot completed successfully Jan 29 20:57:17.304479 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-d0471fce-2f95-47c7-b13d-ee15d9626280 tempest-SnapshotsActionsTest-1230451251 None] Lock "b'cinder-78188085-4f9b-4423-946a-5492573cf5b4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:57:17.306781 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d0471fce-2f95-47c7-b13d-ee15d9626280 tempest-SnapshotsActionsTest-1230451251 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:18.370477 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-d0471fce-2f95-47c7-b13d-ee15d9626280 tempest-SnapshotsActionsTest-1230451251 None] Created reservations ['c1a28c29-4268-4188-b71e-cd74c4ca391e', '4d583c8c-ff2c-44b7-a266-82c1c35dbafc', '8eb47125-ed61-45f4-8812-bb9b3d613f84', '9af6f77e-12a1-4007-9705-2ca8a608f885'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:57:18.428249 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d0471fce-2f95-47c7-b13d-ee15d9626280 tempest-SnapshotsActionsTest-1230451251 None] Delete snapshot completed successfully. Jan 29 20:57:18.434944 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-d0471fce-2f95-47c7-b13d-ee15d9626280 tempest-SnapshotsActionsTest-1230451251 None] Lock "b'cinder-78188085-4f9b-4423-946a-5492573cf5b4-delete_snapshot'" released by "delete_snapshot" :: held 1.130s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:57:20.101812 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-1ad71df1-d6f3-4d0e-b80a-bb55c8ada8ca tempest-SnapshotsActionsTest-1758994236 None] Lock "b'cinder-0385d305-ef41-4018-a348-9338be023f2a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:57:20.117205 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1ad71df1-d6f3-4d0e-b80a-bb55c8ada8ca tempest-SnapshotsActionsTest-1758994236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:21.476009 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-1ad71df1-d6f3-4d0e-b80a-bb55c8ada8ca tempest-SnapshotsActionsTest-1758994236 None] Created reservations ['49bd8e7c-fd0f-45d0-879b-d7c6214580da', '2ab234af-fb6b-40c6-85a0-fafdfe279619', '5caa664d-a330-4ea3-99b1-0fd8259068c8', 'f14447db-7bb4-4c56-b220-b66293cdb7fb'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:57:21.551390 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-1ad71df1-d6f3-4d0e-b80a-bb55c8ada8ca tempest-SnapshotsActionsTest-1758994236 None] Delete snapshot completed successfully. Jan 29 20:57:21.563593 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-1ad71df1-d6f3-4d0e-b80a-bb55c8ada8ca tempest-SnapshotsActionsTest-1758994236 None] Lock "b'cinder-0385d305-ef41-4018-a348-9338be023f2a-delete_snapshot'" released by "delete_snapshot" :: held 1.462s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:57:22.326871 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-edb2ea72-d68f-4b68-a012-ef12600cce82 tempest-SnapshotsActionsTest-1758994236 None] Lock "b'cinder-27243503-fac0-44a6-9d77-8612827b4b62-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:57:22.395623 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-edb2ea72-d68f-4b68-a012-ef12600cce82 tempest-SnapshotsActionsTest-1758994236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:22.476973 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-edb2ea72-d68f-4b68-a012-ef12600cce82 tempest-SnapshotsActionsTest-1758994236 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:57:22.478452 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-edb2ea72-d68f-4b68-a012-ef12600cce82 tempest-SnapshotsActionsTest-1758994236 None] Volume volume-27243503-fac0-44a6-9d77-8612827b4b62 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:57:22.494550 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-edb2ea72-d68f-4b68-a012-ef12600cce82 tempest-SnapshotsActionsTest-1758994236 None] deleting rbd volume volume-27243503-fac0-44a6-9d77-8612827b4b62 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:57:23.057538 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-edb2ea72-d68f-4b68-a012-ef12600cce82 tempest-SnapshotsActionsTest-1758994236 None] Created reservations ['4bf7ecf5-1693-4161-a6eb-3ed1c2534b71', '32085719-94e3-45d8-945a-9440ac18129c', '0760f458-d941-4837-a64c-10f47e61f17d', 'bf9e02d4-afb5-46d3-bde4-2efb2e8993aa'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:57:23.158951 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-edb2ea72-d68f-4b68-a012-ef12600cce82 tempest-SnapshotsActionsTest-1758994236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:23.230435 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-edb2ea72-d68f-4b68-a012-ef12600cce82 tempest-SnapshotsActionsTest-1758994236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:23.285581 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-edb2ea72-d68f-4b68-a012-ef12600cce82 tempest-SnapshotsActionsTest-1758994236 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:57:23.297337 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-edb2ea72-d68f-4b68-a012-ef12600cce82 tempest-SnapshotsActionsTest-1758994236 None] Deleted volume successfully. Jan 29 20:57:23.314650 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-edb2ea72-d68f-4b68-a012-ef12600cce82 tempest-SnapshotsActionsTest-1758994236 None] Lock "b'cinder-27243503-fac0-44a6-9d77-8612827b4b62-delete_volume'" released by "delete_volume" :: held 0.988s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:57:28.637911 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:57:28.639406 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:28.714716 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:28.813135 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:57:38.600221 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:57:38.606588 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:57:38.607929 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:57:38.632672 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Flow 'volume_create_manager' (bd4ac36e-1e3b-4d48-807b-b3e01c1cdff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:57:38.641331 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db2844d-83d5-4c26-9059-50a5c14669cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:38.648962 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:57:38.667145 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db2844d-83d5-4c26-9059-50a5c14669cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1604056267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=54bc71e1-0216-4fa0-83b4-5446ca3bedee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6483aa783d2049789bfc3829cf5ac11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:57:39Z,use_quota=True,user_id='400f9a27dd304973a5aea86c763f6586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:38.675086 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd15617-e08d-47f4-8461-e069731c86f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:38.681890 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd15617-e08d-47f4-8461-e069731c86f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:38.688934 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e75303-8dcc-41af-b547-69cab803c1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:38.693618 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e75303-8dcc-41af-b547-69cab803c1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54bc71e1-0216-4fa0-83b4-5446ca3bedee', 'volume_name': 'volume-54bc71e1-0216-4fa0-83b4-5446ca3bedee', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:38.699225 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf64fccd-67b8-4aa3-a1e4-4c369ad9bcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:38.703939 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf64fccd-67b8-4aa3-a1e4-4c369ad9bcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:38.710187 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ae9794-ea69-47ab-b957-cc5f8ec94f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:38.711420 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Volume 54bc71e1-0216-4fa0-83b4-5446ca3bedee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54bc71e1-0216-4fa0-83b4-5446ca3bedee', 'volume_size': 1} Jan 29 20:57:38.711967 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] creating volume 'volume-54bc71e1-0216-4fa0-83b4-5446ca3bedee' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:57:38.713126 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:38.816577 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:57:38.817240 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:57:38.821964 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ae9794-ea69-47ab-b957-cc5f8ec94f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54bc71e1-0216-4fa0-83b4-5446ca3bedee', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:38.828040 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e882d685-2c05-47e0-bf8f-55e497c788f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:38.839720 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Volume volume-54bc71e1-0216-4fa0-83b4-5446ca3bedee (54bc71e1-0216-4fa0-83b4-5446ca3bedee): created successfully Jan 29 20:57:38.844611 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e882d685-2c05-47e0-bf8f-55e497c788f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:38.855080 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Flow 'volume_create_manager' (bd4ac36e-1e3b-4d48-807b-b3e01c1cdff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:57:38.865539 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-5f6e9201-c5ae-45f5-a64f-3aaffdce2766 tempest-VolumeQuotasAdminTestJSON-388441842 None] Created volume successfully. Jan 29 20:57:39.750038 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-fffe374d-ee32-40c2-80df-1c7e37e24eb6 tempest-VolumeQuotasAdminTestJSON-388441842 None] Lock "b'cinder-54bc71e1-0216-4fa0-83b4-5446ca3bedee-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:57:39.841672 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fffe374d-ee32-40c2-80df-1c7e37e24eb6 tempest-VolumeQuotasAdminTestJSON-388441842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:39.906817 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fffe374d-ee32-40c2-80df-1c7e37e24eb6 tempest-VolumeQuotasAdminTestJSON-388441842 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:57:39.907277 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fffe374d-ee32-40c2-80df-1c7e37e24eb6 tempest-VolumeQuotasAdminTestJSON-388441842 None] Volume volume-54bc71e1-0216-4fa0-83b4-5446ca3bedee is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:57:39.917922 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fffe374d-ee32-40c2-80df-1c7e37e24eb6 tempest-VolumeQuotasAdminTestJSON-388441842 None] deleting rbd volume volume-54bc71e1-0216-4fa0-83b4-5446ca3bedee {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:57:40.372892 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-fffe374d-ee32-40c2-80df-1c7e37e24eb6 tempest-VolumeQuotasAdminTestJSON-388441842 None] Created reservations ['1d451f34-54ac-42cd-86f7-14318e5395b9', '3c43a595-02f6-46c5-a933-2be7c62f45d5', '430c2b06-82b2-4c57-a836-07857d6f44f2', '1ada895f-82b3-4119-bc1f-4c6a3192aaa7'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:57:40.472556 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fffe374d-ee32-40c2-80df-1c7e37e24eb6 tempest-VolumeQuotasAdminTestJSON-388441842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:40.550331 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fffe374d-ee32-40c2-80df-1c7e37e24eb6 tempest-VolumeQuotasAdminTestJSON-388441842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:40.603130 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-fffe374d-ee32-40c2-80df-1c7e37e24eb6 tempest-VolumeQuotasAdminTestJSON-388441842 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:57:40.619996 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-fffe374d-ee32-40c2-80df-1c7e37e24eb6 tempest-VolumeQuotasAdminTestJSON-388441842 None] Deleted volume successfully. Jan 29 20:57:40.649487 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-fffe374d-ee32-40c2-80df-1c7e37e24eb6 tempest-VolumeQuotasAdminTestJSON-388441842 None] Lock "b'cinder-54bc71e1-0216-4fa0-83b4-5446ca3bedee-delete_volume'" released by "delete_volume" :: held 0.899s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:57:41.447274 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 20:57:41.460325 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 20:57:41.460862 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 20:57:41.493765 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Flow 'volume_create_manager' (dddd98d0-18a1-4ff7-8af6-6f5407e752bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:57:41.501143 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a9e54d-0d99-4db5-82ce-b17c476bea20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:41.508243 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 20:57:41.525207 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a9e54d-0d99-4db5-82ce-b17c476bea20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T20:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2066581126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ee54b8b7-213d-4a67-88fb-37953da3a8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6483aa783d2049789bfc3829cf5ac11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T20:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T20:57:41Z,use_quota=True,user_id='400f9a27dd304973a5aea86c763f6586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:41.531831 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25db255a-adcd-4efc-b0a3-16866da472fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:41.536102 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25db255a-adcd-4efc-b0a3-16866da472fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:41.541601 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28cfb5ec-c50d-4c14-bc58-27d5dfceab19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:41.546206 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28cfb5ec-c50d-4c14-bc58-27d5dfceab19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee54b8b7-213d-4a67-88fb-37953da3a8d1', 'volume_name': 'volume-ee54b8b7-213d-4a67-88fb-37953da3a8d1', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:41.551586 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c3e83a-c4c1-40a5-887d-519bc6bf0453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:41.556549 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c3e83a-c4c1-40a5-887d-519bc6bf0453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:41.562164 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264fbe5e-22ee-4736-afe5-06e458468910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:41.563270 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Volume ee54b8b7-213d-4a67-88fb-37953da3a8d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee54b8b7-213d-4a67-88fb-37953da3a8d1', 'volume_size': 1} Jan 29 20:57:41.563660 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] creating volume 'volume-ee54b8b7-213d-4a67-88fb-37953da3a8d1' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 20:57:41.564832 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:41.690499 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 20:57:41.690882 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 20:57:41.695074 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264fbe5e-22ee-4736-afe5-06e458468910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee54b8b7-213d-4a67-88fb-37953da3a8d1', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:41.707447 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352cf790-3c84-4d23-bdab-db6e32734ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 20:57:41.728114 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Volume volume-ee54b8b7-213d-4a67-88fb-37953da3a8d1 (ee54b8b7-213d-4a67-88fb-37953da3a8d1): created successfully Jan 29 20:57:41.732474 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352cf790-3c84-4d23-bdab-db6e32734ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 20:57:41.739486 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Flow 'volume_create_manager' (dddd98d0-18a1-4ff7-8af6-6f5407e752bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 20:57:41.751336 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-86d09473-e934-4a3d-87c9-b29309bc4103 tempest-VolumeQuotasAdminTestJSON-388441842 None] Created volume successfully. Jan 29 20:57:43.516178 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6074d63f-7487-44b2-9a96-30c8a766288a tempest-VolumeQuotasAdminTestJSON-425679661 None] Transfer volume completed successfully. Jan 29 20:57:44.206924 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-5418d2bd-e4b6-4f53-9306-7d064b56dec4 tempest-VolumeQuotasAdminTestJSON-1250402019 None] Lock "b'cinder-ee54b8b7-213d-4a67-88fb-37953da3a8d1-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:57:44.291292 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5418d2bd-e4b6-4f53-9306-7d064b56dec4 tempest-VolumeQuotasAdminTestJSON-1250402019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:44.374110 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5418d2bd-e4b6-4f53-9306-7d064b56dec4 tempest-VolumeQuotasAdminTestJSON-1250402019 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:57:44.374743 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5418d2bd-e4b6-4f53-9306-7d064b56dec4 tempest-VolumeQuotasAdminTestJSON-1250402019 None] Volume volume-ee54b8b7-213d-4a67-88fb-37953da3a8d1 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:57:44.388738 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5418d2bd-e4b6-4f53-9306-7d064b56dec4 tempest-VolumeQuotasAdminTestJSON-1250402019 None] deleting rbd volume volume-ee54b8b7-213d-4a67-88fb-37953da3a8d1 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:57:44.927899 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-5418d2bd-e4b6-4f53-9306-7d064b56dec4 tempest-VolumeQuotasAdminTestJSON-1250402019 None] Created reservations ['f52c3042-d87f-46bc-ad14-002610a85065', 'b2d4bab5-868e-4ac4-bbcb-2f65781659f1', '6b6eb4d7-231f-4020-aa90-630d2d32b968', '7aefdc7c-984d-47ec-9870-8b5bb2dcfa4a'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:57:45.012171 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5418d2bd-e4b6-4f53-9306-7d064b56dec4 tempest-VolumeQuotasAdminTestJSON-1250402019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:45.117308 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5418d2bd-e4b6-4f53-9306-7d064b56dec4 tempest-VolumeQuotasAdminTestJSON-1250402019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:57:45.215437 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-5418d2bd-e4b6-4f53-9306-7d064b56dec4 tempest-VolumeQuotasAdminTestJSON-1250402019 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:57:45.220282 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-5418d2bd-e4b6-4f53-9306-7d064b56dec4 tempest-VolumeQuotasAdminTestJSON-1250402019 None] Deleted volume successfully. Jan 29 20:57:45.253468 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-5418d2bd-e4b6-4f53-9306-7d064b56dec4 tempest-VolumeQuotasAdminTestJSON-1250402019 None] Lock "b'cinder-ee54b8b7-213d-4a67-88fb-37953da3a8d1-delete_volume'" released by "delete_volume" :: held 1.049s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:58:28.639799 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:58:28.641645 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:58:28.709404 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:58:28.776200 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:58:41.600294 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-4e5dca62-089a-4dbe-8f3a-d40c5247fef2 req-3f07aa6a-f2ac-4178-97fa-eab8c7863192 tempest-ServersTestBootFromVolume-1029629551 None] Terminate volume connection completed successfully. Jan 29 20:58:41.601059 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-4e5dca62-089a-4dbe-8f3a-d40c5247fef2 req-3f07aa6a-f2ac-4178-97fa-eab8c7863192 tempest-ServersTestBootFromVolume-1029629551 None] Deleting attachment c909ba91-64f4-4dc6-8356-c2a60f1b642d. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 20:58:41.844190 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-4e5dca62-089a-4dbe-8f3a-d40c5247fef2 req-8c6b9016-28c9-4662-8db1-1cde735d8492 tempest-ServersTestBootFromVolume-1029629551 None] Lock "b'cinder-c295a19f-01eb-4b4f-966f-ccf98d7bd287-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:58:41.929823 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-4e5dca62-089a-4dbe-8f3a-d40c5247fef2 req-8c6b9016-28c9-4662-8db1-1cde735d8492 tempest-ServersTestBootFromVolume-1029629551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:58:42.130465 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-4e5dca62-089a-4dbe-8f3a-d40c5247fef2 req-8c6b9016-28c9-4662-8db1-1cde735d8492 tempest-ServersTestBootFromVolume-1029629551 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:58:42.146326 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-4e5dca62-089a-4dbe-8f3a-d40c5247fef2 req-8c6b9016-28c9-4662-8db1-1cde735d8492 tempest-ServersTestBootFromVolume-1029629551 None] deleting rbd volume volume-c295a19f-01eb-4b4f-966f-ccf98d7bd287 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:58:42.567942 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-4e5dca62-089a-4dbe-8f3a-d40c5247fef2 req-8c6b9016-28c9-4662-8db1-1cde735d8492 tempest-ServersTestBootFromVolume-1029629551 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 20:58:42.607663 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-4e5dca62-089a-4dbe-8f3a-d40c5247fef2 req-8c6b9016-28c9-4662-8db1-1cde735d8492 tempest-ServersTestBootFromVolume-1029629551 None] deleting parent snapshot volume-c295a19f-01eb-4b4f-966f-ccf98d7bd287.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 20:58:43.595661 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [req-4e5dca62-089a-4dbe-8f3a-d40c5247fef2 req-8c6b9016-28c9-4662-8db1-1cde735d8492 tempest-ServersTestBootFromVolume-1029629551 None] Created reservations ['313c1935-98b3-46cf-81ab-9406002c9ad4', 'bd4f8997-8187-4fe7-ba33-d2210145f610', '7266843f-f3c9-4512-9e28-303c0464a3b7', 'c9eed9ec-e753-491e-ac38-3f8619f7901b'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:58:43.699605 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-4e5dca62-089a-4dbe-8f3a-d40c5247fef2 req-8c6b9016-28c9-4662-8db1-1cde735d8492 tempest-ServersTestBootFromVolume-1029629551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:58:43.793364 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-4e5dca62-089a-4dbe-8f3a-d40c5247fef2 req-8c6b9016-28c9-4662-8db1-1cde735d8492 tempest-ServersTestBootFromVolume-1029629551 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:58:43.873964 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [req-4e5dca62-089a-4dbe-8f3a-d40c5247fef2 req-8c6b9016-28c9-4662-8db1-1cde735d8492 tempest-ServersTestBootFromVolume-1029629551 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:58:43.885969 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-4e5dca62-089a-4dbe-8f3a-d40c5247fef2 req-8c6b9016-28c9-4662-8db1-1cde735d8492 tempest-ServersTestBootFromVolume-1029629551 None] Deleted volume successfully. Jan 29 20:58:43.905191 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-4e5dca62-089a-4dbe-8f3a-d40c5247fef2 req-8c6b9016-28c9-4662-8db1-1cde735d8492 tempest-ServersTestBootFromVolume-1029629551 None] Lock "b'cinder-c295a19f-01eb-4b4f-966f-ccf98d7bd287-delete_volume'" released by "delete_volume" :: held 2.065s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:59:00.769039 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-24dc49a5-a0b6-457b-9da0-8ae2a16e613b tempest-DeleteServersTestJSON-1517781922 None] Lock "b'cinder-19eb68a0-1d8d-4519-9ceb-4ddb7679608a-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:59:00.843566 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-24dc49a5-a0b6-457b-9da0-8ae2a16e613b tempest-DeleteServersTestJSON-1517781922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:59:00.937976 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-24dc49a5-a0b6-457b-9da0-8ae2a16e613b tempest-DeleteServersTestJSON-1517781922 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:59:00.938448 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-24dc49a5-a0b6-457b-9da0-8ae2a16e613b tempest-DeleteServersTestJSON-1517781922 None] Volume volume-19eb68a0-1d8d-4519-9ceb-4ddb7679608a is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:59:00.947852 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-24dc49a5-a0b6-457b-9da0-8ae2a16e613b tempest-DeleteServersTestJSON-1517781922 None] deleting rbd volume volume-19eb68a0-1d8d-4519-9ceb-4ddb7679608a {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:59:01.181820 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-24dc49a5-a0b6-457b-9da0-8ae2a16e613b tempest-DeleteServersTestJSON-1517781922 None] Created reservations ['3e7b7ffa-441b-4165-a98c-1fec1ed85971', '9d7d9952-96d5-417f-ade3-8ebc6fec0c53', 'c5e9ee3e-73c5-4847-aed2-105825b65b5d', 'c7a00ba2-002c-482d-8154-70d517b29547'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:59:01.242867 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-24dc49a5-a0b6-457b-9da0-8ae2a16e613b tempest-DeleteServersTestJSON-1517781922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:59:01.274993 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-24dc49a5-a0b6-457b-9da0-8ae2a16e613b tempest-DeleteServersTestJSON-1517781922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:59:01.311139 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-24dc49a5-a0b6-457b-9da0-8ae2a16e613b tempest-DeleteServersTestJSON-1517781922 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:59:01.319621 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-24dc49a5-a0b6-457b-9da0-8ae2a16e613b tempest-DeleteServersTestJSON-1517781922 None] Deleted volume successfully. Jan 29 20:59:01.332487 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-24dc49a5-a0b6-457b-9da0-8ae2a16e613b tempest-DeleteServersTestJSON-1517781922 None] Lock "b'cinder-19eb68a0-1d8d-4519-9ceb-4ddb7679608a-delete_volume'" released by "delete_volume" :: held 0.564s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:59:28.644038 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 20:59:28.644679 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:59:28.721238 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:59:28.792675 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:59:38.985848 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-53556723-ba29-4bbe-900f-1bbc04d0f50c tempest-ServersNegativeTestJSON-1137596608 None] Lock "b'cinder-85612ae1-7fdd-4d0b-856b-2e8ff27c607c-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:59:39.053722 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-53556723-ba29-4bbe-900f-1bbc04d0f50c tempest-ServersNegativeTestJSON-1137596608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:59:39.148714 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-53556723-ba29-4bbe-900f-1bbc04d0f50c tempest-ServersNegativeTestJSON-1137596608 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:59:39.149179 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-53556723-ba29-4bbe-900f-1bbc04d0f50c tempest-ServersNegativeTestJSON-1137596608 None] Volume volume-85612ae1-7fdd-4d0b-856b-2e8ff27c607c is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:59:39.170955 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-53556723-ba29-4bbe-900f-1bbc04d0f50c tempest-ServersNegativeTestJSON-1137596608 None] deleting rbd volume volume-85612ae1-7fdd-4d0b-856b-2e8ff27c607c {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:59:39.733742 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-53556723-ba29-4bbe-900f-1bbc04d0f50c tempest-ServersNegativeTestJSON-1137596608 None] Created reservations ['db77b816-fbf7-415f-9c7b-5a39e34c3de6', '00b1c466-d040-46a4-a1a5-b4cdbd966c40', '96de03e8-e89d-4ecb-b586-4133c18af17a', 'de27cefd-04a0-42d2-9a0d-3574d24abd16'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:59:39.816525 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-53556723-ba29-4bbe-900f-1bbc04d0f50c tempest-ServersNegativeTestJSON-1137596608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:59:39.875139 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-53556723-ba29-4bbe-900f-1bbc04d0f50c tempest-ServersNegativeTestJSON-1137596608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:59:39.939370 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-53556723-ba29-4bbe-900f-1bbc04d0f50c tempest-ServersNegativeTestJSON-1137596608 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:59:39.945735 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-53556723-ba29-4bbe-900f-1bbc04d0f50c tempest-ServersNegativeTestJSON-1137596608 None] Deleted volume successfully. Jan 29 20:59:39.964598 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-53556723-ba29-4bbe-900f-1bbc04d0f50c tempest-ServersNegativeTestJSON-1137596608 None] Lock "b'cinder-85612ae1-7fdd-4d0b-856b-2e8ff27c607c-delete_volume'" released by "delete_volume" :: held 0.979s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 20:59:40.210108 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-fb453ba7-59db-442b-ad2c-5451fe629ad0 tempest-ServersNegativeTestJSON-1137596608 None] Lock "b'cinder-24b5480f-5237-4f1e-b5cd-970aef5d58fc-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 20:59:40.291926 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fb453ba7-59db-442b-ad2c-5451fe629ad0 tempest-ServersNegativeTestJSON-1137596608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:59:40.418711 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fb453ba7-59db-442b-ad2c-5451fe629ad0 tempest-ServersNegativeTestJSON-1137596608 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 20:59:40.419212 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fb453ba7-59db-442b-ad2c-5451fe629ad0 tempest-ServersNegativeTestJSON-1137596608 None] Volume volume-24b5480f-5237-4f1e-b5cd-970aef5d58fc is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 20:59:40.433284 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fb453ba7-59db-442b-ad2c-5451fe629ad0 tempest-ServersNegativeTestJSON-1137596608 None] deleting rbd volume volume-24b5480f-5237-4f1e-b5cd-970aef5d58fc {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 20:59:40.961961 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-fb453ba7-59db-442b-ad2c-5451fe629ad0 tempest-ServersNegativeTestJSON-1137596608 None] Created reservations ['67c04a33-2ce3-405c-98e9-94a06a63eabe', '683af356-713f-464f-af5e-1f199b3fa7a4', '579a1987-11a4-41bf-bf89-e21eccddb5c7', '4d8043bc-5584-4d8b-a64d-e8782984ae79'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 20:59:41.054550 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fb453ba7-59db-442b-ad2c-5451fe629ad0 tempest-ServersNegativeTestJSON-1137596608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:59:41.132894 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fb453ba7-59db-442b-ad2c-5451fe629ad0 tempest-ServersNegativeTestJSON-1137596608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 20:59:41.200863 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-fb453ba7-59db-442b-ad2c-5451fe629ad0 tempest-ServersNegativeTestJSON-1137596608 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 20:59:41.209332 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-fb453ba7-59db-442b-ad2c-5451fe629ad0 tempest-ServersNegativeTestJSON-1137596608 None] Deleted volume successfully. Jan 29 20:59:41.237697 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-fb453ba7-59db-442b-ad2c-5451fe629ad0 tempest-ServersNegativeTestJSON-1137596608 None] Lock "b'cinder-24b5480f-5237-4f1e-b5cd-970aef5d58fc-delete_volume'" released by "delete_volume" :: held 1.027s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:00:28.649670 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:00:28.650484 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:00:28.758768 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:00:28.845295 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:00:54.601912 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:00:54.606981 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:00:54.606981 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:00:54.636123 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Flow 'volume_create_manager' (dc683a08-abc1-4a62-9670-ec8f52419a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:00:54.660001 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c12b60-35e6-461e-ab31-a4b2550431bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:00:54.673532 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:00:54.722014 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c12b60-35e6-461e-ab31-a4b2550431bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1674876056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0e406c47-282d-4d04-a08f-8cfecc4290c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd4d14f918d841dbb3dff9a919096e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:00:55Z,use_quota=True,user_id='70f78eb1030445dd92df792724587668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:00:54.744851 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfb49c5-5d99-4e4d-b9a9-e7edf888444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:00:54.761981 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfb49c5-5d99-4e4d-b9a9-e7edf888444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:00:54.767229 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252e685d-1e1f-479d-9a34-8a5fe9ad9407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:00:54.788058 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252e685d-1e1f-479d-9a34-8a5fe9ad9407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e406c47-282d-4d04-a08f-8cfecc4290c6', 'volume_name': 'volume-0e406c47-282d-4d04-a08f-8cfecc4290c6', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:00:54.798002 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a4e5c9-f47e-4750-9acf-e996b3027bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:00:54.833134 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a4e5c9-f47e-4750-9acf-e996b3027bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:00:54.838918 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba1d5ec-9af2-4e75-b7e4-7c0a2664a935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:00:54.840599 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Volume 0e406c47-282d-4d04-a08f-8cfecc4290c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e406c47-282d-4d04-a08f-8cfecc4290c6', 'volume_size': 1} Jan 29 21:00:54.841048 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] creating volume 'volume-0e406c47-282d-4d04-a08f-8cfecc4290c6' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:00:54.842215 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:00:54.949964 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:00:54.950531 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:00:54.955347 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba1d5ec-9af2-4e75-b7e4-7c0a2664a935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e406c47-282d-4d04-a08f-8cfecc4290c6', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:00:54.960646 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffb89de-70bc-4a71-a041-a8ea1298885b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:00:54.974928 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Volume volume-0e406c47-282d-4d04-a08f-8cfecc4290c6 (0e406c47-282d-4d04-a08f-8cfecc4290c6): created successfully Jan 29 21:00:54.982736 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffb89de-70bc-4a71-a041-a8ea1298885b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:00:54.989355 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Flow 'volume_create_manager' (dc683a08-abc1-4a62-9670-ec8f52419a84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:00:55.004289 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6c282a0d-0fd1-413a-b421-bc84cd912abd tempest-AttachSCSIVolumeTestJSON-1587418501 None] Created volume successfully. Jan 29 21:00:56.356844 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-c8dd340a-fee3-4186-853e-ca2ae42eb192 req-da356dd9-2acc-4420-90ef-bfed7afcd8a7 tempest-AttachSCSIVolumeTestJSON-1587418501 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:00:57.857627 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-c8dd340a-fee3-4186-853e-ca2ae42eb192 req-da356dd9-2acc-4420-90ef-bfed7afcd8a7 tempest-AttachSCSIVolumeTestJSON-1587418501 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.500s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:00:57.858480 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-c8dd340a-fee3-4186-853e-ca2ae42eb192 req-da356dd9-2acc-4420-90ef-bfed7afcd8a7 tempest-AttachSCSIVolumeTestJSON-1587418501 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0e406c47-282d-4d04-a08f-8cfecc4290c6', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '0e406c47-282d-4d04-a08f-8cfecc4290c6', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:00:57.904956 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-c8dd340a-fee3-4186-853e-ca2ae42eb192 req-da356dd9-2acc-4420-90ef-bfed7afcd8a7 tempest-AttachSCSIVolumeTestJSON-1587418501 None] Connection info returned from driver {'name': 'volumes/volume-0e406c47-282d-4d04-a08f-8cfecc4290c6', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0e406c47-282d-4d04-a08f-8cfecc4290c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '39c3c248-8861-4934-aaab-02c68df56297'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:00:58.029658 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-c8dd340a-fee3-4186-853e-ca2ae42eb192 req-da356dd9-2acc-4420-90ef-bfed7afcd8a7 tempest-AttachSCSIVolumeTestJSON-1587418501 None] attachment_update completed successfully. Jan 29 21:01:01.795565 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-2fb4e29b-84c9-4254-986f-b2d9396b1eeb req-ca7a67c7-96b9-4a34-90a0-d03e4cf95108 tempest-AttachSCSIVolumeTestJSON-1587418501 None] Terminate volume connection completed successfully. Jan 29 21:01:01.796226 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-2fb4e29b-84c9-4254-986f-b2d9396b1eeb req-ca7a67c7-96b9-4a34-90a0-d03e4cf95108 tempest-AttachSCSIVolumeTestJSON-1587418501 None] Deleting attachment 39c3c248-8861-4934-aaab-02c68df56297. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:01:08.602414 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-16d204be-4a3b-4b3e-a257-8ce39afaa0a8 tempest-AttachSCSIVolumeTestJSON-1587418501 None] Lock "b'cinder-0e406c47-282d-4d04-a08f-8cfecc4290c6-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:01:08.673824 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-16d204be-4a3b-4b3e-a257-8ce39afaa0a8 tempest-AttachSCSIVolumeTestJSON-1587418501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:01:08.766351 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-16d204be-4a3b-4b3e-a257-8ce39afaa0a8 tempest-AttachSCSIVolumeTestJSON-1587418501 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:01:08.766892 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-16d204be-4a3b-4b3e-a257-8ce39afaa0a8 tempest-AttachSCSIVolumeTestJSON-1587418501 None] Volume volume-0e406c47-282d-4d04-a08f-8cfecc4290c6 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:01:08.794090 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-16d204be-4a3b-4b3e-a257-8ce39afaa0a8 tempest-AttachSCSIVolumeTestJSON-1587418501 None] deleting rbd volume volume-0e406c47-282d-4d04-a08f-8cfecc4290c6 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:01:09.146912 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-16d204be-4a3b-4b3e-a257-8ce39afaa0a8 tempest-AttachSCSIVolumeTestJSON-1587418501 None] Created reservations ['9d9be182-565a-4067-93c9-713a013b686d', 'bc77b31c-7b16-4cb3-836e-958158cdbc1e', '8a3f2740-82a8-4b98-a9b8-591c59ac6dd4', '84948876-567c-43b1-9553-fb1094096d69'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:01:09.212270 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-16d204be-4a3b-4b3e-a257-8ce39afaa0a8 tempest-AttachSCSIVolumeTestJSON-1587418501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:01:09.277788 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-16d204be-4a3b-4b3e-a257-8ce39afaa0a8 tempest-AttachSCSIVolumeTestJSON-1587418501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:01:09.343030 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-16d204be-4a3b-4b3e-a257-8ce39afaa0a8 tempest-AttachSCSIVolumeTestJSON-1587418501 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:01:09.348642 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-16d204be-4a3b-4b3e-a257-8ce39afaa0a8 tempest-AttachSCSIVolumeTestJSON-1587418501 None] Deleted volume successfully. Jan 29 21:01:09.371988 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-16d204be-4a3b-4b3e-a257-8ce39afaa0a8 tempest-AttachSCSIVolumeTestJSON-1587418501 None] Lock "b'cinder-0e406c47-282d-4d04-a08f-8cfecc4290c6-delete_volume'" released by "delete_volume" :: held 0.770s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:01:28.654462 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:01:28.655785 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:01:28.719182 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:01:28.764467 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:02:28.656378 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:02:28.656378 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:02:28.713174 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:02:28.822333 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:02:36.216500 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:02:36.231070 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:02:36.235987 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:02:36.309772 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Flow 'volume_create_manager' (3bf567b9-ccc6-4d2c-981c-5ed5f9ccfe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:02:36.340503 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf70a7a-9bf6-4918-933b-97f2fe6198b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:36.361808 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:02:36.424961 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf70a7a-9bf6-4918-933b-97f2fe6198b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1106451804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29143fe0aaba428f94401ae5bb5d9012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:02:36Z,use_quota=True,user_id='54a259ffde8c4f4da748312b5e5d0079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:36.459665 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11f9aa9-8d86-4706-a84f-2c28cffb6bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:36.464304 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11f9aa9-8d86-4706-a84f-2c28cffb6bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:36.501399 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17bffa6-b352-464a-867b-104e42b20c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:36.775307 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17bffa6-b352-464a-867b-104e42b20c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1', 'volume_name': 'volume-f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:36.788565 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d84ca97-b7ac-4dad-8af7-46ae410c8f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:36.827992 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d84ca97-b7ac-4dad-8af7-46ae410c8f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:36.834310 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508e1c53-30cf-450b-9063-daec1568c3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:36.858561 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Volume f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 21:02:36.861126 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Cloning f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1 from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 21:02:36.879948 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:02:36.919452 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 2, 36, 901622)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:02:36.920159 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:02:36.920749 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Found cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 29 21:02:36.928567 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 0.048s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:02:36.929908 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 21:02:36.957753 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 2, 36, 949931)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:02:36.959879 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:02:36.960293 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Creating from source image-volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 29 21:02:37.010740 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:02:37.175178 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] creating snapshot='volume-f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 21:02:37.801714 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] cloning 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe@volume-f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1.clone_snap' to 'volume-f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 21:02:38.046155 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:02:38.047646 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:02:38.048223 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:02:38.108432 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 21:02:38.109718 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Marking volume f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1 as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 21:02:38.130892 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 21:02:38.131469 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Creating volume glance metadata for volume f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1 backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 21:02:38.269235 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508e1c53-30cf-450b-9063-daec1568c3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:38.281783 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86426615-96c7-4030-a1af-950b6e790e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:38.321842 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Volume volume-f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1 (f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1): created successfully Jan 29 21:02:38.329676 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86426615-96c7-4030-a1af-950b6e790e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:38.351546 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Flow 'volume_create_manager' (3bf567b9-ccc6-4d2c-981c-5ed5f9ccfe84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:02:38.379512 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-8fd0a4c3-bcc4-4ad8-b9f4-1ed379141395 tempest-TaggedBootDevicesTest_v242-78673303 None] Created volume successfully. Jan 29 21:02:40.309902 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:02:40.318802 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:02:40.320250 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:02:40.375403 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Flow 'volume_create_manager' (f7e897b1-b8a3-4f91-9d51-60f8eac70528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:02:40.389855 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8a3aa3-8406-4dd0-951b-7c9b83a49e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:40.405317 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:02:40.438173 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8a3aa3-8406-4dd0-951b-7c9b83a49e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-349424700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7d9d3c11-4660-4244-b3d4-a3012eff5793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29143fe0aaba428f94401ae5bb5d9012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:02:40Z,use_quota=True,user_id='54a259ffde8c4f4da748312b5e5d0079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:40.451538 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8a2ed0-4308-465e-828c-5179e690e68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:40.462237 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8a2ed0-4308-465e-828c-5179e690e68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:40.485418 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138afd88-1345-4981-8ecf-89f02a1a82cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:40.495775 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138afd88-1345-4981-8ecf-89f02a1a82cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d9d3c11-4660-4244-b3d4-a3012eff5793', 'volume_name': 'volume-7d9d3c11-4660-4244-b3d4-a3012eff5793', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:40.508977 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f971cc4-dbb2-4354-bca5-3395430a33fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:40.519162 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f971cc4-dbb2-4354-bca5-3395430a33fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:40.529249 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3baded67-7989-4cc6-ba4c-74c913b554f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:40.532902 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Volume 7d9d3c11-4660-4244-b3d4-a3012eff5793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d9d3c11-4660-4244-b3d4-a3012eff5793', 'volume_size': 1} Jan 29 21:02:40.535771 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] creating volume 'volume-7d9d3c11-4660-4244-b3d4-a3012eff5793' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:02:40.538325 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:02:40.718152 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:02:40.718514 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:02:40.722679 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3baded67-7989-4cc6-ba4c-74c913b554f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d9d3c11-4660-4244-b3d4-a3012eff5793', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:40.728461 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f722d416-0c72-43fe-b938-90d1047b2116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:40.770236 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Volume volume-7d9d3c11-4660-4244-b3d4-a3012eff5793 (7d9d3c11-4660-4244-b3d4-a3012eff5793): created successfully Jan 29 21:02:40.775245 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f722d416-0c72-43fe-b938-90d1047b2116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:40.788382 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Flow 'volume_create_manager' (f7e897b1-b8a3-4f91-9d51-60f8eac70528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:02:40.831510 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-3c707a3f-0a61-4fc2-8d5f-d225b39d5baf tempest-TaggedBootDevicesTest_v242-78673303 None] Created volume successfully. Jan 29 21:02:41.951985 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:02:41.964914 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:02:41.965776 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:02:42.050096 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Flow 'volume_create_manager' (d7740259-a389-4b28-8c50-3d0dbf588ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:02:42.065085 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4060cdcb-9144-4e50-923e-5044fff1340b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:42.079317 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:02:42.110807 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4060cdcb-9144-4e50-923e-5044fff1340b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-652068145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29143fe0aaba428f94401ae5bb5d9012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:02:42Z,use_quota=True,user_id='54a259ffde8c4f4da748312b5e5d0079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:42.126920 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ac0c67-def7-415d-9b2d-56728795d4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:42.139329 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ac0c67-def7-415d-9b2d-56728795d4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:42.151704 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc2b83c-d1b5-4aaf-9832-0f7c41ab78c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:42.163870 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc2b83c-d1b5-4aaf-9832-0f7c41ab78c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7', 'volume_name': 'volume-d9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:42.189334 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e3e166-8f5d-4bf8-a537-fc7d52554d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:42.202242 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e3e166-8f5d-4bf8-a537-fc7d52554d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:42.213257 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862bdd06-b7e1-4b9e-9912-b72facda467d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:42.216571 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Volume d9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7', 'volume_size': 1} Jan 29 21:02:42.225094 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] creating volume 'volume-d9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:02:42.226370 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:02:42.414388 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:02:42.414854 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:02:42.420705 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862bdd06-b7e1-4b9e-9912-b72facda467d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:42.440523 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ab12cc-e5c3-4d93-a338-86fac35e40b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:42.482252 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Volume volume-d9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7 (d9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7): created successfully Jan 29 21:02:42.490410 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ab12cc-e5c3-4d93-a338-86fac35e40b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:42.505172 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Flow 'volume_create_manager' (d7740259-a389-4b28-8c50-3d0dbf588ba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:02:42.519970 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-5c15067e-5ee8-4ab4-8734-1fcd763d242d tempest-TaggedBootDevicesTest_v242-78673303 None] Created volume successfully. Jan 29 21:02:57.076666 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4cc71a81-a694-4952-951c-40afabecf211 tempest-GroupSnapshotsV319Test-61401958 None] Group tempest-GroupSnapshotsV319Test-Group-1895651777: creating Jan 29 21:02:57.145101 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4cc71a81-a694-4952-951c-40afabecf211 tempest-GroupSnapshotsV319Test-61401958 None] Group tempest-GroupSnapshotsV319Test-Group-1895651777: created successfully Jan 29 21:02:57.186611 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4cc71a81-a694-4952-951c-40afabecf211 tempest-GroupSnapshotsV319Test-61401958 None] Create group completed successfully. Jan 29 21:02:59.017541 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:02:59.021679 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:02:59.022213 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:02:59.067433 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Flow 'volume_create_manager' (79dda8d0-afb3-4d21-a324-521fef41a2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:02:59.086815 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eeeff60-4e9c-443b-b607-f50c9e20ecdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:59.105997 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:02:59.137290 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eeeff60-4e9c-443b-b607-f50c9e20ecdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-436132535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f03d3926-8d46-4d1a-a3cb-09dba0e5d2b8,host='ncdv-master-1@ceph#ceph',id=8dc9171d-0b8a-4230-9370-9d4e43c98d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b2e11cabbea4dbc93bc7c8720568c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:02:59Z,use_quota=True,user_id='1871655fe9f0417c841629825da9994a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49ba93aa-1a47-4d5b-887a-144b942bce38),volume_type_id=49ba93aa-1a47-4d5b-887a-144b942bce38)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:59.147171 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f64765-f5b2-4058-bd2b-6da5733ca518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:59.163696 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f64765-f5b2-4058-bd2b-6da5733ca518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:59.169230 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca8bec2-d67b-4c08-a453-ffbe15723ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:59.175540 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca8bec2-d67b-4c08-a453-ffbe15723ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc9171d-0b8a-4230-9370-9d4e43c98d0c', 'volume_name': 'volume-8dc9171d-0b8a-4230-9370-9d4e43c98d0c', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:59.194584 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3277dbd-dea4-4636-b965-0cb80923c9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:59.202603 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3277dbd-dea4-4636-b965-0cb80923c9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:59.209025 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bc6004-7993-4807-8c0e-92cafe691cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:59.216352 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Volume 8dc9171d-0b8a-4230-9370-9d4e43c98d0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc9171d-0b8a-4230-9370-9d4e43c98d0c', 'volume_size': 1} Jan 29 21:02:59.217085 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] creating volume 'volume-8dc9171d-0b8a-4230-9370-9d4e43c98d0c' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:02:59.218279 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:02:59.350468 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] extra_specs: {} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:02:59.352941 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] extra_specs: {} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:02:59.358283 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bc6004-7993-4807-8c0e-92cafe691cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc9171d-0b8a-4230-9370-9d4e43c98d0c', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:59.373344 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85baf91-dbb5-402f-a5dc-cf458c1b1de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:02:59.400428 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Volume volume-8dc9171d-0b8a-4230-9370-9d4e43c98d0c (8dc9171d-0b8a-4230-9370-9d4e43c98d0c): created successfully Jan 29 21:02:59.424117 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85baf91-dbb5-402f-a5dc-cf458c1b1de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:02:59.441783 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Flow 'volume_create_manager' (79dda8d0-afb3-4d21-a324-521fef41a2e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:02:59.496260 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-37bb55d8-b2b1-48cf-a421-4b394a4ec550 tempest-GroupSnapshotsV319Test-61401958 None] Created volume successfully. Jan 29 21:03:00.489087 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-0079cc73-50dd-4a3b-a7cd-0b7879e13983 tempest-GroupSnapshotsV319Test-61401958 None] GroupSnapshot f74aa340-5667-4d1b-bb53-82fd0ac133e1: creating. Jan 29 21:03:00.578309 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0079cc73-50dd-4a3b-a7cd-0b7879e13983 tempest-GroupSnapshotsV319Test-61401958 None] Group snapshot f74aa340-5667-4d1b-bb53-82fd0ac133e1: creating. {{(pid=134283) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4077}} Jan 29 21:03:00.617852 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0079cc73-50dd-4a3b-a7cd-0b7879e13983 tempest-GroupSnapshotsV319Test-61401958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:02.068368 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-0079cc73-50dd-4a3b-a7cd-0b7879e13983 tempest-GroupSnapshotsV319Test-61401958 None] group_snapshot f74aa340-5667-4d1b-bb53-82fd0ac133e1: created successfully Jan 29 21:03:03.433852 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-646f3eb3-7927-4d31-a82c-f4faf9edb01b tempest-GroupSnapshotsV319Test-61401958 None] group_snapshot f74aa340-5667-4d1b-bb53-82fd0ac133e1: deleting Jan 29 21:03:03.483646 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-646f3eb3-7927-4d31-a82c-f4faf9edb01b tempest-GroupSnapshotsV319Test-61401958 None] group_snapshot f74aa340-5667-4d1b-bb53-82fd0ac133e1: deleting {{(pid=134283) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4252}} Jan 29 21:03:03.524085 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-646f3eb3-7927-4d31-a82c-f4faf9edb01b tempest-GroupSnapshotsV319Test-61401958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:03.947744 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-646f3eb3-7927-4d31-a82c-f4faf9edb01b tempest-GroupSnapshotsV319Test-61401958 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-735372835 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-735372835, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:03:03.948760 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-646f3eb3-7927-4d31-a82c-f4faf9edb01b tempest-GroupSnapshotsV319Test-61401958 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-735372835 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-735372835, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:03:03.968397 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-646f3eb3-7927-4d31-a82c-f4faf9edb01b tempest-GroupSnapshotsV319Test-61401958 None] Created reservations ['ebd42f3a-1c52-44b2-8363-deb3a5424ef6', '0b28753b-a424-488f-88f5-9173cb59f8fd', '0d3d25f4-4786-472c-9fbc-486ad30368bf', '1d7ec8a3-25fa-4bbc-8fcb-2198595e215e'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:03:04.059710 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-646f3eb3-7927-4d31-a82c-f4faf9edb01b tempest-GroupSnapshotsV319Test-61401958 None] group_snapshot f74aa340-5667-4d1b-bb53-82fd0ac133e1: deleted successfully Jan 29 21:03:05.212304 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6ddd4225-0651-40ce-8204-cae81619b919 tempest-GroupSnapshotsV319Test-61401958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:05.273937 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6ddd4225-0651-40ce-8204-cae81619b919 tempest-GroupSnapshotsV319Test-61401958 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:03:05.274796 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6ddd4225-0651-40ce-8204-cae81619b919 tempest-GroupSnapshotsV319Test-61401958 None] Volume volume-8dc9171d-0b8a-4230-9370-9d4e43c98d0c is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:03:05.284299 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6ddd4225-0651-40ce-8204-cae81619b919 tempest-GroupSnapshotsV319Test-61401958 None] deleting rbd volume volume-8dc9171d-0b8a-4230-9370-9d4e43c98d0c {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:03:05.772437 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-6ddd4225-0651-40ce-8204-cae81619b919 tempest-GroupSnapshotsV319Test-61401958 None] Created reservations ['9e1426d5-987b-4879-b5b9-b60acee5ca33'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:03:05.803568 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-6ddd4225-0651-40ce-8204-cae81619b919 tempest-GroupSnapshotsV319Test-61401958 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-735372835 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-735372835, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:03:05.826634 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-6ddd4225-0651-40ce-8204-cae81619b919 tempest-GroupSnapshotsV319Test-61401958 None] Created reservations ['509a5a59-0274-4d66-b740-7cec713521e5', 'e8948161-6792-4b00-a609-22bfdfefdf67', '7e5c866c-ee69-4dfc-9c65-92fe0b6843af', '02f333ae-6f29-4d16-b737-4d2075f732b6'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:03:05.959590 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6ddd4225-0651-40ce-8204-cae81619b919 tempest-GroupSnapshotsV319Test-61401958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:06.034114 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6ddd4225-0651-40ce-8204-cae81619b919 tempest-GroupSnapshotsV319Test-61401958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:06.099029 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-6ddd4225-0651-40ce-8204-cae81619b919 tempest-GroupSnapshotsV319Test-61401958 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:03:06.105489 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6ddd4225-0651-40ce-8204-cae81619b919 tempest-GroupSnapshotsV319Test-61401958 None] Delete group completed successfully. Jan 29 21:03:09.836133 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-f095e2ac-0cbb-4411-b2ad-bd90c1d3dd3c req-c9c2d9cd-b4de-46c5-97d3-72eb7765f9af tempest-TaggedBootDevicesTest_v242-78673303 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:03:10.997461 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-f095e2ac-0cbb-4411-b2ad-bd90c1d3dd3c req-c9c2d9cd-b4de-46c5-97d3-72eb7765f9af tempest-TaggedBootDevicesTest_v242-78673303 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.160s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:03:10.999440 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-f095e2ac-0cbb-4411-b2ad-bd90c1d3dd3c req-c9c2d9cd-b4de-46c5-97d3-72eb7765f9af tempest-TaggedBootDevicesTest_v242-78673303 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:03:11.057983 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-f095e2ac-0cbb-4411-b2ad-bd90c1d3dd3c req-c9c2d9cd-b4de-46c5-97d3-72eb7765f9af tempest-TaggedBootDevicesTest_v242-78673303 None] Connection info returned from driver {'name': 'volumes/volume-f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bb9ba474-0643-4590-a7a6-63d36229b7c2'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:03:11.125457 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-f095e2ac-0cbb-4411-b2ad-bd90c1d3dd3c req-c9c2d9cd-b4de-46c5-97d3-72eb7765f9af tempest-TaggedBootDevicesTest_v242-78673303 None] attachment_update completed successfully. Jan 29 21:03:11.786149 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-f095e2ac-0cbb-4411-b2ad-bd90c1d3dd3c req-0ec3a37f-bda0-449d-89d5-5da70a58c6a8 tempest-TaggedBootDevicesTest_v242-78673303 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:03:12.914731 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-f095e2ac-0cbb-4411-b2ad-bd90c1d3dd3c req-0ec3a37f-bda0-449d-89d5-5da70a58c6a8 tempest-TaggedBootDevicesTest_v242-78673303 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.128s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:03:12.915703 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-f095e2ac-0cbb-4411-b2ad-bd90c1d3dd3c req-0ec3a37f-bda0-449d-89d5-5da70a58c6a8 tempest-TaggedBootDevicesTest_v242-78673303 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7d9d3c11-4660-4244-b3d4-a3012eff5793', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '7d9d3c11-4660-4244-b3d4-a3012eff5793', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:03:12.948081 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-f095e2ac-0cbb-4411-b2ad-bd90c1d3dd3c req-0ec3a37f-bda0-449d-89d5-5da70a58c6a8 tempest-TaggedBootDevicesTest_v242-78673303 None] Connection info returned from driver {'name': 'volumes/volume-7d9d3c11-4660-4244-b3d4-a3012eff5793', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7d9d3c11-4660-4244-b3d4-a3012eff5793', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6285af40-9ef5-478e-866a-5541bcf8b223'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:03:13.032033 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-f095e2ac-0cbb-4411-b2ad-bd90c1d3dd3c req-0ec3a37f-bda0-449d-89d5-5da70a58c6a8 tempest-TaggedBootDevicesTest_v242-78673303 None] attachment_update completed successfully. Jan 29 21:03:13.388938 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-f095e2ac-0cbb-4411-b2ad-bd90c1d3dd3c req-9b697074-8b08-47b6-9f11-44ccce4e7fbf tempest-TaggedBootDevicesTest_v242-78673303 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:03:14.615559 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-f095e2ac-0cbb-4411-b2ad-bd90c1d3dd3c req-9b697074-8b08-47b6-9f11-44ccce4e7fbf tempest-TaggedBootDevicesTest_v242-78673303 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.226s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:03:14.616294 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-f095e2ac-0cbb-4411-b2ad-bd90c1d3dd3c req-9b697074-8b08-47b6-9f11-44ccce4e7fbf tempest-TaggedBootDevicesTest_v242-78673303 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'd9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:03:14.657144 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-f095e2ac-0cbb-4411-b2ad-bd90c1d3dd3c req-9b697074-8b08-47b6-9f11-44ccce4e7fbf tempest-TaggedBootDevicesTest_v242-78673303 None] Connection info returned from driver {'name': 'volumes/volume-d9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '53377e33-cee4-4064-b4dd-42b49e40f1e5'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:03:14.758209 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-f095e2ac-0cbb-4411-b2ad-bd90c1d3dd3c req-9b697074-8b08-47b6-9f11-44ccce4e7fbf tempest-TaggedBootDevicesTest_v242-78673303 None] attachment_update completed successfully. Jan 29 21:03:15.199605 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:03:15.209489 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:03:15.210254 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:03:15.296642 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Flow 'volume_create_manager' (e8e232df-a04a-4360-839e-31c5d6328db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:03:15.307468 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a18c4b-b10a-453c-8579-f31e4a66dd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:15.315058 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:03:15.331929 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a18c4b-b10a-453c-8579-f31e4a66dd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1837765120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=461386b6-a6f0-43db-8e9b-ed2a3ebf6d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ed8fa9948c431aa8606c5e886282b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:03:15Z,use_quota=True,user_id='5e3dad2cf91f492d8fa3be5b9230603d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aeca64c2-8e19-4e05-8d5c-91b746e3ca11),volume_type_id=aeca64c2-8e19-4e05-8d5c-91b746e3ca11)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:15.338654 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489f9baa-1365-4233-8e5a-275ba3e4ec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:15.353499 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489f9baa-1365-4233-8e5a-275ba3e4ec5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:15.364619 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829e25da-1d2d-4dd0-9658-fbefbb434aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:15.378263 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829e25da-1d2d-4dd0-9658-fbefbb434aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '461386b6-a6f0-43db-8e9b-ed2a3ebf6d0c', 'volume_name': 'volume-461386b6-a6f0-43db-8e9b-ed2a3ebf6d0c', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:15.393804 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8692ae9-6e92-4d5b-9347-812f888e6317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:15.404748 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8692ae9-6e92-4d5b-9347-812f888e6317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:15.422999 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12741d47-d030-4ba3-84a1-987a9c7ebd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:15.424411 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Volume 461386b6-a6f0-43db-8e9b-ed2a3ebf6d0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-461386b6-a6f0-43db-8e9b-ed2a3ebf6d0c', 'volume_size': 1} Jan 29 21:03:15.426680 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] creating volume 'volume-461386b6-a6f0-43db-8e9b-ed2a3ebf6d0c' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:03:15.430564 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:15.623273 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] extra_specs: {} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:03:15.623894 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] extra_specs: {} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:03:15.629799 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12741d47-d030-4ba3-84a1-987a9c7ebd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-461386b6-a6f0-43db-8e9b-ed2a3ebf6d0c', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:15.643814 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9171361-6c9a-4068-99f3-882799c589fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:15.665075 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Volume volume-461386b6-a6f0-43db-8e9b-ed2a3ebf6d0c (461386b6-a6f0-43db-8e9b-ed2a3ebf6d0c): created successfully Jan 29 21:03:15.667724 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9171361-6c9a-4068-99f3-882799c589fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:15.676479 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Flow 'volume_create_manager' (e8e232df-a04a-4360-839e-31c5d6328db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:03:15.716909 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-05e8d5b1-9160-4124-8a98-0678d29a5df8 tempest-VolumeTypesAccessTest-730867723 None] Created volume successfully. Jan 29 21:03:16.643224 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-2f88bcfe-f578-43b2-9aea-a68b2a61ed66 tempest-VolumeTypesAccessTest-730867723 None] Lock "b'cinder-461386b6-a6f0-43db-8e9b-ed2a3ebf6d0c-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:03:16.727263 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2f88bcfe-f578-43b2-9aea-a68b2a61ed66 tempest-VolumeTypesAccessTest-730867723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:16.852549 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2f88bcfe-f578-43b2-9aea-a68b2a61ed66 tempest-VolumeTypesAccessTest-730867723 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:03:16.853184 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2f88bcfe-f578-43b2-9aea-a68b2a61ed66 tempest-VolumeTypesAccessTest-730867723 None] Volume volume-461386b6-a6f0-43db-8e9b-ed2a3ebf6d0c is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:03:16.879566 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2f88bcfe-f578-43b2-9aea-a68b2a61ed66 tempest-VolumeTypesAccessTest-730867723 None] deleting rbd volume volume-461386b6-a6f0-43db-8e9b-ed2a3ebf6d0c {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:03:17.332687 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-2f88bcfe-f578-43b2-9aea-a68b2a61ed66 tempest-VolumeTypesAccessTest-730867723 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1549550770 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1549550770, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:03:17.333892 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-2f88bcfe-f578-43b2-9aea-a68b2a61ed66 tempest-VolumeTypesAccessTest-730867723 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1549550770 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1549550770, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:03:17.373503 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-2f88bcfe-f578-43b2-9aea-a68b2a61ed66 tempest-VolumeTypesAccessTest-730867723 None] Created reservations ['5657c3eb-9e72-4ce9-9a54-afb8d8f0cc27', '527ae7cf-74a7-43ec-80c0-c1fa5e9859ea', '96992584-3a1c-467e-8d23-89d1711327fa', '8a07cc93-9d8a-4035-848e-0c614505fe91'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:03:17.453657 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2f88bcfe-f578-43b2-9aea-a68b2a61ed66 tempest-VolumeTypesAccessTest-730867723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:17.525260 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2f88bcfe-f578-43b2-9aea-a68b2a61ed66 tempest-VolumeTypesAccessTest-730867723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:17.615589 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-2f88bcfe-f578-43b2-9aea-a68b2a61ed66 tempest-VolumeTypesAccessTest-730867723 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:03:17.644055 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-2f88bcfe-f578-43b2-9aea-a68b2a61ed66 tempest-VolumeTypesAccessTest-730867723 None] Deleted volume successfully. Jan 29 21:03:17.681351 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-2f88bcfe-f578-43b2-9aea-a68b2a61ed66 tempest-VolumeTypesAccessTest-730867723 None] Lock "b'cinder-461386b6-a6f0-43db-8e9b-ed2a3ebf6d0c-delete_volume'" released by "delete_volume" :: held 1.038s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:03:28.660213 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:03:28.660923 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:28.713924 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:28.792917 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:03:45.963174 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:03:45.968341 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:03:45.968715 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:03:46.001135 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Flow 'volume_create_manager' (95307e05-f5d4-4835-8fb0-f2280b09e9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:03:46.009781 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0332d0fc-486e-4695-b79b-a65975238f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:46.019174 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:03:46.039198 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0332d0fc-486e-4695-b79b-a65975238f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1257343176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b8cde548-0151-4a87-b84e-275327599b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744c0a71b4af48dd8e65af356934b075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:03:46Z,use_quota=True,user_id='4d654980e2a84deb8f276579ef032c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:46.045811 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0178ad79-bfce-4763-8843-b9fdb94af0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:46.054413 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0178ad79-bfce-4763-8843-b9fdb94af0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:46.062766 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a9c26f-88c3-4365-811b-a1cd664610d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:46.067638 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a9c26f-88c3-4365-811b-a1cd664610d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8cde548-0151-4a87-b84e-275327599b0f', 'volume_name': 'volume-b8cde548-0151-4a87-b84e-275327599b0f', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:46.073056 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9849148-76c2-4c6a-9110-1aa9e5ad80a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:46.077582 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9849148-76c2-4c6a-9110-1aa9e5ad80a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:46.082585 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed4ab98-bfe9-4be2-9b0d-4bef6d1e743a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:46.084517 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Volume b8cde548-0151-4a87-b84e-275327599b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8cde548-0151-4a87-b84e-275327599b0f', 'volume_size': 1} Jan 29 21:03:46.085926 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] creating volume 'volume-b8cde548-0151-4a87-b84e-275327599b0f' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:03:46.087188 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:46.252152 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:03:46.252522 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:03:46.256727 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed4ab98-bfe9-4be2-9b0d-4bef6d1e743a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8cde548-0151-4a87-b84e-275327599b0f', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:46.272720 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7f0f55-662f-4405-9538-49a662499476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:46.291619 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Volume volume-b8cde548-0151-4a87-b84e-275327599b0f (b8cde548-0151-4a87-b84e-275327599b0f): created successfully Jan 29 21:03:46.296483 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7f0f55-662f-4405-9538-49a662499476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:46.306188 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Flow 'volume_create_manager' (95307e05-f5d4-4835-8fb0-f2280b09e9a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:03:46.323267 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-0abd916b-d079-4d11-8da1-27bf2d0fd2e8 tempest-VolumesActionsTest-1658749688 None] Created volume successfully. Jan 29 21:03:46.996237 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-63f5743b-008c-46e6-b70e-c63c15d4668d tempest-VolumesActionsTest-1658749688 None] Lock "b'cinder-b8cde548-0151-4a87-b84e-275327599b0f'" acquired by "attach_volume" :: waited 0.025s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:03:47.106336 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-63f5743b-008c-46e6-b70e-c63c15d4668d tempest-VolumesActionsTest-1658749688 None] Attaching volume b8cde548-0151-4a87-b84e-275327599b0f to instance e81660d1-2ed9-4e02-8f25-4f9ac4d6637f at mountpoint /dev/sdb on host None. Jan 29 21:03:47.153735 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-63f5743b-008c-46e6-b70e-c63c15d4668d tempest-VolumesActionsTest-1658749688 None] Attach volume completed successfully. Jan 29 21:03:47.159743 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-63f5743b-008c-46e6-b70e-c63c15d4668d tempest-VolumesActionsTest-1658749688 None] Lock "b'cinder-b8cde548-0151-4a87-b84e-275327599b0f'" released by "attach_volume" :: held 0.164s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:03:47.820870 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-da210261-c31f-47d2-b48c-b97098bc6853 tempest-VolumesActionsTest-1742126356 None] Terminate volume connection completed successfully. Jan 29 21:03:47.867862 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-da210261-c31f-47d2-b48c-b97098bc6853 tempest-VolumesActionsTest-1742126356 None] Lock "b'cinder-b8cde548-0151-4a87-b84e-275327599b0f-detach_volume'" acquired by "detach_volume" :: waited 0.014s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:03:47.879336 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-da210261-c31f-47d2-b48c-b97098bc6853 tempest-VolumesActionsTest-1742126356 None] Detaching volume b8cde548-0151-4a87-b84e-275327599b0f from instance e81660d1-2ed9-4e02-8f25-4f9ac4d6637f. Jan 29 21:03:47.930735 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-da210261-c31f-47d2-b48c-b97098bc6853 tempest-VolumesActionsTest-1742126356 None] Detach volume completed successfully. Jan 29 21:03:47.937763 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-da210261-c31f-47d2-b48c-b97098bc6853 tempest-VolumesActionsTest-1742126356 None] Lock "b'cinder-b8cde548-0151-4a87-b84e-275327599b0f-detach_volume'" released by "detach_volume" :: held 0.070s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:03:48.191250 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-d984aeec-7522-45ea-96ec-3795baf191a2 tempest-VolumesActionsTest-1658749688 None] Lock "b'cinder-b8cde548-0151-4a87-b84e-275327599b0f-detach_volume'" acquired by "detach_volume" :: waited 0.014s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:03:48.191871 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d984aeec-7522-45ea-96ec-3795baf191a2 tempest-VolumesActionsTest-1658749688 None] Volume detach called, but volume not attached. Jan 29 21:03:48.210530 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-d984aeec-7522-45ea-96ec-3795baf191a2 tempest-VolumesActionsTest-1658749688 None] Lock "b'cinder-b8cde548-0151-4a87-b84e-275327599b0f-detach_volume'" released by "detach_volume" :: held 0.019s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:03:48.711765 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:03:48.715752 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:03:48.716193 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:03:48.735246 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Flow 'volume_create_manager' (daeb17cb-3313-4ce0-ba05-fa2d136eb480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:03:48.741828 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c852a0-fc27-4d46-8348-64658e4b999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:48.748222 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:03:48.765747 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c852a0-fc27-4d46-8348-64658e4b999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-600623672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=060fe24e-aa00-4e74-9bad-ed2c525f791c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c32fcb52cd34c8caf1c321403522ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:03:49Z,use_quota=True,user_id='ee3035f11d364aeb8336ac8d7cfb69ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:48.771447 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b611d9f-1d72-43d3-892e-4546010db6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:48.776407 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b611d9f-1d72-43d3-892e-4546010db6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:48.781734 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02f02c6-b0f0-40fb-864c-d4dcc757d8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:48.871539 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02f02c6-b0f0-40fb-864c-d4dcc757d8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '060fe24e-aa00-4e74-9bad-ed2c525f791c', 'volume_name': 'volume-060fe24e-aa00-4e74-9bad-ed2c525f791c', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:48.876613 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f654a2f8-c468-4d5a-a495-6bb9f9333a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:48.881006 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f654a2f8-c468-4d5a-a495-6bb9f9333a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:48.886823 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbd2192-c3c6-45b8-a3c8-cdf0ff17bfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:48.888221 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Volume 060fe24e-aa00-4e74-9bad-ed2c525f791c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-060fe24e-aa00-4e74-9bad-ed2c525f791c', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 21:03:48.888900 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Cloning 060fe24e-aa00-4e74-9bad-ed2c525f791c from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 21:03:48.898126 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:03:48.912704 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 3, 48, 905234)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:03:48.913004 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:03:48.913404 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Found cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 29 21:03:48.919145 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 0.021s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:03:48.920233 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 21:03:48.932065 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 3, 48, 929395)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:03:48.932596 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:03:48.933193 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Creating from source image-volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 29 21:03:48.956671 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:49.033869 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] creating snapshot='volume-060fe24e-aa00-4e74-9bad-ed2c525f791c.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 21:03:49.906303 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] cloning 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe@volume-060fe24e-aa00-4e74-9bad-ed2c525f791c.clone_snap' to 'volume-060fe24e-aa00-4e74-9bad-ed2c525f791c' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 21:03:50.085292 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:03:50.086847 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:03:50.087859 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:03:50.113962 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 21:03:50.114696 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Marking volume 060fe24e-aa00-4e74-9bad-ed2c525f791c as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 21:03:50.124394 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to 060fe24e-aa00-4e74-9bad-ed2c525f791c. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 21:03:50.125134 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Creating volume glance metadata for volume 060fe24e-aa00-4e74-9bad-ed2c525f791c backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 21:03:50.182651 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbd2192-c3c6-45b8-a3c8-cdf0ff17bfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060fe24e-aa00-4e74-9bad-ed2c525f791c', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:50.189530 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6676febb-9404-4980-9d9d-bd96f4e5bbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:50.202232 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Volume volume-060fe24e-aa00-4e74-9bad-ed2c525f791c (060fe24e-aa00-4e74-9bad-ed2c525f791c): created successfully Jan 29 21:03:50.206445 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6676febb-9404-4980-9d9d-bd96f4e5bbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:50.213109 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Flow 'volume_create_manager' (daeb17cb-3313-4ce0-ba05-fa2d136eb480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:03:50.243063 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-43c53830-9447-4788-a3d4-de286bf58f6d tempest-VolumesImageMetadata-554822203 None] Created volume successfully. Jan 29 21:03:51.269093 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-2e1f1566-d63e-4460-aeb9-4dec69ae8456 tempest-VolumesImageMetadata-554822203 None] Lock "b'cinder-060fe24e-aa00-4e74-9bad-ed2c525f791c-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:03:51.320470 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2e1f1566-d63e-4460-aeb9-4dec69ae8456 tempest-VolumesImageMetadata-554822203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:51.409554 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2e1f1566-d63e-4460-aeb9-4dec69ae8456 tempest-VolumesImageMetadata-554822203 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:03:51.417204 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2e1f1566-d63e-4460-aeb9-4dec69ae8456 tempest-VolumesImageMetadata-554822203 None] deleting rbd volume volume-060fe24e-aa00-4e74-9bad-ed2c525f791c {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:03:51.633328 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2e1f1566-d63e-4460-aeb9-4dec69ae8456 tempest-VolumesImageMetadata-554822203 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 21:03:51.674726 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2e1f1566-d63e-4460-aeb9-4dec69ae8456 tempest-VolumesImageMetadata-554822203 None] deleting parent snapshot volume-060fe24e-aa00-4e74-9bad-ed2c525f791c.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 21:03:52.048883 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-2e1f1566-d63e-4460-aeb9-4dec69ae8456 tempest-VolumesImageMetadata-554822203 None] Created reservations ['915e41bc-654b-4e16-b82d-c70585f8da98', '35497a2f-a7f2-487c-8309-93e6b06dbc92', '24625a0d-025f-47d3-9413-2416763f56cf', '5ca90dcc-6274-43ae-bb26-8cb8962dd1f3'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:03:52.106837 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2e1f1566-d63e-4460-aeb9-4dec69ae8456 tempest-VolumesImageMetadata-554822203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:52.191882 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2e1f1566-d63e-4460-aeb9-4dec69ae8456 tempest-VolumesImageMetadata-554822203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:52.236322 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-2e1f1566-d63e-4460-aeb9-4dec69ae8456 tempest-VolumesImageMetadata-554822203 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:03:52.250569 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-2e1f1566-d63e-4460-aeb9-4dec69ae8456 tempest-VolumesImageMetadata-554822203 None] Deleted volume successfully. Jan 29 21:03:52.274519 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-2e1f1566-d63e-4460-aeb9-4dec69ae8456 tempest-VolumesImageMetadata-554822203 None] Lock "b'cinder-060fe24e-aa00-4e74-9bad-ed2c525f791c-delete_volume'" released by "delete_volume" :: held 1.004s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:03:53.314004 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:03:53.317322 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:03:53.317771 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:03:53.359697 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Flow 'volume_create_manager' (fceb3b87-8b06-4231-b771-dbf4ad423774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:03:53.390414 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a33c48-8e97-4ee0-987f-c46189af3b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:53.420190 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:03:53.437688 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a33c48-8e97-4ee0-987f-c46189af3b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1914265306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cda13d22-1df6-46c2-b607-c566d3c319d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744c0a71b4af48dd8e65af356934b075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:03:53Z,use_quota=True,user_id='4d654980e2a84deb8f276579ef032c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:53.444867 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8dd35cb-9242-4ead-ba3c-913909cea569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:53.449674 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8dd35cb-9242-4ead-ba3c-913909cea569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:53.456385 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f8ca5e-efb5-43c8-a79d-db5ad63520ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:53.461944 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f8ca5e-efb5-43c8-a79d-db5ad63520ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cda13d22-1df6-46c2-b607-c566d3c319d1', 'volume_name': 'volume-cda13d22-1df6-46c2-b607-c566d3c319d1', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:53.467359 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3720ee-cb4b-4967-b34a-2a45486beb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:53.471573 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3720ee-cb4b-4967-b34a-2a45486beb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:53.477551 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49058d00-bc5f-4095-8cbb-c043453e95a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:53.478672 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Volume cda13d22-1df6-46c2-b607-c566d3c319d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cda13d22-1df6-46c2-b607-c566d3c319d1', 'volume_size': 1} Jan 29 21:03:53.479100 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] creating volume 'volume-cda13d22-1df6-46c2-b607-c566d3c319d1' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:03:53.480137 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:53.581584 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:03:53.583010 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:03:53.588297 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49058d00-bc5f-4095-8cbb-c043453e95a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda13d22-1df6-46c2-b607-c566d3c319d1', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:53.598401 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db6782f-cbf0-4513-8a6e-8c8bee913db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:53.609744 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Volume volume-cda13d22-1df6-46c2-b607-c566d3c319d1 (cda13d22-1df6-46c2-b607-c566d3c319d1): created successfully Jan 29 21:03:53.613889 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db6782f-cbf0-4513-8a6e-8c8bee913db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:53.619634 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Flow 'volume_create_manager' (fceb3b87-8b06-4231-b771-dbf4ad423774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:03:53.633013 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-c40d6531-539d-472f-a563-448ea55d4654 tempest-VolumesActionsTest-1658749688 None] Created volume successfully. Jan 29 21:03:54.717452 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e948ca4b-b0cf-46e9-9af1-5b37a63397f4 tempest-VolumesActionsTest-1742126356 None] Lock "b'cinder-cda13d22-1df6-46c2-b607-c566d3c319d1-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:03:54.786234 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e948ca4b-b0cf-46e9-9af1-5b37a63397f4 tempest-VolumesActionsTest-1742126356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:54.882830 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e948ca4b-b0cf-46e9-9af1-5b37a63397f4 tempest-VolumesActionsTest-1742126356 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:03:54.883261 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e948ca4b-b0cf-46e9-9af1-5b37a63397f4 tempest-VolumesActionsTest-1742126356 None] Volume volume-cda13d22-1df6-46c2-b607-c566d3c319d1 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:03:54.889888 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e948ca4b-b0cf-46e9-9af1-5b37a63397f4 tempest-VolumesActionsTest-1742126356 None] deleting rbd volume volume-cda13d22-1df6-46c2-b607-c566d3c319d1 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:03:55.380093 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-e948ca4b-b0cf-46e9-9af1-5b37a63397f4 tempest-VolumesActionsTest-1742126356 None] Created reservations ['62d970ee-88ef-488e-be37-8c195ea897ea', '96af0a9c-4b7e-48e7-8d91-8959ecc30080', '2c8c7abc-ae67-4864-a0e9-6c9a6ac72039', '2dabbdcd-a0e9-40c4-972e-804a5b90426b'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:03:55.483013 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e948ca4b-b0cf-46e9-9af1-5b37a63397f4 tempest-VolumesActionsTest-1742126356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:55.555376 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e948ca4b-b0cf-46e9-9af1-5b37a63397f4 tempest-VolumesActionsTest-1742126356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:55.622948 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e948ca4b-b0cf-46e9-9af1-5b37a63397f4 tempest-VolumesActionsTest-1742126356 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:03:55.628146 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e948ca4b-b0cf-46e9-9af1-5b37a63397f4 tempest-VolumesActionsTest-1742126356 None] Deleted volume successfully. Jan 29 21:03:55.649493 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e948ca4b-b0cf-46e9-9af1-5b37a63397f4 tempest-VolumesActionsTest-1742126356 None] Lock "b'cinder-cda13d22-1df6-46c2-b607-c566d3c319d1-delete_volume'" released by "delete_volume" :: held 0.933s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:03:55.779551 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:03:55.791407 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:03:55.791932 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:03:55.832939 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Flow 'volume_create_manager' (96589b9d-5883-44d0-abaa-4109c723ae12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:03:55.859907 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010be991-3444-4dd0-8160-16ac7592e7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:55.868123 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:03:55.910521 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010be991-3444-4dd0-8160-16ac7592e7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1336371284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=943d28db-2bc5-4979-9830-f336e9878302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02842c016cfb4fe8b76fed22a22841d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:03:56Z,use_quota=True,user_id='2bb93c32c61f4b36a0754009d59cdce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:55.933139 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b72c99-a764-4d0b-b3c6-5e6c9fcfbf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:55.940702 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b72c99-a764-4d0b-b3c6-5e6c9fcfbf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:55.954099 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ec7132-c706-4b12-8c50-43311d1db5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:55.960063 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ec7132-c706-4b12-8c50-43311d1db5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943d28db-2bc5-4979-9830-f336e9878302', 'volume_name': 'volume-943d28db-2bc5-4979-9830-f336e9878302', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:55.977543 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccfd646-f4df-43ce-b911-56bae94e4560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:55.983420 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccfd646-f4df-43ce-b911-56bae94e4560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:55.990162 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1a8521-f4bf-4f10-99e2-811bff9f67ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:55.993305 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Volume 943d28db-2bc5-4979-9830-f336e9878302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943d28db-2bc5-4979-9830-f336e9878302', 'volume_size': 1} Jan 29 21:03:55.993942 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] creating volume 'volume-943d28db-2bc5-4979-9830-f336e9878302' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:03:55.995150 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:56.085875 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:03:56.095487 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:03:56.095912 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:03:56.132616 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Flow 'volume_create_manager' (f98ef8b2-2749-4cce-b5be-7c5eabb2d014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:03:56.140430 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e59f4b-7919-4a04-99cb-f086518a9e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:56.148742 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:03:56.161300 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:03:56.161957 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:03:56.166335 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1a8521-f4bf-4f10-99e2-811bff9f67ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943d28db-2bc5-4979-9830-f336e9878302', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:56.171136 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9159854e-ccd1-481d-b3be-7053e621b546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:56.182090 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e59f4b-7919-4a04-99cb-f086518a9e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1466015987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0996a91d-f380-4bb5-9f10-cebbee85b8aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7481f3ad392e46869de5ead7018fb937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:03:56Z,use_quota=True,user_id='d920523bf77a4c088cf22d89596be090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:56.188014 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56f27ee-1bbf-4e73-a99e-d9b4293ca216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:56.193347 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56f27ee-1bbf-4e73-a99e-d9b4293ca216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:56.198515 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1424f4-6f88-410f-b14f-2f8c7f50006a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:56.203669 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1424f4-6f88-410f-b14f-2f8c7f50006a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0996a91d-f380-4bb5-9f10-cebbee85b8aa', 'volume_name': 'volume-0996a91d-f380-4bb5-9f10-cebbee85b8aa', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:56.210014 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814f4e76-5bbf-4cf5-a348-75c9503e3c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:56.215814 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814f4e76-5bbf-4cf5-a348-75c9503e3c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:56.221837 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5af94c-c4e2-42ce-a83f-e2ab2abb2fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:56.223104 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Volume 0996a91d-f380-4bb5-9f10-cebbee85b8aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0996a91d-f380-4bb5-9f10-cebbee85b8aa', 'volume_size': 1} Jan 29 21:03:56.223683 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] creating volume 'volume-0996a91d-f380-4bb5-9f10-cebbee85b8aa' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:03:56.224867 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:56.274597 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Volume volume-943d28db-2bc5-4979-9830-f336e9878302 (943d28db-2bc5-4979-9830-f336e9878302): created successfully Jan 29 21:03:56.281052 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9159854e-ccd1-481d-b3be-7053e621b546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:56.290933 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Flow 'volume_create_manager' (96589b9d-5883-44d0-abaa-4109c723ae12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:03:56.324891 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-21bd9743-4fb1-479b-9a0e-f1c9d6973fac tempest-VolumesMetadataTest-979802015 None] Created volume successfully. Jan 29 21:03:56.334424 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:03:56.335018 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:03:56.340021 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5af94c-c4e2-42ce-a83f-e2ab2abb2fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0996a91d-f380-4bb5-9f10-cebbee85b8aa', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:56.345946 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31bcec1e-965a-4e77-ac37-eee0122b92e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:56.363066 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Volume volume-0996a91d-f380-4bb5-9f10-cebbee85b8aa (0996a91d-f380-4bb5-9f10-cebbee85b8aa): created successfully Jan 29 21:03:56.367718 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31bcec1e-965a-4e77-ac37-eee0122b92e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:56.376781 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Flow 'volume_create_manager' (f98ef8b2-2749-4cce-b5be-7c5eabb2d014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:03:56.398590 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-bd3e6c5b-5b43-4a2e-ad70-309deb18cff1 req-926face2-0232-4257-bbbc-281eb5e0d89f tempest-VolumesGetTestJSON-1837606709 None] Created volume successfully. Jan 29 21:03:56.500206 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:03:56.505370 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:03:56.506242 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:03:56.532939 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Flow 'volume_create_manager' (80a2a5d9-e6a0-4ce2-88e8-4a0ab3e3b048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:03:56.542027 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e19a152-4076-4126-9816-bc5db261385b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:56.550531 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:03:56.585009 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e19a152-4076-4126-9816-bc5db261385b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-242376872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=463a5475-8223-46b0-a056-4713ccd07aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744c0a71b4af48dd8e65af356934b075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:03:56Z,use_quota=True,user_id='4d654980e2a84deb8f276579ef032c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:56.592722 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b498bef1-8a96-45bf-a068-b555095d4b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:56.597643 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b498bef1-8a96-45bf-a068-b555095d4b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:56.605380 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e15345-079f-46b8-9722-23b2aa8c465a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:56.609658 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e15345-079f-46b8-9722-23b2aa8c465a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463a5475-8223-46b0-a056-4713ccd07aac', 'volume_name': 'volume-463a5475-8223-46b0-a056-4713ccd07aac', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:56.615051 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611a2f44-acb1-44c5-b773-6eec5c08ec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:56.626447 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611a2f44-acb1-44c5-b773-6eec5c08ec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:56.632635 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36dbd2bd-29dc-4490-ab1c-9c988d2a471a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:56.633177 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Volume 463a5475-8223-46b0-a056-4713ccd07aac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463a5475-8223-46b0-a056-4713ccd07aac', 'volume_size': 1} Jan 29 21:03:56.634040 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] creating volume 'volume-463a5475-8223-46b0-a056-4713ccd07aac' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:03:56.635215 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:56.765714 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:03:56.766388 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:03:56.772797 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36dbd2bd-29dc-4490-ab1c-9c988d2a471a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463a5475-8223-46b0-a056-4713ccd07aac', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:56.778881 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52243f02-0377-4c15-8e0a-558ce666af06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:03:56.791041 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Volume volume-463a5475-8223-46b0-a056-4713ccd07aac (463a5475-8223-46b0-a056-4713ccd07aac): created successfully Jan 29 21:03:56.798212 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52243f02-0377-4c15-8e0a-558ce666af06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:03:56.805579 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Flow 'volume_create_manager' (80a2a5d9-e6a0-4ce2-88e8-4a0ab3e3b048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:03:56.823885 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4fedd1b3-ac50-44d5-a52c-806b463754c1 tempest-VolumesActionsTest-1658749688 None] Created volume successfully. Jan 29 21:03:57.470081 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-2d64651d-d3b7-49ff-b3da-c9e7e95de838 req-09722517-b2c1-467e-b701-ffddb90f8fa5 tempest-VolumesGetTestJSON-1837606709 None] Lock "b'cinder-0996a91d-f380-4bb5-9f10-cebbee85b8aa-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:03:57.572249 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-2d64651d-d3b7-49ff-b3da-c9e7e95de838 req-09722517-b2c1-467e-b701-ffddb90f8fa5 tempest-VolumesGetTestJSON-1837606709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:57.704798 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-2d64651d-d3b7-49ff-b3da-c9e7e95de838 req-09722517-b2c1-467e-b701-ffddb90f8fa5 tempest-VolumesGetTestJSON-1837606709 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:03:57.705472 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-2d64651d-d3b7-49ff-b3da-c9e7e95de838 req-09722517-b2c1-467e-b701-ffddb90f8fa5 tempest-VolumesGetTestJSON-1837606709 None] Volume volume-0996a91d-f380-4bb5-9f10-cebbee85b8aa is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:03:57.720336 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-2d64651d-d3b7-49ff-b3da-c9e7e95de838 req-09722517-b2c1-467e-b701-ffddb90f8fa5 tempest-VolumesGetTestJSON-1837606709 None] deleting rbd volume volume-0996a91d-f380-4bb5-9f10-cebbee85b8aa {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:03:57.961268 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-a6cdea8f-7242-4485-8173-88cc2d87325d tempest-VolumesMetadataTest-979802015 None] Lock "b'cinder-943d28db-2bc5-4979-9830-f336e9878302-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:03:58.162337 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-bf0f20be-4fd3-4ee1-afd6-8fa3eccff4c9 tempest-VolumesActionsTest-1742126356 None] Lock "b'cinder-463a5475-8223-46b0-a056-4713ccd07aac-delete_volume'" acquired by "delete_volume" :: waited 0.114s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:03:58.171879 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a6cdea8f-7242-4485-8173-88cc2d87325d tempest-VolumesMetadataTest-979802015 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:58.254812 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a6cdea8f-7242-4485-8173-88cc2d87325d tempest-VolumesMetadataTest-979802015 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:03:58.255245 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a6cdea8f-7242-4485-8173-88cc2d87325d tempest-VolumesMetadataTest-979802015 None] Volume volume-943d28db-2bc5-4979-9830-f336e9878302 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:03:58.270604 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a6cdea8f-7242-4485-8173-88cc2d87325d tempest-VolumesMetadataTest-979802015 None] deleting rbd volume volume-943d28db-2bc5-4979-9830-f336e9878302 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:03:58.351866 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bf0f20be-4fd3-4ee1-afd6-8fa3eccff4c9 tempest-VolumesActionsTest-1742126356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:58.442921 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bf0f20be-4fd3-4ee1-afd6-8fa3eccff4c9 tempest-VolumesActionsTest-1742126356 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:03:58.443807 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bf0f20be-4fd3-4ee1-afd6-8fa3eccff4c9 tempest-VolumesActionsTest-1742126356 None] Volume volume-463a5475-8223-46b0-a056-4713ccd07aac is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:03:58.471624 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bf0f20be-4fd3-4ee1-afd6-8fa3eccff4c9 tempest-VolumesActionsTest-1742126356 None] deleting rbd volume volume-463a5475-8223-46b0-a056-4713ccd07aac {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:03:58.533315 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [req-2d64651d-d3b7-49ff-b3da-c9e7e95de838 req-09722517-b2c1-467e-b701-ffddb90f8fa5 tempest-VolumesGetTestJSON-1837606709 None] Created reservations ['d9e25c9e-78cb-4318-8ab8-4abf26e33ecf', '8fafe1a0-4610-4d2b-b32a-79c70609c85c', '456d26cf-bb6c-46ef-af06-a96cb2dc81e6', 'b89fc711-b205-44ca-9ff5-170373fadbfa'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:03:58.648805 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-2d64651d-d3b7-49ff-b3da-c9e7e95de838 req-09722517-b2c1-467e-b701-ffddb90f8fa5 tempest-VolumesGetTestJSON-1837606709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:58.762138 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-2d64651d-d3b7-49ff-b3da-c9e7e95de838 req-09722517-b2c1-467e-b701-ffddb90f8fa5 tempest-VolumesGetTestJSON-1837606709 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:58.853993 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [req-2d64651d-d3b7-49ff-b3da-c9e7e95de838 req-09722517-b2c1-467e-b701-ffddb90f8fa5 tempest-VolumesGetTestJSON-1837606709 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:03:58.860150 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-2d64651d-d3b7-49ff-b3da-c9e7e95de838 req-09722517-b2c1-467e-b701-ffddb90f8fa5 tempest-VolumesGetTestJSON-1837606709 None] Deleted volume successfully. Jan 29 21:03:58.879279 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-2d64651d-d3b7-49ff-b3da-c9e7e95de838 req-09722517-b2c1-467e-b701-ffddb90f8fa5 tempest-VolumesGetTestJSON-1837606709 None] Lock "b'cinder-0996a91d-f380-4bb5-9f10-cebbee85b8aa-delete_volume'" released by "delete_volume" :: held 1.409s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:03:58.969356 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-a6cdea8f-7242-4485-8173-88cc2d87325d tempest-VolumesMetadataTest-979802015 None] Created reservations ['83df9612-d0e5-4bef-b97a-a7f8156e46c1', 'e9321cc2-c8cc-49b6-8e66-613ed8c81f9a', 'b7410693-336f-4e74-8db6-5935b8322212', '64e78ef9-a2e1-4a64-8c42-4e4bd8c7e01a'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:03:59.143979 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a6cdea8f-7242-4485-8173-88cc2d87325d tempest-VolumesMetadataTest-979802015 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:59.263028 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a6cdea8f-7242-4485-8173-88cc2d87325d tempest-VolumesMetadataTest-979802015 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:59.343718 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-a6cdea8f-7242-4485-8173-88cc2d87325d tempest-VolumesMetadataTest-979802015 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:03:59.348783 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-a6cdea8f-7242-4485-8173-88cc2d87325d tempest-VolumesMetadataTest-979802015 None] Deleted volume successfully. Jan 29 21:03:59.374591 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-bf0f20be-4fd3-4ee1-afd6-8fa3eccff4c9 tempest-VolumesActionsTest-1742126356 None] Created reservations ['bb7d4782-1d53-4501-90f5-353eedac2b66', '82e1ab48-077f-4d64-9a26-ffad5868e084', 'fd932d68-2a31-4889-b106-42271d53ca3d', '4a96d1c5-292b-4de7-87aa-86c388c09d72'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:03:59.423298 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-a6cdea8f-7242-4485-8173-88cc2d87325d tempest-VolumesMetadataTest-979802015 None] Lock "b'cinder-943d28db-2bc5-4979-9830-f336e9878302-delete_volume'" released by "delete_volume" :: held 1.466s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:03:59.532591 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bf0f20be-4fd3-4ee1-afd6-8fa3eccff4c9 tempest-VolumesActionsTest-1742126356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:59.612062 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bf0f20be-4fd3-4ee1-afd6-8fa3eccff4c9 tempest-VolumesActionsTest-1742126356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:03:59.648484 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-bf0f20be-4fd3-4ee1-afd6-8fa3eccff4c9 tempest-VolumesActionsTest-1742126356 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:03:59.653199 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-bf0f20be-4fd3-4ee1-afd6-8fa3eccff4c9 tempest-VolumesActionsTest-1742126356 None] Deleted volume successfully. Jan 29 21:03:59.679760 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-bf0f20be-4fd3-4ee1-afd6-8fa3eccff4c9 tempest-VolumesActionsTest-1742126356 None] Lock "b'cinder-463a5475-8223-46b0-a056-4713ccd07aac-delete_volume'" released by "delete_volume" :: held 1.517s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:04:01.172081 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:04:01.179229 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:04:01.179830 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:04:01.232149 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Flow 'volume_create_manager' (a1fb2fb9-eab5-4646-9c36-76a1896628b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:04:01.247233 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39298041-bd40-4121-909a-c8af9d8d7b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:01.269347 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:04:01.283745 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39298041-bd40-4121-909a-c8af9d8d7b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1806559316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=49ff8a9e-6978-4574-a698-892ed6644c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744c0a71b4af48dd8e65af356934b075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:04:01Z,use_quota=True,user_id='4d654980e2a84deb8f276579ef032c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:01.290995 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47c142b-f11d-4e5f-b0a5-eb35adfe1ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:01.295594 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47c142b-f11d-4e5f-b0a5-eb35adfe1ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:01.301181 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009c71c0-68c3-499e-8b3e-8af2d43e5e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:01.306549 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009c71c0-68c3-499e-8b3e-8af2d43e5e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49ff8a9e-6978-4574-a698-892ed6644c4c', 'volume_name': 'volume-49ff8a9e-6978-4574-a698-892ed6644c4c', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:01.313001 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b772cb6-6d29-4de8-96c4-11cea1f11a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:01.317522 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b772cb6-6d29-4de8-96c4-11cea1f11a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:01.324878 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5416fd-b465-4ff1-8464-bbaee9f0bb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:01.326211 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Volume 49ff8a9e-6978-4574-a698-892ed6644c4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49ff8a9e-6978-4574-a698-892ed6644c4c', 'volume_size': 1} Jan 29 21:04:01.326777 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] creating volume 'volume-49ff8a9e-6978-4574-a698-892ed6644c4c' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:04:01.340283 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:01.532707 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:04:01.533313 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:04:01.539127 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5416fd-b465-4ff1-8464-bbaee9f0bb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49ff8a9e-6978-4574-a698-892ed6644c4c', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:01.545012 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e830578-cd2f-45ab-ad06-ddbbac95a44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:01.572384 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Volume volume-49ff8a9e-6978-4574-a698-892ed6644c4c (49ff8a9e-6978-4574-a698-892ed6644c4c): created successfully Jan 29 21:04:01.577292 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e830578-cd2f-45ab-ad06-ddbbac95a44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:01.596186 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Flow 'volume_create_manager' (a1fb2fb9-eab5-4646-9c36-76a1896628b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:04:01.619447 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f92f8152-8aa1-4dfd-9bc9-bee3a374d4ee tempest-VolumesActionsTest-1658749688 None] Created volume successfully. Jan 29 21:04:02.503054 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-3ff8c9ec-a990-4d64-8dc2-639c82ef1cc1 tempest-VolumesActionsTest-1742126356 None] Lock "b'cinder-49ff8a9e-6978-4574-a698-892ed6644c4c-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:04:02.605437 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3ff8c9ec-a990-4d64-8dc2-639c82ef1cc1 tempest-VolumesActionsTest-1742126356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:02.727367 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3ff8c9ec-a990-4d64-8dc2-639c82ef1cc1 tempest-VolumesActionsTest-1742126356 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:04:02.727367 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3ff8c9ec-a990-4d64-8dc2-639c82ef1cc1 tempest-VolumesActionsTest-1742126356 None] Volume volume-49ff8a9e-6978-4574-a698-892ed6644c4c is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:04:02.740849 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3ff8c9ec-a990-4d64-8dc2-639c82ef1cc1 tempest-VolumesActionsTest-1742126356 None] deleting rbd volume volume-49ff8a9e-6978-4574-a698-892ed6644c4c {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:04:03.258235 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-3ff8c9ec-a990-4d64-8dc2-639c82ef1cc1 tempest-VolumesActionsTest-1742126356 None] Created reservations ['52e98a88-6f1a-4cd2-8480-63835d8a9380', '29d281d4-086f-4072-acb3-57ec8a7023b0', '59a36006-a21f-4ac0-83e8-e65a67683660', 'ff5b6844-2730-468b-b0cf-a2bca93041f4'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:04:03.330822 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3ff8c9ec-a990-4d64-8dc2-639c82ef1cc1 tempest-VolumesActionsTest-1742126356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:03.419169 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3ff8c9ec-a990-4d64-8dc2-639c82ef1cc1 tempest-VolumesActionsTest-1742126356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:03.480033 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-3ff8c9ec-a990-4d64-8dc2-639c82ef1cc1 tempest-VolumesActionsTest-1742126356 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:04:03.494241 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-3ff8c9ec-a990-4d64-8dc2-639c82ef1cc1 tempest-VolumesActionsTest-1742126356 None] Deleted volume successfully. Jan 29 21:04:03.530543 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-3ff8c9ec-a990-4d64-8dc2-639c82ef1cc1 tempest-VolumesActionsTest-1742126356 None] Lock "b'cinder-49ff8a9e-6978-4574-a698-892ed6644c4c-delete_volume'" released by "delete_volume" :: held 1.027s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:04:04.196772 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:04:04.203161 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:04:04.204110 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:04:04.251443 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Flow 'volume_create_manager' (095937c8-6e93-4695-98b3-328bbbbe13b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:04:04.259796 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67e5283-0b41-4fe1-a708-eac063e034f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:04.269865 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:04:04.294081 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67e5283-0b41-4fe1-a708-eac063e034f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1681525374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bc748017-5990-41de-8388-f03dc293d832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744c0a71b4af48dd8e65af356934b075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:04:04Z,use_quota=True,user_id='4d654980e2a84deb8f276579ef032c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:04.302013 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b48bd8-b23a-436b-ab70-e7d6a8055291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:04.316219 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b48bd8-b23a-436b-ab70-e7d6a8055291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:04.338714 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e791cad-1666-4023-87f3-7f9efc9fbe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:04.344451 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e791cad-1666-4023-87f3-7f9efc9fbe2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc748017-5990-41de-8388-f03dc293d832', 'volume_name': 'volume-bc748017-5990-41de-8388-f03dc293d832', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:04.352003 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5e974f-fb9b-40ba-8544-77113366cc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:04.383045 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5e974f-fb9b-40ba-8544-77113366cc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:04.423404 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8480f4ba-9649-4b3c-8523-f4f2f1729697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:04.424567 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Volume bc748017-5990-41de-8388-f03dc293d832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc748017-5990-41de-8388-f03dc293d832', 'volume_size': 1} Jan 29 21:04:04.424952 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] creating volume 'volume-bc748017-5990-41de-8388-f03dc293d832' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:04:04.430185 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:04.595948 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:04:04.596598 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:04:04.617130 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8480f4ba-9649-4b3c-8523-f4f2f1729697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc748017-5990-41de-8388-f03dc293d832', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:04.641064 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3157dfb2-5ddb-4799-8861-57c6e0b5a16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:04.663408 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Volume volume-bc748017-5990-41de-8388-f03dc293d832 (bc748017-5990-41de-8388-f03dc293d832): created successfully Jan 29 21:04:04.669913 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3157dfb2-5ddb-4799-8861-57c6e0b5a16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:04.683756 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Flow 'volume_create_manager' (095937c8-6e93-4695-98b3-328bbbbe13b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:04:04.702276 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-11e969a3-183a-4169-a6af-7b4575939f8c tempest-VolumesActionsTest-1658749688 None] Created volume successfully. Jan 29 21:04:05.493594 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-66349334-c0a9-4350-85ac-6c8b86fa33c5 tempest-VolumesActionsTest-1742126356 None] Lock "b'cinder-bc748017-5990-41de-8388-f03dc293d832-delete_volume'" acquired by "delete_volume" :: waited 0.037s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:04:05.598962 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-66349334-c0a9-4350-85ac-6c8b86fa33c5 tempest-VolumesActionsTest-1742126356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:05.735166 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-66349334-c0a9-4350-85ac-6c8b86fa33c5 tempest-VolumesActionsTest-1742126356 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:04:05.735930 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-66349334-c0a9-4350-85ac-6c8b86fa33c5 tempest-VolumesActionsTest-1742126356 None] Volume volume-bc748017-5990-41de-8388-f03dc293d832 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:04:05.748651 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-66349334-c0a9-4350-85ac-6c8b86fa33c5 tempest-VolumesActionsTest-1742126356 None] deleting rbd volume volume-bc748017-5990-41de-8388-f03dc293d832 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:04:06.342964 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-66349334-c0a9-4350-85ac-6c8b86fa33c5 tempest-VolumesActionsTest-1742126356 None] Created reservations ['216d1339-12a1-4235-8c8e-2ea468a7e826', '3f932034-7c84-4fa4-977f-4edc93f4865d', '08aeb973-ca89-4209-bdae-3736841069ad', '70788d5f-bb57-446a-aa62-bd4492a0c00c'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:04:06.437272 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-66349334-c0a9-4350-85ac-6c8b86fa33c5 tempest-VolumesActionsTest-1742126356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:06.516456 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-66349334-c0a9-4350-85ac-6c8b86fa33c5 tempest-VolumesActionsTest-1742126356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:06.593942 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-66349334-c0a9-4350-85ac-6c8b86fa33c5 tempest-VolumesActionsTest-1742126356 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:04:06.598789 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-66349334-c0a9-4350-85ac-6c8b86fa33c5 tempest-VolumesActionsTest-1742126356 None] Deleted volume successfully. Jan 29 21:04:06.623843 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-66349334-c0a9-4350-85ac-6c8b86fa33c5 tempest-VolumesActionsTest-1742126356 None] Lock "b'cinder-bc748017-5990-41de-8388-f03dc293d832-delete_volume'" released by "delete_volume" :: held 1.134s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:04:07.440466 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:04:07.458785 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:04:07.460480 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:04:07.524611 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Flow 'volume_create_manager' (02516212-fa33-4a7d-bf5c-d9675b6c659a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:04:07.545602 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5c9064-301e-4a8b-a98b-9d72279cd08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:07.577416 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:04:07.600340 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5c9064-301e-4a8b-a98b-9d72279cd08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-420346893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b440310a-0e65-40eb-8a03-4bd81189084b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744c0a71b4af48dd8e65af356934b075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:04:07Z,use_quota=True,user_id='4d654980e2a84deb8f276579ef032c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:07.608108 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37379ec-eafe-4d05-bef9-bf1f15870889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:07.614927 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37379ec-eafe-4d05-bef9-bf1f15870889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:07.623706 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6ccbb3-a963-4cf1-bf10-745ca2b5dd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:07.630592 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6ccbb3-a963-4cf1-bf10-745ca2b5dd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b440310a-0e65-40eb-8a03-4bd81189084b', 'volume_name': 'volume-b440310a-0e65-40eb-8a03-4bd81189084b', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:07.637972 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b8f233-baeb-4ea0-babc-48570b52e715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:07.644094 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b8f233-baeb-4ea0-babc-48570b52e715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:07.650687 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1235b41-bbb8-4433-a0e2-23238786d039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:07.652400 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Volume b440310a-0e65-40eb-8a03-4bd81189084b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b440310a-0e65-40eb-8a03-4bd81189084b', 'volume_size': 1} Jan 29 21:04:07.653253 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] creating volume 'volume-b440310a-0e65-40eb-8a03-4bd81189084b' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:04:07.654485 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:07.784122 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:04:07.784492 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:04:07.788834 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1235b41-bbb8-4433-a0e2-23238786d039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b440310a-0e65-40eb-8a03-4bd81189084b', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:07.812049 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2977648a-5dcf-4421-99fb-83f24bd362e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:07.836326 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Volume volume-b440310a-0e65-40eb-8a03-4bd81189084b (b440310a-0e65-40eb-8a03-4bd81189084b): created successfully Jan 29 21:04:07.842530 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2977648a-5dcf-4421-99fb-83f24bd362e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:07.852852 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Flow 'volume_create_manager' (02516212-fa33-4a7d-bf5c-d9675b6c659a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:04:07.871172 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-59cd3171-f8e8-4961-a297-2135f91c41da tempest-VolumesActionsTest-1658749688 None] Created volume successfully. Jan 29 21:04:09.469202 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-1303d0ea-d10f-45a4-8d2a-dca6cbe0306a tempest-VolumesActionsTest-1658749688 None] Lock "b'cinder-b440310a-0e65-40eb-8a03-4bd81189084b-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:04:09.604006 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1303d0ea-d10f-45a4-8d2a-dca6cbe0306a tempest-VolumesActionsTest-1658749688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:09.729721 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1303d0ea-d10f-45a4-8d2a-dca6cbe0306a tempest-VolumesActionsTest-1658749688 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:04:09.730155 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1303d0ea-d10f-45a4-8d2a-dca6cbe0306a tempest-VolumesActionsTest-1658749688 None] Volume volume-b440310a-0e65-40eb-8a03-4bd81189084b is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:04:09.749058 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1303d0ea-d10f-45a4-8d2a-dca6cbe0306a tempest-VolumesActionsTest-1658749688 None] deleting rbd volume volume-b440310a-0e65-40eb-8a03-4bd81189084b {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:04:10.348252 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-1303d0ea-d10f-45a4-8d2a-dca6cbe0306a tempest-VolumesActionsTest-1658749688 None] Created reservations ['054bbb93-1aff-4053-ae3e-aa486da09b85', 'b44f44b9-b591-48c2-b8ef-891e4b4ef511', 'f151eeaa-9f87-4512-ab6a-805fc8808a18', '5969c5db-bad9-43a4-9459-fc9a451c2a2f'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:04:10.484719 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1303d0ea-d10f-45a4-8d2a-dca6cbe0306a tempest-VolumesActionsTest-1658749688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:10.623808 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1303d0ea-d10f-45a4-8d2a-dca6cbe0306a tempest-VolumesActionsTest-1658749688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:10.714097 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-1303d0ea-d10f-45a4-8d2a-dca6cbe0306a tempest-VolumesActionsTest-1658749688 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:04:10.721292 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-1303d0ea-d10f-45a4-8d2a-dca6cbe0306a tempest-VolumesActionsTest-1658749688 None] Deleted volume successfully. Jan 29 21:04:10.739980 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-1303d0ea-d10f-45a4-8d2a-dca6cbe0306a tempest-VolumesActionsTest-1658749688 None] Lock "b'cinder-b440310a-0e65-40eb-8a03-4bd81189084b-delete_volume'" released by "delete_volume" :: held 1.271s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:04:10.841874 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-14e031fb-86f3-4330-994d-010ec0baa516 tempest-VolumesActionsTest-1658749688 None] Lock "b'cinder-b8cde548-0151-4a87-b84e-275327599b0f-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:04:10.914914 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-14e031fb-86f3-4330-994d-010ec0baa516 tempest-VolumesActionsTest-1658749688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:11.006756 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-14e031fb-86f3-4330-994d-010ec0baa516 tempest-VolumesActionsTest-1658749688 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:04:11.007118 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-14e031fb-86f3-4330-994d-010ec0baa516 tempest-VolumesActionsTest-1658749688 None] Volume volume-b8cde548-0151-4a87-b84e-275327599b0f is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:04:11.027087 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-14e031fb-86f3-4330-994d-010ec0baa516 tempest-VolumesActionsTest-1658749688 None] deleting rbd volume volume-b8cde548-0151-4a87-b84e-275327599b0f {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:04:11.599945 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-14e031fb-86f3-4330-994d-010ec0baa516 tempest-VolumesActionsTest-1658749688 None] Created reservations ['2ee797d8-749f-4663-91b3-c82d91261ab8', '245d3fcf-08a8-47cc-aa20-00b8fa7c791c', '1270282d-2395-44b3-a936-b0fe5d768862', 'f2010193-42c4-4665-8537-f8f3ef181e69'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:04:11.723750 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-14e031fb-86f3-4330-994d-010ec0baa516 tempest-VolumesActionsTest-1658749688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:11.784937 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-14e031fb-86f3-4330-994d-010ec0baa516 tempest-VolumesActionsTest-1658749688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:11.859928 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-14e031fb-86f3-4330-994d-010ec0baa516 tempest-VolumesActionsTest-1658749688 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:04:11.926835 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-14e031fb-86f3-4330-994d-010ec0baa516 tempest-VolumesActionsTest-1658749688 None] Deleted volume successfully. Jan 29 21:04:11.995510 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-14e031fb-86f3-4330-994d-010ec0baa516 tempest-VolumesActionsTest-1658749688 None] Lock "b'cinder-b8cde548-0151-4a87-b84e-275327599b0f-delete_volume'" released by "delete_volume" :: held 1.154s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:04:28.662442 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:04:28.663880 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:28.753233 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:28.828566 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:04:58.905910 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:04:58.913095 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:04:58.914913 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:04:58.945618 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Flow 'volume_create_manager' (428192bc-66b2-4ab3-95b9-5e7ba1f54356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:04:58.956066 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdde2530-3503-448f-8316-d580ce770d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:58.964003 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:04:58.982711 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdde2530-3503-448f-8316-d580ce770d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1618511345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=030e378f-c9fa-4e82-9f25-1c298c1a9cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d5e7056616415aa449f9987bb3442c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:04:59Z,use_quota=True,user_id='0dc31429cb2f4eb990604713c35fdb2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:58.988670 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6972db-8c3e-4258-b6bb-718014b33198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:58.996215 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6972db-8c3e-4258-b6bb-718014b33198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:59.009393 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fee470c-594d-4e82-afc0-a3630ebe99f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:59.197082 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fee470c-594d-4e82-afc0-a3630ebe99f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '030e378f-c9fa-4e82-9f25-1c298c1a9cb5', 'volume_name': 'volume-030e378f-c9fa-4e82-9f25-1c298c1a9cb5', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:59.203208 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1224e0-df3e-42e5-84c5-290074bfd010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:59.242063 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1224e0-df3e-42e5-84c5-290074bfd010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:04:59.258491 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2dc8d6-1efb-439d-8485-91da67dc4197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:04:59.260859 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Volume 030e378f-c9fa-4e82-9f25-1c298c1a9cb5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-030e378f-c9fa-4e82-9f25-1c298c1a9cb5', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 21:04:59.266081 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Cloning 030e378f-c9fa-4e82-9f25-1c298c1a9cb5 from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 21:04:59.295948 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.027s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:04:59.324650 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 4, 59, 307082)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:04:59.325382 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:04:59.326251 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Found cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 29 21:04:59.333521 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 0.036s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:04:59.338437 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 21:04:59.351733 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 4, 59, 345748)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:04:59.353078 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:04:59.353802 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Creating from source image-volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 29 21:04:59.386059 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:04:59.498004 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] creating snapshot='volume-030e378f-c9fa-4e82-9f25-1c298c1a9cb5.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 21:04:59.648928 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] cloning 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe@volume-030e378f-c9fa-4e82-9f25-1c298c1a9cb5.clone_snap' to 'volume-030e378f-c9fa-4e82-9f25-1c298c1a9cb5' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 21:04:59.979877 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:04:59.981936 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:04:59.982621 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:05:00.048453 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 21:05:00.049483 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Marking volume 030e378f-c9fa-4e82-9f25-1c298c1a9cb5 as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 21:05:00.066862 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to 030e378f-c9fa-4e82-9f25-1c298c1a9cb5. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 21:05:00.067672 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Creating volume glance metadata for volume 030e378f-c9fa-4e82-9f25-1c298c1a9cb5 backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 21:05:00.247119 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2dc8d6-1efb-439d-8485-91da67dc4197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-030e378f-c9fa-4e82-9f25-1c298c1a9cb5', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:05:00.259992 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1fe268-9c15-403d-93be-dccd893eb4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:05:00.277847 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Volume volume-030e378f-c9fa-4e82-9f25-1c298c1a9cb5 (030e378f-c9fa-4e82-9f25-1c298c1a9cb5): created successfully Jan 29 21:05:00.287699 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1fe268-9c15-403d-93be-dccd893eb4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:05:00.312426 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Flow 'volume_create_manager' (428192bc-66b2-4ab3-95b9-5e7ba1f54356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:05:00.334269 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-86d64285-6af7-4948-9dd2-41b1364efdaf tempest-TestVolumeBackupRestore-1484692939 None] Created volume successfully. Jan 29 21:05:09.168782 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-055278ad-444d-4e00-a70e-5e06753a2261 tempest-TestVolumeBackupRestore-1484692939 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:05:10.311189 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-055278ad-444d-4e00-a70e-5e06753a2261 tempest-TestVolumeBackupRestore-1484692939 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.142s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:05:10.312082 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-055278ad-444d-4e00-a70e-5e06753a2261 tempest-TestVolumeBackupRestore-1484692939 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-030e378f-c9fa-4e82-9f25-1c298c1a9cb5', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '030e378f-c9fa-4e82-9f25-1c298c1a9cb5', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:05:10.336008 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-055278ad-444d-4e00-a70e-5e06753a2261 tempest-TestVolumeBackupRestore-1484692939 None] Initialize volume connection completed successfully. Jan 29 21:05:23.496139 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-055278ad-444d-4e00-a70e-5e06753a2261 tempest-TestVolumeBackupRestore-1484692939 None] Terminate volume connection completed successfully. Jan 29 21:05:23.524127 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-055278ad-444d-4e00-a70e-5e06753a2261 tempest-TestVolumeBackupRestore-1484692939 None] Remove volume export completed successfully. Jan 29 21:05:24.510519 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:05:24.518074 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:05:24.518759 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:05:24.598934 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Flow 'volume_create_manager' (fa59e4e9-c049-4ebb-9c75-3e8e204db5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:05:24.620480 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d756eb2-5b68-41a5-b49c-9eb76312f38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:05:24.637149 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:05:24.663545 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d756eb2-5b68-41a5-b49c-9eb76312f38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:05:24Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_9613b9c4-3653-4464-a9fc-7901e03542b8',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d5e7056616415aa449f9987bb3442c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:05:24Z,use_quota=True,user_id='0dc31429cb2f4eb990604713c35fdb2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:05:24.669365 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (266c3944-26a3-4cff-8d5c-1b289c5d79b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:05:24.674096 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (266c3944-26a3-4cff-8d5c-1b289c5d79b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:05:24.680044 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9675c8f-eb30-4df5-8e47-c0f14f2ed0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:05:24.684711 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9675c8f-eb30-4df5-8e47-c0f14f2ed0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0', 'volume_name': 'volume-7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:05:24.690403 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe78e03e-b90a-48c4-ab97-ad4a545ac6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:05:24.695850 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe78e03e-b90a-48c4-ab97-ad4a545ac6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:05:24.701284 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43915f34-78bd-4f3e-aa2b-b7d1cf8e9b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:05:24.702692 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Volume 7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0', 'volume_size': 1} Jan 29 21:05:24.703422 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] creating volume 'volume-7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:05:24.704798 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:05:24.805813 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:05:24.806825 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:05:24.811798 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43915f34-78bd-4f3e-aa2b-b7d1cf8e9b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:05:24.818956 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a4dd40-6c61-4f4e-bb72-d4dc85a2d181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:05:24.834642 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Volume volume-7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0 (7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0): created successfully Jan 29 21:05:24.839747 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a4dd40-6c61-4f4e-bb72-d4dc85a2d181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:05:24.878086 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Flow 'volume_create_manager' (fa59e4e9-c049-4ebb-9c75-3e8e204db5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:05:24.897633 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Created volume successfully. Jan 29 21:05:25.577991 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:05:26.545733 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.967s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:05:26.547401 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:05:26.585053 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Initialize volume connection completed successfully. Jan 29 21:05:28.668089 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:05:28.678785 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:05:28.765928 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:05:28.870171 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:05:33.855138 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Terminate volume connection completed successfully. Jan 29 21:05:33.906905 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-8ce1509c-094b-44db-85a6-dc97dd78ae88 tempest-TestVolumeBackupRestore-1484692939 None] Remove volume export completed successfully. Jan 29 21:05:40.070285 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-b8a23cf6-a737-495f-9dd3-b41d574b64f9 req-181ba636-8c90-472c-8c28-3cf4e7b878d0 tempest-TestVolumeBackupRestore-1484692939 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:05:41.056814 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-b8a23cf6-a737-495f-9dd3-b41d574b64f9 req-181ba636-8c90-472c-8c28-3cf4e7b878d0 tempest-TestVolumeBackupRestore-1484692939 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.986s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:05:41.058445 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b8a23cf6-a737-495f-9dd3-b41d574b64f9 req-181ba636-8c90-472c-8c28-3cf4e7b878d0 tempest-TestVolumeBackupRestore-1484692939 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:05:41.090126 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-b8a23cf6-a737-495f-9dd3-b41d574b64f9 req-181ba636-8c90-472c-8c28-3cf4e7b878d0 tempest-TestVolumeBackupRestore-1484692939 None] Connection info returned from driver {'name': 'volumes/volume-7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2b1fe6b1-2def-4125-9823-2657ae270907'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:05:41.179799 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-b8a23cf6-a737-495f-9dd3-b41d574b64f9 req-181ba636-8c90-472c-8c28-3cf4e7b878d0 tempest-TestVolumeBackupRestore-1484692939 None] attachment_update completed successfully. Jan 29 21:06:20.546712 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:06:20.556535 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:06:20.556975 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:06:20.593484 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Flow 'volume_create_manager' (b071d94c-c366-47f6-8a12-4a15659a98dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:06:20.620525 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f10a50-dde1-4ac1-924f-63745d6af23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:20.630100 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:06:20.652695 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f10a50-dde1-4ac1-924f-63745d6af23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-463402692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e7d8c372-16d1-4f1c-aa3b-fa488f1906a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a4befefe27499c9f75924231f51b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:06:20Z,use_quota=True,user_id='b975488576b04ae29fb4c5d98f7f5d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5c66f6d-07c0-47c8-8d0d-6e27272ca3cb),volume_type_id=f5c66f6d-07c0-47c8-8d0d-6e27272ca3cb)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:20.661207 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a89a30-85d7-48b9-994b-b0cd0d53b42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:20.666512 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a89a30-85d7-48b9-994b-b0cd0d53b42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:20.675367 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86798a4-6c5b-4043-936b-762d6c612247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:20.681813 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86798a4-6c5b-4043-936b-762d6c612247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d8c372-16d1-4f1c-aa3b-fa488f1906a9', 'volume_name': 'volume-e7d8c372-16d1-4f1c-aa3b-fa488f1906a9', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:20.690446 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04874897-ffd4-4ecd-84fd-a62b3afa17d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:20.698513 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04874897-ffd4-4ecd-84fd-a62b3afa17d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:20.704664 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a68219d-ef9d-476d-adf5-07d44fbde0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:20.707319 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Volume e7d8c372-16d1-4f1c-aa3b-fa488f1906a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d8c372-16d1-4f1c-aa3b-fa488f1906a9', 'volume_size': 1} Jan 29 21:06:20.707946 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] creating volume 'volume-e7d8c372-16d1-4f1c-aa3b-fa488f1906a9' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:06:20.710303 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:20.844355 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] extra_specs: {} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:06:20.845072 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] extra_specs: {} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:06:20.849283 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a68219d-ef9d-476d-adf5-07d44fbde0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d8c372-16d1-4f1c-aa3b-fa488f1906a9', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:20.858276 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f610f43-96c6-4de2-a045-18c0ef701560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:20.874228 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Volume volume-e7d8c372-16d1-4f1c-aa3b-fa488f1906a9 (e7d8c372-16d1-4f1c-aa3b-fa488f1906a9): created successfully Jan 29 21:06:20.882696 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f610f43-96c6-4de2-a045-18c0ef701560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:20.895321 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Flow 'volume_create_manager' (b071d94c-c366-47f6-8a12-4a15659a98dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:06:20.924934 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-dc9d0fd1-5af8-4540-a752-eea5b67c0ce7 tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Created volume successfully. Jan 29 21:06:22.454396 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7ddc253b-c60b-4b7d-bca5-99b1ba21050c tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:22.573982 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7ddc253b-c60b-4b7d-bca5-99b1ba21050c tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:22.660033 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-7ddc253b-c60b-4b7d-bca5-99b1ba21050c tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:06:22.667761 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-7ddc253b-c60b-4b7d-bca5-99b1ba21050c tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Retype volume completed successfully. Jan 29 21:06:23.732320 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-3c0ee958-9229-4c0b-be24-01e75e512a8f tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Lock "b'cinder-e7d8c372-16d1-4f1c-aa3b-fa488f1906a9-delete_volume'" acquired by "delete_volume" :: waited 0.053s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:06:23.792180 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3c0ee958-9229-4c0b-be24-01e75e512a8f tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:23.899855 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3c0ee958-9229-4c0b-be24-01e75e512a8f tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:06:23.900348 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3c0ee958-9229-4c0b-be24-01e75e512a8f tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Volume volume-e7d8c372-16d1-4f1c-aa3b-fa488f1906a9 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:06:23.917209 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3c0ee958-9229-4c0b-be24-01e75e512a8f tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] deleting rbd volume volume-e7d8c372-16d1-4f1c-aa3b-fa488f1906a9 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:06:24.585693 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-3c0ee958-9229-4c0b-be24-01e75e512a8f tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:06:24.586897 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-3c0ee958-9229-4c0b-be24-01e75e512a8f tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:06:24.610545 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-3c0ee958-9229-4c0b-be24-01e75e512a8f tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Created reservations ['8d8ef332-4cc4-4c7d-80c4-0070da70c571', 'fe872f59-78fd-43c2-ac4c-030f6c514216', 'bd5d791f-67f6-48eb-8911-1ae0c3d60d55', '179fa6dc-261f-426e-8a31-643888de5cbe'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:06:24.692123 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3c0ee958-9229-4c0b-be24-01e75e512a8f tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:24.765992 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3c0ee958-9229-4c0b-be24-01e75e512a8f tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:24.880574 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-3c0ee958-9229-4c0b-be24-01e75e512a8f tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:06:24.889817 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-3c0ee958-9229-4c0b-be24-01e75e512a8f tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Deleted volume successfully. Jan 29 21:06:24.917877 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-3c0ee958-9229-4c0b-be24-01e75e512a8f tempest-VolumeRetypeWithoutMigrationTest-1206371820 None] Lock "b'cinder-e7d8c372-16d1-4f1c-aa3b-fa488f1906a9-delete_volume'" released by "delete_volume" :: held 1.186s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:06:28.668777 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:06:28.670677 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:28.752796 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:28.856393 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:06:42.802300 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:06:42.808716 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:06:42.809361 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:06:42.838352 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Flow 'volume_create_manager' (6e45efa0-2271-46ed-bc67-019dce54e2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:06:42.852278 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56cfd05-6ff6-4991-9609-601b412ceab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:42.867369 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:06:42.900953 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56cfd05-6ff6-4991-9609-601b412ceab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-692891834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=89564243-2d97-4bf4-808f-ed24f2c3907e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e098df0ad6734d838f781cd1cf37bdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:06:43Z,use_quota=True,user_id='34a4ea845d3d4873a71702434ed0b19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:42.913331 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0cc38f-ace7-427a-ae8f-ddd1a306169c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:42.921169 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0cc38f-ace7-427a-ae8f-ddd1a306169c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:42.929729 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7169908c-837c-404a-bfab-2872f859daa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:42.937592 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7169908c-837c-404a-bfab-2872f859daa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89564243-2d97-4bf4-808f-ed24f2c3907e', 'volume_name': 'volume-89564243-2d97-4bf4-808f-ed24f2c3907e', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:42.945614 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ded951-914c-4ab3-9456-377794e4fc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:42.952573 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ded951-914c-4ab3-9456-377794e4fc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:42.961837 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7dae58-6300-4520-9c0d-2df03b58c93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:42.963943 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Volume 89564243-2d97-4bf4-808f-ed24f2c3907e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89564243-2d97-4bf4-808f-ed24f2c3907e', 'volume_size': 1} Jan 29 21:06:42.964570 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] creating volume 'volume-89564243-2d97-4bf4-808f-ed24f2c3907e' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:06:42.968073 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:43.137280 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:06:43.137903 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:06:43.142029 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7dae58-6300-4520-9c0d-2df03b58c93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89564243-2d97-4bf4-808f-ed24f2c3907e', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:43.147346 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d4914d-fe10-4322-a675-63951daa8ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:43.170103 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Volume volume-89564243-2d97-4bf4-808f-ed24f2c3907e (89564243-2d97-4bf4-808f-ed24f2c3907e): created successfully Jan 29 21:06:43.192211 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d4914d-fe10-4322-a675-63951daa8ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:43.208973 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Flow 'volume_create_manager' (6e45efa0-2271-46ed-bc67-019dce54e2ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:06:43.240323 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-29375abc-6475-4efd-895b-014232b7bc76 tempest-AbsoluteLimitsTests-1467335462 None] Created volume successfully. Jan 29 21:06:44.105709 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-bfe03a57-c712-46eb-ad22-c1a7e8d751d1 tempest-AbsoluteLimitsTests-1467335462 None] Lock "b'cinder-89564243-2d97-4bf4-808f-ed24f2c3907e-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:06:44.237706 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bfe03a57-c712-46eb-ad22-c1a7e8d751d1 tempest-AbsoluteLimitsTests-1467335462 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:44.308712 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bfe03a57-c712-46eb-ad22-c1a7e8d751d1 tempest-AbsoluteLimitsTests-1467335462 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:06:44.310026 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bfe03a57-c712-46eb-ad22-c1a7e8d751d1 tempest-AbsoluteLimitsTests-1467335462 None] Volume volume-89564243-2d97-4bf4-808f-ed24f2c3907e is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:06:44.338669 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bfe03a57-c712-46eb-ad22-c1a7e8d751d1 tempest-AbsoluteLimitsTests-1467335462 None] deleting rbd volume volume-89564243-2d97-4bf4-808f-ed24f2c3907e {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:06:44.820681 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-bfe03a57-c712-46eb-ad22-c1a7e8d751d1 tempest-AbsoluteLimitsTests-1467335462 None] Created reservations ['80453984-29b1-4fcf-817f-800fd1b405ea', '9c56ec22-a078-4282-aa1f-d854c65c7039', '18be6deb-24bf-4393-8cc6-69fc514557e9', '39d8c1a9-5ed7-4036-90e7-3824ff544a39'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:06:44.887926 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bfe03a57-c712-46eb-ad22-c1a7e8d751d1 tempest-AbsoluteLimitsTests-1467335462 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:44.934626 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bfe03a57-c712-46eb-ad22-c1a7e8d751d1 tempest-AbsoluteLimitsTests-1467335462 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:44.977388 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-bfe03a57-c712-46eb-ad22-c1a7e8d751d1 tempest-AbsoluteLimitsTests-1467335462 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:06:44.988213 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-bfe03a57-c712-46eb-ad22-c1a7e8d751d1 tempest-AbsoluteLimitsTests-1467335462 None] Deleted volume successfully. Jan 29 21:06:45.004534 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-bfe03a57-c712-46eb-ad22-c1a7e8d751d1 tempest-AbsoluteLimitsTests-1467335462 None] Lock "b'cinder-89564243-2d97-4bf4-808f-ed24f2c3907e-delete_volume'" released by "delete_volume" :: held 0.899s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:06:48.652592 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:06:48.655832 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:06:48.656275 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:06:48.676850 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Flow 'volume_create_manager' (44a2169d-6651-4a46-96dc-5498ea762fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:06:48.683938 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df97c26f-99d8-4595-9dfe-5066168a5bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:48.690985 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:06:48.705723 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df97c26f-99d8-4595-9dfe-5066168a5bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1596623897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b720bcc2-26c7-4f79-8084-5a70eb214134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d232a1f2a17c40bcab038d27b16d7769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:06:49Z,use_quota=True,user_id='d42488770a1847bebef4e21083b11443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:48.711135 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df75125e-a4ae-492b-8687-d37faa30b926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:48.715339 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df75125e-a4ae-492b-8687-d37faa30b926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:48.720348 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59847b4-8c4f-4943-8261-f6ae7304bbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:48.724480 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59847b4-8c4f-4943-8261-f6ae7304bbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b720bcc2-26c7-4f79-8084-5a70eb214134', 'volume_name': 'volume-b720bcc2-26c7-4f79-8084-5a70eb214134', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:48.729438 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f066684-b918-409f-9f02-cb4f7a572726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:48.733350 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f066684-b918-409f-9f02-cb4f7a572726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:48.738052 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febe110d-30d6-48ce-8d10-807680185988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:48.739107 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Volume b720bcc2-26c7-4f79-8084-5a70eb214134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b720bcc2-26c7-4f79-8084-5a70eb214134', 'volume_size': 1} Jan 29 21:06:48.739489 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] creating volume 'volume-b720bcc2-26c7-4f79-8084-5a70eb214134' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:06:48.740455 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:48.799167 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:06:48.799614 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:06:48.803290 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febe110d-30d6-48ce-8d10-807680185988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b720bcc2-26c7-4f79-8084-5a70eb214134', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:48.808074 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e38a89e-6dbb-4353-8986-8c4e3af57ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:06:48.818098 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Volume volume-b720bcc2-26c7-4f79-8084-5a70eb214134 (b720bcc2-26c7-4f79-8084-5a70eb214134): created successfully Jan 29 21:06:48.822261 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e38a89e-6dbb-4353-8986-8c4e3af57ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:06:48.828309 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Flow 'volume_create_manager' (44a2169d-6651-4a46-96dc-5498ea762fdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:06:48.836734 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-10f40709-5a13-4250-8f5c-95a8e5cc0559 tempest-VolumesDeleteCascade-1038366498 None] Created volume successfully. Jan 29 21:06:49.893753 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a2b58020-60cd-404f-99c1-93a24c3fabc8 tempest-VolumesDeleteCascade-1038366498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:50.655505 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-a2b58020-60cd-404f-99c1-93a24c3fabc8 tempest-VolumesDeleteCascade-1038366498 None] Create snapshot completed successfully Jan 29 21:06:51.074241 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-291d6170-769a-4a1b-8913-69121cbfb416 tempest-VolumesDeleteCascade-1038366498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:51.667254 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-291d6170-769a-4a1b-8913-69121cbfb416 tempest-VolumesDeleteCascade-1038366498 None] Create snapshot completed successfully Jan 29 21:06:52.186228 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Lock "b'cinder-b720bcc2-26c7-4f79-8084-5a70eb214134-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:06:52.226699 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Performing cascade delete. {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/manager.py:958}} Jan 29 21:06:52.244265 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Lock "b'cinder-62ec283a-4557-4eed-8ecd-6e7a7d58a174-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.007s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:06:52.255683 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:53.305538 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Created reservations ['fa5b812a-2b9c-48d2-8955-5deb45a39345', '843018c1-653f-406a-80a7-7de84e094b5c', '195594dd-3048-44a2-ac48-02524b4cb08d', '0e775a89-ae66-481d-91ae-5323e5b1a0a0'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:06:53.361982 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Delete snapshot completed successfully. Jan 29 21:06:53.367531 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Lock "b'cinder-62ec283a-4557-4eed-8ecd-6e7a7d58a174-delete_snapshot'" released by "delete_snapshot" :: held 1.123s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:06:53.378762 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Lock "b'cinder-83ab09df-42db-4b88-9e35-ac781a3ae660-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:06:53.415548 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:54.316860 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Created reservations ['132e8f16-0496-45a3-8d32-95e45f9e4593', '00f8308a-fdf5-4cda-bb22-9ce92cd10559', '2ef1cefe-4ff8-4390-8279-71b62e8cb898', '9154efb2-11ef-4a01-b124-9f0359ad2123'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:06:54.364191 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Delete snapshot completed successfully. Jan 29 21:06:54.370789 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Lock "b'cinder-83ab09df-42db-4b88-9e35-ac781a3ae660-delete_snapshot'" released by "delete_snapshot" :: held 0.991s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:06:54.371835 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Snapshots deleted, issuing volume delete {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/manager.py:973}} Jan 29 21:06:54.373451 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:54.428702 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:06:54.429401 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Volume volume-b720bcc2-26c7-4f79-8084-5a70eb214134 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:06:54.441602 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] deleting rbd volume volume-b720bcc2-26c7-4f79-8084-5a70eb214134 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:06:54.946096 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Created reservations ['c5c6401f-e371-46ed-a66a-58c11b4b8a09', '72326ff0-d613-4424-a1cd-0d4e8bb18e57', '28466e59-d676-41b6-89fa-d8884c2ac26d', '57a14890-7fbe-4519-a369-9f856133ad00'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:06:55.014890 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:55.063702 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:06:55.130175 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:06:55.146533 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Deleted volume successfully. Jan 29 21:06:55.170190 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-ae37aa47-0b30-4ccd-bb23-44c8a3a833f8 tempest-VolumesDeleteCascade-1038366498 None] Lock "b'cinder-b720bcc2-26c7-4f79-8084-5a70eb214134-delete_volume'" released by "delete_volume" :: held 2.982s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:06:57.209488 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b564f74a-f400-4e1c-b75a-2fee6eae00ff tempest-BackendsCapabilitiesAdminTestsJSON-1236017227 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:39de64bc-eb6d-4b6f-a981-9da4a74249ad:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134283) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4732}} Jan 29 21:06:57.276232 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3f4d2b74-cd86-4f41-948a-0c76b7232adb tempest-BackendsCapabilitiesAdminTestsJSON-1236017227 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:39de64bc-eb6d-4b6f-a981-9da4a74249ad:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134283) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4732}} Jan 29 21:07:00.493825 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:07:00.508888 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:07:00.510082 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:07:00.558744 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Flow 'volume_create_manager' (12e2af20-7dd9-4eb9-bc1a-85e124b4ac8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:07:00.577891 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5f3256-63fc-485c-9f4e-9e001ee09787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:00.606306 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:07:00.656009 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5f3256-63fc-485c-9f4e-9e001ee09787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-954477300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b9aff24b-7124-4446-979b-efca74b5210c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374f378be1684b84b05434245324cf27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:07:00Z,use_quota=True,user_id='71b2e565044e4fd3b16c6c3743829af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:00.678995 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431b6cc2-55f5-4bee-aefc-8eb8f6bd6c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:00.684050 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431b6cc2-55f5-4bee-aefc-8eb8f6bd6c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:00.690988 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80531afb-457f-4052-adc6-beb4c5640315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:00.873286 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80531afb-457f-4052-adc6-beb4c5640315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b9aff24b-7124-4446-979b-efca74b5210c', 'volume_name': 'volume-b9aff24b-7124-4446-979b-efca74b5210c', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:00.886704 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7a9d06-413a-4079-a67a-a362584eebef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:00.895299 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7a9d06-413a-4079-a67a-a362584eebef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:00.903705 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bde34a7-1f2c-48bb-9928-d83516ae4a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:00.912485 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Volume b9aff24b-7124-4446-979b-efca74b5210c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b9aff24b-7124-4446-979b-efca74b5210c', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 21:07:00.915463 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Cloning b9aff24b-7124-4446-979b-efca74b5210c from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 21:07:00.934709 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.018s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:07:00.963943 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 7, 0, 948398)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:07:00.971853 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:07:00.972593 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Found cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 29 21:07:00.984074 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 0.049s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:07:00.985298 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 21:07:00.996554 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 7, 0, 989880)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:07:00.997178 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:07:00.998114 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Creating from source image-volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 29 21:07:01.026018 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:01.155775 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] creating snapshot='volume-b9aff24b-7124-4446-979b-efca74b5210c.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 21:07:02.318492 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] cloning 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe@volume-b9aff24b-7124-4446-979b-efca74b5210c.clone_snap' to 'volume-b9aff24b-7124-4446-979b-efca74b5210c' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 21:07:02.551678 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:07:02.553346 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:07:02.554210 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:07:02.591257 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 21:07:02.592211 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Marking volume b9aff24b-7124-4446-979b-efca74b5210c as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 21:07:02.607155 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to b9aff24b-7124-4446-979b-efca74b5210c. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 21:07:02.608061 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Creating volume glance metadata for volume b9aff24b-7124-4446-979b-efca74b5210c backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 21:07:02.720386 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bde34a7-1f2c-48bb-9928-d83516ae4a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9aff24b-7124-4446-979b-efca74b5210c', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:02.727236 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb95cc3c-fefe-4605-bcd2-692b1de1a864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:02.754741 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Volume volume-b9aff24b-7124-4446-979b-efca74b5210c (b9aff24b-7124-4446-979b-efca74b5210c): created successfully Jan 29 21:07:02.761602 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb95cc3c-fefe-4605-bcd2-692b1de1a864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:02.770386 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Flow 'volume_create_manager' (12e2af20-7dd9-4eb9-bc1a-85e124b4ac8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:07:02.802832 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-1259a00d-4e07-4d9d-bfc0-ee3641f7d2fc tempest-VolumesExtendTest-1931285563 None] Created volume successfully. Jan 29 21:07:03.427473 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-19b6b1d5-873d-41a4-ad6f-b80b0bc73576 req-b7b78c3e-6f8a-405c-9f61-cb3e0768fc48 tempest-TestVolumeBackupRestore-1484692939 None] Terminate volume connection completed successfully. Jan 29 21:07:03.429114 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-19b6b1d5-873d-41a4-ad6f-b80b0bc73576 req-b7b78c3e-6f8a-405c-9f61-cb3e0768fc48 tempest-TestVolumeBackupRestore-1484692939 None] Deleting attachment 2b1fe6b1-2def-4125-9823-2657ae270907. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:07:03.955382 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-14ae3b00-16b7-4f98-a9cd-17fa58c1447f tempest-VolumesExtendTest-1931285563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:04.231182 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6c5310ab-81c8-4327-8ec3-3fc4c3d8b925 tempest-GroupSnapshotsTest-1940853820 None] Group tempest-GroupSnapshotsTest-Group-1826777555: creating Jan 29 21:07:04.259245 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6c5310ab-81c8-4327-8ec3-3fc4c3d8b925 tempest-GroupSnapshotsTest-1940853820 None] Group tempest-GroupSnapshotsTest-Group-1826777555: created successfully Jan 29 21:07:04.271016 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6c5310ab-81c8-4327-8ec3-3fc4c3d8b925 tempest-GroupSnapshotsTest-1940853820 None] Create group completed successfully. Jan 29 21:07:04.280668 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-14ae3b00-16b7-4f98-a9cd-17fa58c1447f tempest-VolumesExtendTest-1931285563 None] Extend volume from 1 GB to 2 GB. {{(pid=134283) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Jan 29 21:07:04.321323 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-14ae3b00-16b7-4f98-a9cd-17fa58c1447f tempest-VolumesExtendTest-1931285563 None] Extend volume completed successfully. Jan 29 21:07:05.782487 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-4ee5b29d-ded2-42b2-a3db-635eb87011de tempest-TestVolumeBackupRestore-1484692939 None] Lock "b'cinder-7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:07:05.838431 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4ee5b29d-ded2-42b2-a3db-635eb87011de tempest-TestVolumeBackupRestore-1484692939 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:06.575432 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4ee5b29d-ded2-42b2-a3db-635eb87011de tempest-TestVolumeBackupRestore-1484692939 None] Volume volume-7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:07:06.599136 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4ee5b29d-ded2-42b2-a3db-635eb87011de tempest-TestVolumeBackupRestore-1484692939 None] deleting rbd volume volume-7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:07:06.665484 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:07:06.669331 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:07:06.670050 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:07:06.691740 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Flow 'volume_create_manager' (861157e0-d65c-414d-aa48-a667376ea2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:07:06.699548 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b433b728-bc38-417c-8cf4-91939615ea95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:06.714115 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:07:06.739333 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b433b728-bc38-417c-8cf4-91939615ea95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-115849678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8157d62a-60fa-4c76-b31a-94e7388ece96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374f378be1684b84b05434245324cf27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:07:06Z,use_quota=True,user_id='71b2e565044e4fd3b16c6c3743829af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:06.749860 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8f166c-ed0e-4bd6-96b1-8034cc9d0b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:06.760790 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8f166c-ed0e-4bd6-96b1-8034cc9d0b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:06.780216 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787fc1d6-1ed4-4439-9129-39e806e77e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:06.790519 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787fc1d6-1ed4-4439-9129-39e806e77e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8157d62a-60fa-4c76-b31a-94e7388ece96', 'volume_name': 'volume-8157d62a-60fa-4c76-b31a-94e7388ece96', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:06.799932 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6741631c-3a83-475b-871b-5f1fdbd14fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:06.821226 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6741631c-3a83-475b-871b-5f1fdbd14fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:06.827035 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ff228b-49e8-4f0b-80c6-bb108b68997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:06.828429 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Volume 8157d62a-60fa-4c76-b31a-94e7388ece96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8157d62a-60fa-4c76-b31a-94e7388ece96', 'volume_size': 1} Jan 29 21:07:06.829080 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] creating volume 'volume-8157d62a-60fa-4c76-b31a-94e7388ece96' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:07:06.830303 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:06.865636 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-bb9fdb60-c46a-4f6c-a551-66813ff9c14a tempest-TestVolumeBackupRestore-1484692939 None] Lock "b'cinder-030e378f-c9fa-4e82-9f25-1c298c1a9cb5-delete_volume'" acquired by "delete_volume" :: waited 0.223s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:07:06.882747 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:07:06.889522 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:07:06.890275 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:07:06.949726 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Flow 'volume_create_manager' (ba43e29a-451f-4914-852f-6dbc43efdc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:07:06.964640 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e559269-b541-40d4-aa69-ab7f2e853d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:06.995597 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:07:06.995597 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:07:06.997045 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ff228b-49e8-4f0b-80c6-bb108b68997d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8157d62a-60fa-4c76-b31a-94e7388ece96', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:07.001878 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b94ded0-06b1-4d3a-b360-0854e080f31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:07.016172 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:07:07.078251 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e559269-b541-40d4-aa69-ab7f2e853d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-474450437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3300435c-d54b-4116-96a6-2015f7868a67,host='ncdv-master-1@ceph#ceph',id=42d5f944-80f1-46e2-8f4a-46a680273182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3afea838c3c94b9e825ced924f1abbf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:07:06Z,use_quota=True,user_id='35421d40099b474aba176f99a2050f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a5c36ad-5742-4c28-a417-fd0c1f0a8caa),volume_type_id=2a5c36ad-5742-4c28-a417-fd0c1f0a8caa)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:07.088208 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a622b411-1236-4dc5-a66b-186479a24882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:07.092945 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a622b411-1236-4dc5-a66b-186479a24882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:07.099345 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (334691a8-4b42-4079-8e32-3289edbbd6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:07.113463 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (334691a8-4b42-4079-8e32-3289edbbd6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d5f944-80f1-46e2-8f4a-46a680273182', 'volume_name': 'volume-42d5f944-80f1-46e2-8f4a-46a680273182', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:07.146368 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc58ac03-6318-4aad-a48d-610e4f1ed0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:07.161281 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc58ac03-6318-4aad-a48d-610e4f1ed0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:07.166997 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d80a29-e460-4505-bd30-b15c219a307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:07.168387 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Volume 42d5f944-80f1-46e2-8f4a-46a680273182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d5f944-80f1-46e2-8f4a-46a680273182', 'volume_size': 1} Jan 29 21:07:07.169003 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] creating volume 'volume-42d5f944-80f1-46e2-8f4a-46a680273182' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:07:07.170028 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:07.235791 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Volume volume-8157d62a-60fa-4c76-b31a-94e7388ece96 (8157d62a-60fa-4c76-b31a-94e7388ece96): created successfully Jan 29 21:07:07.240729 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b94ded0-06b1-4d3a-b360-0854e080f31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:07.252033 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Flow 'volume_create_manager' (861157e0-d65c-414d-aa48-a667376ea2e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:07:07.261756 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb9fdb60-c46a-4f6c-a551-66813ff9c14a tempest-TestVolumeBackupRestore-1484692939 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:07.643834 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb9fdb60-c46a-4f6c-a551-66813ff9c14a tempest-TestVolumeBackupRestore-1484692939 None] deleting rbd volume volume-030e378f-c9fa-4e82-9f25-1c298c1a9cb5 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:07:07.652239 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] extra_specs: {} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:07:07.652597 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] extra_specs: {} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:07:07.670712 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d80a29-e460-4505-bd30-b15c219a307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d5f944-80f1-46e2-8f4a-46a680273182', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:07.687044 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9768311-1c5d-469f-aa1d-31fd776ae7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:07.709152 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-15cecfe0-17ea-4023-ba51-eb31d58f4725 tempest-VolumesExtendTest-1931285563 None] Created volume successfully. Jan 29 21:07:07.734355 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Volume volume-42d5f944-80f1-46e2-8f4a-46a680273182 (42d5f944-80f1-46e2-8f4a-46a680273182): created successfully Jan 29 21:07:07.745767 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9768311-1c5d-469f-aa1d-31fd776ae7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:07.755993 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Flow 'volume_create_manager' (ba43e29a-451f-4914-852f-6dbc43efdc45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:07:07.771326 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d2afda3c-7caf-4e9e-b8a5-34fd9be2a4c7 tempest-GroupSnapshotsTest-1940853820 None] Created volume successfully. Jan 29 21:07:07.829873 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-4ee5b29d-ded2-42b2-a3db-635eb87011de tempest-TestVolumeBackupRestore-1484692939 None] Created reservations ['0dad704b-9905-47a0-9096-256bb419e241', 'f5fbd47d-32a6-41e2-bba1-a7d256cc59c9', '222aaada-a645-4e65-82d1-b7ca52c3431e', '0d558bfd-d17c-4a47-967e-5c45bde8143d'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:07.921017 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4ee5b29d-ded2-42b2-a3db-635eb87011de tempest-TestVolumeBackupRestore-1484692939 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:08.002053 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4ee5b29d-ded2-42b2-a3db-635eb87011de tempest-TestVolumeBackupRestore-1484692939 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:08.081059 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-4ee5b29d-ded2-42b2-a3db-635eb87011de tempest-TestVolumeBackupRestore-1484692939 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:07:08.083473 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb9fdb60-c46a-4f6c-a551-66813ff9c14a tempest-TestVolumeBackupRestore-1484692939 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 21:07:08.129360 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb9fdb60-c46a-4f6c-a551-66813ff9c14a tempest-TestVolumeBackupRestore-1484692939 None] deleting parent snapshot volume-030e378f-c9fa-4e82-9f25-1c298c1a9cb5.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 21:07:08.669475 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6ce0c962-98b6-4140-91b4-6d08390b33db tempest-GroupSnapshotsTest-1940853820 None] GroupSnapshot 10e82eb6-4522-413c-b1af-00ae1e1adde7: creating. Jan 29 21:07:08.674776 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4ee5b29d-ded2-42b2-a3db-635eb87011de tempest-TestVolumeBackupRestore-1484692939 None] Deleted volume successfully. Jan 29 21:07:08.711882 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6ce0c962-98b6-4140-91b4-6d08390b33db tempest-GroupSnapshotsTest-1940853820 None] Group snapshot 10e82eb6-4522-413c-b1af-00ae1e1adde7: creating. {{(pid=134283) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4077}} Jan 29 21:07:08.728154 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-4ee5b29d-ded2-42b2-a3db-635eb87011de tempest-TestVolumeBackupRestore-1484692939 None] Lock "b'cinder-7e8cfa75-20c6-4bb8-ba8f-f16b6befc7a0-delete_volume'" released by "delete_volume" :: held 2.947s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:07:08.742330 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0c0df789-30e0-42c8-8212-86f19da6efcc tempest-VolumesExtendTest-1931285563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:08.834942 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6ce0c962-98b6-4140-91b4-6d08390b33db tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:08.895477 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-bb9fdb60-c46a-4f6c-a551-66813ff9c14a tempest-TestVolumeBackupRestore-1484692939 None] Created reservations ['2f426959-11d1-4c57-aebf-107ec1b3f241', '6f7245d4-938d-4bac-89ee-22d2d39d8480', 'cf3df73a-9dae-44d9-9ec3-9602eb2bf12b', 'eb66e903-4081-42c4-8c4b-fd7315cd47cd'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:08.952701 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb9fdb60-c46a-4f6c-a551-66813ff9c14a tempest-TestVolumeBackupRestore-1484692939 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:08.996367 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb9fdb60-c46a-4f6c-a551-66813ff9c14a tempest-TestVolumeBackupRestore-1484692939 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:09.066303 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-bb9fdb60-c46a-4f6c-a551-66813ff9c14a tempest-TestVolumeBackupRestore-1484692939 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:07:09.083071 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-bb9fdb60-c46a-4f6c-a551-66813ff9c14a tempest-TestVolumeBackupRestore-1484692939 None] Deleted volume successfully. Jan 29 21:07:09.105353 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-bb9fdb60-c46a-4f6c-a551-66813ff9c14a tempest-TestVolumeBackupRestore-1484692939 None] Lock "b'cinder-030e378f-c9fa-4e82-9f25-1c298c1a9cb5-delete_volume'" released by "delete_volume" :: held 2.240s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:07:09.836415 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-0c0df789-30e0-42c8-8212-86f19da6efcc tempest-VolumesExtendTest-1931285563 None] Create snapshot completed successfully Jan 29 21:07:09.892672 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6ce0c962-98b6-4140-91b4-6d08390b33db tempest-GroupSnapshotsTest-1940853820 None] group_snapshot 10e82eb6-4522-413c-b1af-00ae1e1adde7: created successfully Jan 29 21:07:10.600474 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9d5c54ec-fed7-453e-b865-653a5b98c882 tempest-VolumesExtendTest-1931285563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:10.698929 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9d5c54ec-fed7-453e-b865-653a5b98c882 tempest-VolumesExtendTest-1931285563 None] Extend volume from 1 GB to 2 GB. {{(pid=134283) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Jan 29 21:07:10.727159 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9d5c54ec-fed7-453e-b865-653a5b98c882 tempest-VolumesExtendTest-1931285563 None] Extend volume completed successfully. Jan 29 21:07:11.295346 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e7cced76-ce0f-4b68-b61e-a962515e0017 tempest-GroupSnapshotsTest-1940853820 None] cloning volumes/volume-42d5f944-80f1-46e2-8f4a-46a680273182@snapshot-e31ef22c-942e-4e35-86d8-e6bd1fa66891 to volume-e9cfdbb1-7043-489b-9a06-18ae51933b92 {{(pid=134283) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 29 21:07:11.296276 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e7cced76-ce0f-4b68-b61e-a962515e0017 tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:11.363784 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e7cced76-ce0f-4b68-b61e-a962515e0017 tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:11.628731 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e7cced76-ce0f-4b68-b61e-a962515e0017 tempest-GroupSnapshotsTest-1940853820 None] extra_specs: {} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:07:11.629165 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e7cced76-ce0f-4b68-b61e-a962515e0017 tempest-GroupSnapshotsTest-1940853820 None] extra_specs: {} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:07:11.634696 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e7cced76-ce0f-4b68-b61e-a962515e0017 tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:11.714346 ncdv-master-1 cinder-volume[134283]: WARNING cinder.volume.drivers.rbd [None req-e7cced76-ce0f-4b68-b61e-a962515e0017 tempest-GroupSnapshotsTest-1940853820 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError Jan 29 21:07:11.881395 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-a36ecce0-f003-4b0a-8054-0ad33ad7e645 tempest-VolumesExtendTest-1931285563 None] Lock "b'cinder-9a2f74bc-4406-4217-9ca3-f8d4720c9427-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.025s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:07:11.883806 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a36ecce0-f003-4b0a-8054-0ad33ad7e645 tempest-VolumesExtendTest-1931285563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:11.994480 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e7cced76-ce0f-4b68-b61e-a962515e0017 tempest-GroupSnapshotsTest-1940853820 None] Create group from source-snapshot-10e82eb6-4522-413c-b1af-00ae1e1adde7 completed successfully. Jan 29 21:07:12.393728 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-a36ecce0-f003-4b0a-8054-0ad33ad7e645 tempest-VolumesExtendTest-1931285563 None] Created reservations ['95f6bd1d-7bd4-48a5-9a3f-10ee2afb6fcb', 'fab94a6e-229a-4e71-a54d-71b29323eab4', '15c50c23-b954-44ad-99b3-ae6aefddc266', '849467e2-d121-4cd9-b5a3-ac299ab4f5f0'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:12.458421 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-a36ecce0-f003-4b0a-8054-0ad33ad7e645 tempest-VolumesExtendTest-1931285563 None] Delete snapshot completed successfully. Jan 29 21:07:12.464322 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-a36ecce0-f003-4b0a-8054-0ad33ad7e645 tempest-VolumesExtendTest-1931285563 None] Lock "b'cinder-9a2f74bc-4406-4217-9ca3-f8d4720c9427-delete_snapshot'" released by "delete_snapshot" :: held 0.583s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:07:12.919130 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c5c47e4e-c7d0-46d6-80b7-d0cb4dcbd5a0 tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:13.002216 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c5c47e4e-c7d0-46d6-80b7-d0cb4dcbd5a0 tempest-GroupSnapshotsTest-1940853820 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:07:13.018170 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c5c47e4e-c7d0-46d6-80b7-d0cb4dcbd5a0 tempest-GroupSnapshotsTest-1940853820 None] deleting rbd volume volume-e9cfdbb1-7043-489b-9a06-18ae51933b92 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:07:13.058589 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-ab47388e-c7cd-4cfb-baef-5282c8bece8c tempest-VolumesExtendTest-1931285563 None] Lock "b'cinder-8157d62a-60fa-4c76-b31a-94e7388ece96-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:07:13.106936 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ab47388e-c7cd-4cfb-baef-5282c8bece8c tempest-VolumesExtendTest-1931285563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:13.199691 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ab47388e-c7cd-4cfb-baef-5282c8bece8c tempest-VolumesExtendTest-1931285563 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:07:13.200174 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ab47388e-c7cd-4cfb-baef-5282c8bece8c tempest-VolumesExtendTest-1931285563 None] Volume volume-8157d62a-60fa-4c76-b31a-94e7388ece96 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:07:13.208962 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ab47388e-c7cd-4cfb-baef-5282c8bece8c tempest-VolumesExtendTest-1931285563 None] deleting rbd volume volume-8157d62a-60fa-4c76-b31a-94e7388ece96 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:07:13.475009 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-c5c47e4e-c7d0-46d6-80b7-d0cb4dcbd5a0 tempest-GroupSnapshotsTest-1940853820 None] Created reservations ['117a4f39-e4a2-47bf-a40f-069d16938d0b'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:13.514480 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-c5c47e4e-c7d0-46d6-80b7-d0cb4dcbd5a0 tempest-GroupSnapshotsTest-1940853820 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-996641810 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-996641810, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:07:13.515524 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-c5c47e4e-c7d0-46d6-80b7-d0cb4dcbd5a0 tempest-GroupSnapshotsTest-1940853820 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-996641810 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-996641810, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:07:13.535534 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-c5c47e4e-c7d0-46d6-80b7-d0cb4dcbd5a0 tempest-GroupSnapshotsTest-1940853820 None] Created reservations ['93ed91ee-41ec-46f8-925e-e0d29b12f9ca', 'd81385b1-1033-43c8-8e64-0458d4c389d6', '10da7382-8699-4e47-be4c-0b3947ca3042', 'eec936b2-b498-4bcb-9f04-d12ede254a09'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:13.723083 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-ab47388e-c7cd-4cfb-baef-5282c8bece8c tempest-VolumesExtendTest-1931285563 None] Created reservations ['b57160da-b06b-4e7f-bc97-4ef5f516598e', 'f7669f24-9102-4a9e-b332-228dcd7a9e1f', 'e5aa3de3-b90a-4f07-9498-3fb215f81063', '2d3cd963-f67f-4582-9f7e-b7cfd5f21cdf'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:13.766691 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c5c47e4e-c7d0-46d6-80b7-d0cb4dcbd5a0 tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:13.824342 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c5c47e4e-c7d0-46d6-80b7-d0cb4dcbd5a0 tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:13.885466 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-c5c47e4e-c7d0-46d6-80b7-d0cb4dcbd5a0 tempest-GroupSnapshotsTest-1940853820 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:07:13.923353 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-c5c47e4e-c7d0-46d6-80b7-d0cb4dcbd5a0 tempest-GroupSnapshotsTest-1940853820 None] Delete group completed successfully. Jan 29 21:07:13.925472 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ab47388e-c7cd-4cfb-baef-5282c8bece8c tempest-VolumesExtendTest-1931285563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:13.997790 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ab47388e-c7cd-4cfb-baef-5282c8bece8c tempest-VolumesExtendTest-1931285563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:14.059759 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-ab47388e-c7cd-4cfb-baef-5282c8bece8c tempest-VolumesExtendTest-1931285563 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:07:14.068044 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ab47388e-c7cd-4cfb-baef-5282c8bece8c tempest-VolumesExtendTest-1931285563 None] Deleted volume successfully. Jan 29 21:07:14.089841 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-ab47388e-c7cd-4cfb-baef-5282c8bece8c tempest-VolumesExtendTest-1931285563 None] Lock "b'cinder-8157d62a-60fa-4c76-b31a-94e7388ece96-delete_volume'" released by "delete_volume" :: held 1.032s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:07:14.142217 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d7510797-e51b-4cb8-964d-41a164b413c0 tempest-GroupSnapshotsTest-1940853820 None] group_snapshot 10e82eb6-4522-413c-b1af-00ae1e1adde7: deleting Jan 29 21:07:14.165916 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d7510797-e51b-4cb8-964d-41a164b413c0 tempest-GroupSnapshotsTest-1940853820 None] group_snapshot 10e82eb6-4522-413c-b1af-00ae1e1adde7: deleting {{(pid=134283) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4252}} Jan 29 21:07:14.197303 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d7510797-e51b-4cb8-964d-41a164b413c0 tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:14.302699 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-1a73dc79-e066-49d8-8846-c449336b8d2e tempest-VolumesExtendTest-1931285563 None] Lock "b'cinder-b9aff24b-7124-4446-979b-efca74b5210c-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:07:14.347701 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1a73dc79-e066-49d8-8846-c449336b8d2e tempest-VolumesExtendTest-1931285563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:14.436521 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1a73dc79-e066-49d8-8846-c449336b8d2e tempest-VolumesExtendTest-1931285563 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:07:14.449136 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1a73dc79-e066-49d8-8846-c449336b8d2e tempest-VolumesExtendTest-1931285563 None] deleting rbd volume volume-b9aff24b-7124-4446-979b-efca74b5210c {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:07:14.674033 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1a73dc79-e066-49d8-8846-c449336b8d2e tempest-VolumesExtendTest-1931285563 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 21:07:14.714935 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1a73dc79-e066-49d8-8846-c449336b8d2e tempest-VolumesExtendTest-1931285563 None] deleting parent snapshot volume-b9aff24b-7124-4446-979b-efca74b5210c.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 21:07:15.411002 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-1a73dc79-e066-49d8-8846-c449336b8d2e tempest-VolumesExtendTest-1931285563 None] Created reservations ['fc2d5c5f-8b1e-44c3-97d8-59173279a572', 'cc0de321-d91f-445c-a3d8-7f0511741d6c', '8055ac68-5898-4a82-a401-38e1346957ef', 'c83c8293-b713-4fb4-bdd3-a093c5bdaf08'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:15.468228 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-d7510797-e51b-4cb8-964d-41a164b413c0 tempest-GroupSnapshotsTest-1940853820 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-996641810 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-996641810, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:07:15.489995 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1a73dc79-e066-49d8-8846-c449336b8d2e tempest-VolumesExtendTest-1931285563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:15.541646 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1a73dc79-e066-49d8-8846-c449336b8d2e tempest-VolumesExtendTest-1931285563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:15.620300 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-1a73dc79-e066-49d8-8846-c449336b8d2e tempest-VolumesExtendTest-1931285563 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:07:15.627472 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-1a73dc79-e066-49d8-8846-c449336b8d2e tempest-VolumesExtendTest-1931285563 None] Deleted volume successfully. Jan 29 21:07:15.638545 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-d7510797-e51b-4cb8-964d-41a164b413c0 tempest-GroupSnapshotsTest-1940853820 None] Created reservations ['38dcbdbe-eff4-4e10-ad9f-fcd5ad867b98', '5711d80c-1cb4-4c9c-9786-7736e26b2647', '89365581-7741-49dc-b43b-a581f0a84232', '9a264ab3-ccd4-4a14-9b72-87acf6f2cb47'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:15.651189 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-1a73dc79-e066-49d8-8846-c449336b8d2e tempest-VolumesExtendTest-1931285563 None] Lock "b'cinder-b9aff24b-7124-4446-979b-efca74b5210c-delete_volume'" released by "delete_volume" :: held 1.348s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:07:15.721883 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d7510797-e51b-4cb8-964d-41a164b413c0 tempest-GroupSnapshotsTest-1940853820 None] group_snapshot 10e82eb6-4522-413c-b1af-00ae1e1adde7: deleted successfully Jan 29 21:07:16.889322 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cdde7123-5791-4803-8cf7-1e28551d858e tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:16.968517 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cdde7123-5791-4803-8cf7-1e28551d858e tempest-GroupSnapshotsTest-1940853820 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:07:16.969833 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cdde7123-5791-4803-8cf7-1e28551d858e tempest-GroupSnapshotsTest-1940853820 None] Volume volume-42d5f944-80f1-46e2-8f4a-46a680273182 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:07:16.983804 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cdde7123-5791-4803-8cf7-1e28551d858e tempest-GroupSnapshotsTest-1940853820 None] deleting rbd volume volume-42d5f944-80f1-46e2-8f4a-46a680273182 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:07:17.467954 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-cdde7123-5791-4803-8cf7-1e28551d858e tempest-GroupSnapshotsTest-1940853820 None] Created reservations ['9247d004-30ff-4155-a32e-c80b95e9810d'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:17.506472 ncdv-master-1 cinder-volume[134283]: WARNING cinder.db.sqlalchemy.api [None req-cdde7123-5791-4803-8cf7-1e28551d858e tempest-GroupSnapshotsTest-1940853820 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-996641810'] Jan 29 21:07:17.530712 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-cdde7123-5791-4803-8cf7-1e28551d858e tempest-GroupSnapshotsTest-1940853820 None] Created reservations ['c6ad4f5b-dc03-4479-aafc-1098002eff2c', '212f5e40-bfb7-4d7d-9581-eed2e41c9496', '02119d8e-b9d5-4472-950c-41885986e7af', 'c5822aef-7e89-4c97-b873-8577003468d3'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:17.670514 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cdde7123-5791-4803-8cf7-1e28551d858e tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:17.742085 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cdde7123-5791-4803-8cf7-1e28551d858e tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:17.792398 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-cdde7123-5791-4803-8cf7-1e28551d858e tempest-GroupSnapshotsTest-1940853820 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:07:17.798047 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-cdde7123-5791-4803-8cf7-1e28551d858e tempest-GroupSnapshotsTest-1940853820 None] Delete group completed successfully. Jan 29 21:07:18.381587 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-87cd9b73-e511-492c-b365-15e626c610bd tempest-GroupSnapshotsTest-1940853820 None] Group tempest-GroupSnapshotsTest-Group-813981830: creating Jan 29 21:07:18.407424 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-87cd9b73-e511-492c-b365-15e626c610bd tempest-GroupSnapshotsTest-1940853820 None] Group tempest-GroupSnapshotsTest-Group-813981830: created successfully Jan 29 21:07:18.418171 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-87cd9b73-e511-492c-b365-15e626c610bd tempest-GroupSnapshotsTest-1940853820 None] Create group completed successfully. Jan 29 21:07:19.931946 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:07:19.943986 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:07:19.947473 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:07:19.995704 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Flow 'volume_create_manager' (44276c1b-90fd-4b03-bf80-c4f7e805e64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:07:20.005699 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8324feae-b3f2-4ccd-9d73-b64926c632d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:20.013202 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:07:20.033255 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8324feae-b3f2-4ccd-9d73-b64926c632d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-894342633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1397d5b5-5de1-4af8-b3be-1637fee69af7,host='ncdv-master-1@ceph#ceph',id=b4baf4a8-8001-41e2-aab5-bf296b29c664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3afea838c3c94b9e825ced924f1abbf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:07:20Z,use_quota=True,user_id='35421d40099b474aba176f99a2050f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(adb0866e-3f0a-449c-8717-eb64b9f53b19),volume_type_id=adb0866e-3f0a-449c-8717-eb64b9f53b19)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:20.039255 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd610a5-5937-455a-b303-b22700aca597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:20.044288 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd610a5-5937-455a-b303-b22700aca597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:20.070970 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949a67fc-dc3e-4ac1-90f6-c84560c7f9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:20.081967 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949a67fc-dc3e-4ac1-90f6-c84560c7f9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4baf4a8-8001-41e2-aab5-bf296b29c664', 'volume_name': 'volume-b4baf4a8-8001-41e2-aab5-bf296b29c664', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:20.094918 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a526a9c8-a9b9-4de5-a560-fea0d5944611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:20.099276 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a526a9c8-a9b9-4de5-a560-fea0d5944611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:20.109205 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8029b031-b128-46c8-a576-c7c46e7c2a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:20.113038 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Volume b4baf4a8-8001-41e2-aab5-bf296b29c664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4baf4a8-8001-41e2-aab5-bf296b29c664', 'volume_size': 1} Jan 29 21:07:20.114556 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] creating volume 'volume-b4baf4a8-8001-41e2-aab5-bf296b29c664' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:07:20.117394 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:20.280150 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] extra_specs: {} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:07:20.280595 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] extra_specs: {} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:07:20.285379 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8029b031-b128-46c8-a576-c7c46e7c2a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4baf4a8-8001-41e2-aab5-bf296b29c664', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:20.290436 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c64fb4d-a838-4495-92e2-ed46954fdc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:20.304287 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Volume volume-b4baf4a8-8001-41e2-aab5-bf296b29c664 (b4baf4a8-8001-41e2-aab5-bf296b29c664): created successfully Jan 29 21:07:20.308791 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c64fb4d-a838-4495-92e2-ed46954fdc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:20.317762 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Flow 'volume_create_manager' (44276c1b-90fd-4b03-bf80-c4f7e805e64f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:07:20.330229 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-b65b05b9-9e06-4334-8882-a30a1c5ea963 tempest-GroupSnapshotsTest-1940853820 None] Created volume successfully. Jan 29 21:07:21.532007 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:07:21.539442 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:07:21.540042 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:07:21.576240 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Flow 'volume_create_manager' (32cb1f09-eaee-4822-9a9b-8512b2dd4071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:07:21.584581 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1bae2e1-1624-4716-b99c-d6a080800ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:21.606121 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:07:21.624589 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1bae2e1-1624-4716-b99c-d6a080800ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1442834112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1397d5b5-5de1-4af8-b3be-1637fee69af7,host='ncdv-master-1@ceph#ceph',id=94f11e76-95a8-4b4b-bbf3-661e8c3a9552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3afea838c3c94b9e825ced924f1abbf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:07:21Z,use_quota=True,user_id='35421d40099b474aba176f99a2050f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(adb0866e-3f0a-449c-8717-eb64b9f53b19),volume_type_id=adb0866e-3f0a-449c-8717-eb64b9f53b19)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:21.631246 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfbe940-bfde-4fce-83ef-8e27bbe3260c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:21.636313 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfbe940-bfde-4fce-83ef-8e27bbe3260c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:21.642746 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fe97ec-90d3-4d96-be46-600da9238cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:21.647963 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fe97ec-90d3-4d96-be46-600da9238cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f11e76-95a8-4b4b-bbf3-661e8c3a9552', 'volume_name': 'volume-94f11e76-95a8-4b4b-bbf3-661e8c3a9552', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:21.653820 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a506e5-b4ba-4185-ac5f-3c172a3d580b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:21.658253 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a506e5-b4ba-4185-ac5f-3c172a3d580b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:21.667255 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f376b9a-9eab-44c6-bcf9-b48e3374d078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:21.668778 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Volume 94f11e76-95a8-4b4b-bbf3-661e8c3a9552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f11e76-95a8-4b4b-bbf3-661e8c3a9552', 'volume_size': 1} Jan 29 21:07:21.669429 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] creating volume 'volume-94f11e76-95a8-4b4b-bbf3-661e8c3a9552' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:07:21.670637 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:21.773875 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] extra_specs: {} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:07:21.775150 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] extra_specs: {} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:07:21.783348 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f376b9a-9eab-44c6-bcf9-b48e3374d078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f11e76-95a8-4b4b-bbf3-661e8c3a9552', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:21.791131 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f853cbfd-3c0e-4b1a-8f2c-9ca188799fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:21.801352 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Volume volume-94f11e76-95a8-4b4b-bbf3-661e8c3a9552 (94f11e76-95a8-4b4b-bbf3-661e8c3a9552): created successfully Jan 29 21:07:21.806225 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f853cbfd-3c0e-4b1a-8f2c-9ca188799fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:21.812737 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Flow 'volume_create_manager' (32cb1f09-eaee-4822-9a9b-8512b2dd4071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:07:21.852854 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d7e0f667-4b35-45ce-b7da-875c75d5b25d tempest-GroupSnapshotsTest-1940853820 None] Created volume successfully. Jan 29 21:07:22.713814 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-56eebb56-ba89-4164-acaf-f3f4e7ff31a5 tempest-GroupSnapshotsTest-1940853820 None] Update group completed successfully. Jan 29 21:07:24.024361 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-c05ba730-8d97-4542-abff-a9b7c5533d43 tempest-GroupSnapshotsTest-1940853820 None] Update group completed successfully. Jan 29 21:07:25.274837 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-b3503ed3-8a7d-4124-844c-4fbcdbc77756 tempest-GroupSnapshotsTest-1940853820 None] Update group completed successfully. Jan 29 21:07:26.609968 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f37f4b0f-4b24-45cd-8731-17f8cc0fcabc tempest-GroupSnapshotsTest-1940853820 None] Update group completed successfully. Jan 29 21:07:28.020573 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6715fc47-93be-4ce1-a13f-c0a71e24132d tempest-GroupSnapshotsTest-1940853820 None] GroupSnapshot e3541979-df74-4cff-a704-792d1ca11d7b: creating. Jan 29 21:07:28.052974 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6715fc47-93be-4ce1-a13f-c0a71e24132d tempest-GroupSnapshotsTest-1940853820 None] Group snapshot e3541979-df74-4cff-a704-792d1ca11d7b: creating. {{(pid=134283) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4077}} Jan 29 21:07:28.084145 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6715fc47-93be-4ce1-a13f-c0a71e24132d tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:28.673724 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:07:28.678013 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:28.786847 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:28.836700 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:07:28.896013 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6715fc47-93be-4ce1-a13f-c0a71e24132d tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:29.970796 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6715fc47-93be-4ce1-a13f-c0a71e24132d tempest-GroupSnapshotsTest-1940853820 None] group_snapshot e3541979-df74-4cff-a704-792d1ca11d7b: created successfully Jan 29 21:07:30.476433 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9e26cc6f-6cd1-4105-afbb-49fda7ba9cf2 tempest-GroupSnapshotsTest-1940853820 None] group_snapshot e3541979-df74-4cff-a704-792d1ca11d7b: deleting Jan 29 21:07:30.516104 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9e26cc6f-6cd1-4105-afbb-49fda7ba9cf2 tempest-GroupSnapshotsTest-1940853820 None] group_snapshot e3541979-df74-4cff-a704-792d1ca11d7b: deleting {{(pid=134283) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4252}} Jan 29 21:07:30.556376 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9e26cc6f-6cd1-4105-afbb-49fda7ba9cf2 tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:31.874732 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9e26cc6f-6cd1-4105-afbb-49fda7ba9cf2 tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:32.911720 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-9e26cc6f-6cd1-4105-afbb-49fda7ba9cf2 tempest-GroupSnapshotsTest-1940853820 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1648230781 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1648230781, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:07:32.914033 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-9e26cc6f-6cd1-4105-afbb-49fda7ba9cf2 tempest-GroupSnapshotsTest-1940853820 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1648230781 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1648230781, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:07:32.948326 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-9e26cc6f-6cd1-4105-afbb-49fda7ba9cf2 tempest-GroupSnapshotsTest-1940853820 None] Created reservations ['c826dc22-4749-4295-93dd-1c3c35ea5909', '3d0c44a3-97b5-4b04-b580-3c6a7ee6138b', '5dd0ed8c-73cf-433f-8777-b86f83410f7f', '5a87c9b9-8bb8-4ee3-ad61-34dd25662055'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:33.109028 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-9e26cc6f-6cd1-4105-afbb-49fda7ba9cf2 tempest-GroupSnapshotsTest-1940853820 None] Created reservations ['1fda4b40-2583-41ca-b890-32b3e49213c6', '863ad910-b7ef-4fbb-89f6-50abcf4fb1ec', 'acb63b1d-a0ee-4733-9f04-1db35dbf6204', 'fb126af3-7fec-4fcc-a9ec-d2fa0d1aa383'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:33.191057 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9e26cc6f-6cd1-4105-afbb-49fda7ba9cf2 tempest-GroupSnapshotsTest-1940853820 None] group_snapshot e3541979-df74-4cff-a704-792d1ca11d7b: deleted successfully Jan 29 21:07:34.345282 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:34.412293 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:07:34.417642 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] Volume volume-94f11e76-95a8-4b4b-bbf3-661e8c3a9552 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:07:34.426420 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] deleting rbd volume volume-94f11e76-95a8-4b4b-bbf3-661e8c3a9552 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:07:34.735175 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:34.806064 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:07:34.806663 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] Volume volume-b4baf4a8-8001-41e2-aab5-bf296b29c664 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:07:34.813946 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] deleting rbd volume volume-b4baf4a8-8001-41e2-aab5-bf296b29c664 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:07:35.268366 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] Created reservations ['0a676c09-0bc1-4058-9ac7-bff4e3916528'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:35.286467 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1648230781 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1648230781, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:07:35.302437 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] Created reservations ['96e43232-ac6a-4bde-a80e-691107a287c4', '0376f444-3024-48e4-92e7-2a8f9bb7c548', 'b935a914-af7b-431d-bab1-28d5f4b11710', '7c46c664-e8ff-49ff-afbf-84c395f20496'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:35.387597 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] Created reservations ['56a18ca7-81b2-4bd2-b7b2-c7b93dc04e27', '311152e8-803a-4546-83ae-29268c609bab', 'c2a5d688-cbbd-4e2b-8378-227a913e8cad', 'ee1ca80c-24e8-419b-bbec-751ef1a1139f'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:35.485827 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:35.548117 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:35.619660 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:07:35.623730 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-3a8c3661-3b03-4b63-ba39-481813631e0f tempest-GroupSnapshotsTest-1940853820 None] Delete group completed successfully. Jan 29 21:07:35.928657 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f72c96c4-1356-48e7-ba7d-f63f85e9a87c tempest-GroupSnapshotsTest-1940853820 None] Group tempest-GroupSnapshotsTest-Group-1851995211: creating Jan 29 21:07:35.948347 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f72c96c4-1356-48e7-ba7d-f63f85e9a87c tempest-GroupSnapshotsTest-1940853820 None] Group tempest-GroupSnapshotsTest-Group-1851995211: created successfully Jan 29 21:07:35.968450 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f72c96c4-1356-48e7-ba7d-f63f85e9a87c tempest-GroupSnapshotsTest-1940853820 None] Create group completed successfully. Jan 29 21:07:37.702132 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:07:37.708757 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:07:37.709656 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:07:37.802530 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Flow 'volume_create_manager' (841176a5-93f4-40d8-a0dd-93639ef3ef58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:07:37.837468 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c8d1ab-dc2f-406d-bf95-df4d5a347ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:37.850582 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:07:37.885472 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c8d1ab-dc2f-406d-bf95-df4d5a347ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1507023254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6718be67-3574-4f90-abcc-242e7005bd20,host='ncdv-master-1@ceph#ceph',id=f85e748d-fc8b-4622-80a4-3fe73e99b8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3afea838c3c94b9e825ced924f1abbf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:07:38Z,use_quota=True,user_id='35421d40099b474aba176f99a2050f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddcc6847-07d1-4139-857d-eefe95c2799d),volume_type_id=ddcc6847-07d1-4139-857d-eefe95c2799d)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:37.896575 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048f4c56-c06a-4ec6-bb3d-720ccf0cc031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:37.902730 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048f4c56-c06a-4ec6-bb3d-720ccf0cc031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:37.914687 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4722ea0-2a21-4c6f-80fb-4dcd6f2875e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:37.945678 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4722ea0-2a21-4c6f-80fb-4dcd6f2875e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f85e748d-fc8b-4622-80a4-3fe73e99b8ef', 'volume_name': 'volume-f85e748d-fc8b-4622-80a4-3fe73e99b8ef', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:37.951393 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2885eb6d-f77e-47d7-a61c-4db98ca25fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:37.962423 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2885eb6d-f77e-47d7-a61c-4db98ca25fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:37.976635 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2fea19-5247-48e0-a3cb-e799b077bb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:37.977938 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Volume f85e748d-fc8b-4622-80a4-3fe73e99b8ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f85e748d-fc8b-4622-80a4-3fe73e99b8ef', 'volume_size': 1} Jan 29 21:07:37.978282 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] creating volume 'volume-f85e748d-fc8b-4622-80a4-3fe73e99b8ef' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:07:37.979300 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:38.099644 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] extra_specs: {} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:07:38.100321 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] extra_specs: {} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:07:38.104711 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2fea19-5247-48e0-a3cb-e799b077bb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f85e748d-fc8b-4622-80a4-3fe73e99b8ef', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:38.110299 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e2c0b5-cdcf-4862-9316-14f2ec1e9546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:07:38.120965 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Volume volume-f85e748d-fc8b-4622-80a4-3fe73e99b8ef (f85e748d-fc8b-4622-80a4-3fe73e99b8ef): created successfully Jan 29 21:07:38.132128 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e2c0b5-cdcf-4862-9316-14f2ec1e9546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:07:38.141690 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Flow 'volume_create_manager' (841176a5-93f4-40d8-a0dd-93639ef3ef58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:07:38.150549 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-3f6e58b9-9a17-4d1c-a68c-29e56d3dc377 tempest-GroupSnapshotsTest-1940853820 None] Created volume successfully. Jan 29 21:07:38.944089 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-98bbfb0c-75c6-49f7-906f-e3093429485e tempest-GroupSnapshotsTest-1940853820 None] GroupSnapshot 1df9665c-9ec2-42b9-90c5-1134d0b12a68: creating. Jan 29 21:07:38.983462 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-98bbfb0c-75c6-49f7-906f-e3093429485e tempest-GroupSnapshotsTest-1940853820 None] Group snapshot 1df9665c-9ec2-42b9-90c5-1134d0b12a68: creating. {{(pid=134283) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4077}} Jan 29 21:07:39.005922 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-98bbfb0c-75c6-49f7-906f-e3093429485e tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:40.034631 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-98bbfb0c-75c6-49f7-906f-e3093429485e tempest-GroupSnapshotsTest-1940853820 None] group_snapshot 1df9665c-9ec2-42b9-90c5-1134d0b12a68: created successfully Jan 29 21:07:41.271598 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-751e140e-60c6-4dc1-9bde-34ad1ec79cd3 tempest-GroupSnapshotsTest-1940853820 None] group_snapshot 1df9665c-9ec2-42b9-90c5-1134d0b12a68: deleting Jan 29 21:07:41.293421 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-751e140e-60c6-4dc1-9bde-34ad1ec79cd3 tempest-GroupSnapshotsTest-1940853820 None] group_snapshot 1df9665c-9ec2-42b9-90c5-1134d0b12a68: deleting {{(pid=134283) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4252}} Jan 29 21:07:41.327632 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-751e140e-60c6-4dc1-9bde-34ad1ec79cd3 tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:42.426403 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-751e140e-60c6-4dc1-9bde-34ad1ec79cd3 tempest-GroupSnapshotsTest-1940853820 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-6075312 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-6075312, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:07:42.428172 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-751e140e-60c6-4dc1-9bde-34ad1ec79cd3 tempest-GroupSnapshotsTest-1940853820 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-6075312 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-6075312, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:07:42.447179 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-751e140e-60c6-4dc1-9bde-34ad1ec79cd3 tempest-GroupSnapshotsTest-1940853820 None] Created reservations ['edaf2372-849a-4684-8804-cf863e46eb08', '2df2944c-336b-47f5-8135-c3026331624b', '4bb2656f-58e0-40bb-a686-a68cb4e4757b', 'c6177f27-18cf-4725-a07d-a915d9bd99cb'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:42.519448 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-751e140e-60c6-4dc1-9bde-34ad1ec79cd3 tempest-GroupSnapshotsTest-1940853820 None] group_snapshot 1df9665c-9ec2-42b9-90c5-1134d0b12a68: deleted successfully Jan 29 21:07:43.823212 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c69bb4f7-9bf7-4737-bee6-07e4e051ec9e tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:43.893564 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c69bb4f7-9bf7-4737-bee6-07e4e051ec9e tempest-GroupSnapshotsTest-1940853820 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:07:43.894135 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c69bb4f7-9bf7-4737-bee6-07e4e051ec9e tempest-GroupSnapshotsTest-1940853820 None] Volume volume-f85e748d-fc8b-4622-80a4-3fe73e99b8ef is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:07:43.900561 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c69bb4f7-9bf7-4737-bee6-07e4e051ec9e tempest-GroupSnapshotsTest-1940853820 None] deleting rbd volume volume-f85e748d-fc8b-4622-80a4-3fe73e99b8ef {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:07:44.205593 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-c69bb4f7-9bf7-4737-bee6-07e4e051ec9e tempest-GroupSnapshotsTest-1940853820 None] Created reservations ['5d4b9c33-3cac-4fc7-88e1-b353023d86ee'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:44.228353 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-c69bb4f7-9bf7-4737-bee6-07e4e051ec9e tempest-GroupSnapshotsTest-1940853820 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-6075312 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-6075312, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:07:44.242675 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-c69bb4f7-9bf7-4737-bee6-07e4e051ec9e tempest-GroupSnapshotsTest-1940853820 None] Created reservations ['29b74cf8-d291-48de-adaf-c0afb9c8ef32', 'cca9d43a-b467-4f7f-a1b6-52009839c893', '5a5b5841-c700-4e83-a7dd-bb3684cd4fbe', '93d064d5-c6d9-40f6-8e62-75093c47e3f5'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:44.316779 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c69bb4f7-9bf7-4737-bee6-07e4e051ec9e tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:44.341277 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c69bb4f7-9bf7-4737-bee6-07e4e051ec9e tempest-GroupSnapshotsTest-1940853820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:44.365397 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-c69bb4f7-9bf7-4737-bee6-07e4e051ec9e tempest-GroupSnapshotsTest-1940853820 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:07:44.369965 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-c69bb4f7-9bf7-4737-bee6-07e4e051ec9e tempest-GroupSnapshotsTest-1940853820 None] Delete group completed successfully. Jan 29 21:07:54.118328 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6f951b6e-83a7-42c8-83e1-baba129843bd tempest-GroupsV320Test-119546830 None] Group tempest-GroupsV320Test-Group-1858367272: creating Jan 29 21:07:54.133937 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6f951b6e-83a7-42c8-83e1-baba129843bd tempest-GroupsV320Test-119546830 None] Group tempest-GroupsV320Test-Group-1858367272: created successfully Jan 29 21:07:54.142968 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6f951b6e-83a7-42c8-83e1-baba129843bd tempest-GroupsV320Test-119546830 None] Create group completed successfully. Jan 29 21:07:55.676320 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-56274250-64d1-4219-adcb-45e39138c43d tempest-GroupsV320Test-119546830 None] Created reservations ['6abb82b5-12c4-4a07-872b-2034384b4e95'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:07:55.713927 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-56274250-64d1-4219-adcb-45e39138c43d tempest-GroupsV320Test-119546830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:55.758256 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-56274250-64d1-4219-adcb-45e39138c43d tempest-GroupsV320Test-119546830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:07:55.818549 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-56274250-64d1-4219-adcb-45e39138c43d tempest-GroupsV320Test-119546830 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:07:55.825801 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-56274250-64d1-4219-adcb-45e39138c43d tempest-GroupsV320Test-119546830 None] Delete group completed successfully. Jan 29 21:08:06.840855 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:08:06.846014 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:08:06.846737 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:08:06.895437 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Flow 'volume_create_manager' (1a7232b1-2fdf-4ddc-8514-20975d4511df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:06.907574 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd5d4b8-a873-4194-ae1f-d02ab71d8882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:06.932324 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:08:06.964136 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd5d4b8-a873-4194-ae1f-d02ab71d8882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-316710650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ee642e4a-50a9-4062-a37e-efca8d8c64d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904eb3d8b17b4287a2df816f86396291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:08:07Z,use_quota=True,user_id='497e2a31cf6a4f84817a22b9a41d48b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:06.977168 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87fc1b1-9a56-43c8-9036-b6f563eaba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:06.983270 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87fc1b1-9a56-43c8-9036-b6f563eaba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:06.996164 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd842a1d-c1e6-46b8-8373-17244f2fa09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:07.013716 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd842a1d-c1e6-46b8-8373-17244f2fa09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee642e4a-50a9-4062-a37e-efca8d8c64d2', 'volume_name': 'volume-ee642e4a-50a9-4062-a37e-efca8d8c64d2', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:07.034249 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69538471-4742-4b27-8eab-beee28111e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:07.044961 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69538471-4742-4b27-8eab-beee28111e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:07.059688 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b01d280c-6569-4062-ae31-6018ceac1023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:07.062421 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Volume ee642e4a-50a9-4062-a37e-efca8d8c64d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee642e4a-50a9-4062-a37e-efca8d8c64d2', 'volume_size': 1} Jan 29 21:08:07.062980 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] creating volume 'volume-ee642e4a-50a9-4062-a37e-efca8d8c64d2' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:08:07.064081 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:07.246879 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:08:07.247530 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:08:07.253037 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b01d280c-6569-4062-ae31-6018ceac1023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee642e4a-50a9-4062-a37e-efca8d8c64d2', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:07.261988 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156335d6-59c2-4d27-bde2-fc2445960d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:07.282913 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Volume volume-ee642e4a-50a9-4062-a37e-efca8d8c64d2 (ee642e4a-50a9-4062-a37e-efca8d8c64d2): created successfully Jan 29 21:08:07.287439 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156335d6-59c2-4d27-bde2-fc2445960d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:07.300292 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Flow 'volume_create_manager' (1a7232b1-2fdf-4ddc-8514-20975d4511df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:07.319717 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-025a165e-8e2b-4e84-ad5d-c39e3cdbc6d1 tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Created volume successfully. Jan 29 21:08:08.769144 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-2c2dc994-4786-4153-88d6-74c3f4c30c1c req-0bb0050d-4c42-4c3f-a25b-26461e6e21c4 tempest-TaggedBootDevicesTest_v242-78673303 None] Terminate volume connection completed successfully. Jan 29 21:08:08.769757 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-2c2dc994-4786-4153-88d6-74c3f4c30c1c req-0bb0050d-4c42-4c3f-a25b-26461e6e21c4 tempest-TaggedBootDevicesTest_v242-78673303 None] Deleting attachment bb9ba474-0643-4590-a7a6-63d36229b7c2. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:08:09.027025 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-2c2dc994-4786-4153-88d6-74c3f4c30c1c req-6a0eff54-4b73-4a2b-9da2-775ad00e5224 tempest-TaggedBootDevicesTest_v242-78673303 None] Terminate volume connection completed successfully. Jan 29 21:08:09.027740 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-2c2dc994-4786-4153-88d6-74c3f4c30c1c req-6a0eff54-4b73-4a2b-9da2-775ad00e5224 tempest-TaggedBootDevicesTest_v242-78673303 None] Deleting attachment 6285af40-9ef5-478e-866a-5541bcf8b223. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:08:09.213231 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-4aba4de9-a568-4762-a0ad-a71e653e50da tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Lock "b'cinder-ee642e4a-50a9-4062-a37e-efca8d8c64d2-delete_volume'" acquired by "delete_volume" :: waited 0.069s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:08:09.417089 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4aba4de9-a568-4762-a0ad-a71e653e50da tempest-VolumeQuotasNegativeTestJSON-1639397636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:09.504372 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4aba4de9-a568-4762-a0ad-a71e653e50da tempest-VolumeQuotasNegativeTestJSON-1639397636 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:08:09.505094 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4aba4de9-a568-4762-a0ad-a71e653e50da tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Volume volume-ee642e4a-50a9-4062-a37e-efca8d8c64d2 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:08:09.520743 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4aba4de9-a568-4762-a0ad-a71e653e50da tempest-VolumeQuotasNegativeTestJSON-1639397636 None] deleting rbd volume volume-ee642e4a-50a9-4062-a37e-efca8d8c64d2 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:08:09.523565 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-2c2dc994-4786-4153-88d6-74c3f4c30c1c req-674efe84-f4b2-42f4-bc09-9de54436c43d tempest-TaggedBootDevicesTest_v242-78673303 None] Terminate volume connection completed successfully. Jan 29 21:08:09.525289 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-2c2dc994-4786-4153-88d6-74c3f4c30c1c req-674efe84-f4b2-42f4-bc09-9de54436c43d tempest-TaggedBootDevicesTest_v242-78673303 None] Deleting attachment 53377e33-cee4-4064-b4dd-42b49e40f1e5. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:08:09.936822 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-4aba4de9-a568-4762-a0ad-a71e653e50da tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Created reservations ['b1d2bd78-3da7-4e34-8c4a-200e25dd938e', '57de9158-307a-4447-a698-0634d1788c4b', '06ad211a-abfc-4b1c-a365-da55a992ba30', 'fab9eb0f-afac-419b-ae78-c8c03114285c'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:08:10.001772 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4aba4de9-a568-4762-a0ad-a71e653e50da tempest-VolumeQuotasNegativeTestJSON-1639397636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:10.087837 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4aba4de9-a568-4762-a0ad-a71e653e50da tempest-VolumeQuotasNegativeTestJSON-1639397636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:10.142358 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-4aba4de9-a568-4762-a0ad-a71e653e50da tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:08:10.158359 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4aba4de9-a568-4762-a0ad-a71e653e50da tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Deleted volume successfully. Jan 29 21:08:10.177330 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-4aba4de9-a568-4762-a0ad-a71e653e50da tempest-VolumeQuotasNegativeTestJSON-1639397636 None] Lock "b'cinder-ee642e4a-50a9-4062-a37e-efca8d8c64d2-delete_volume'" released by "delete_volume" :: held 0.964s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:08:15.436450 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:08:15.443048 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:08:15.443514 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:08:15.473761 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Flow 'volume_create_manager' (e2d75006-a423-4c64-93d3-c7ac56d3e620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:15.500753 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42e1294-40db-42ee-b02c-a50b2de57124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:15.515052 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:08:15.565342 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42e1294-40db-42ee-b02c-a50b2de57124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-731093665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2fe60dc4-3604-43a1-8bb2-f1289e7d80ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3203d136588245c48e54c6be202d0ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:08:15Z,use_quota=True,user_id='a669f4b5436d4923bcbf275c3a822a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:15.585619 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b46b395-79b2-44ba-b0b3-ac6e65ec7a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:15.595803 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b46b395-79b2-44ba-b0b3-ac6e65ec7a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:15.602608 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db85c5d0-d355-4e75-906a-3048860367e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:15.608036 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db85c5d0-d355-4e75-906a-3048860367e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fe60dc4-3604-43a1-8bb2-f1289e7d80ab', 'volume_name': 'volume-2fe60dc4-3604-43a1-8bb2-f1289e7d80ab', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:15.615817 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508bfc7e-9376-4b3e-a17e-fd18f4bcf295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:15.621378 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508bfc7e-9376-4b3e-a17e-fd18f4bcf295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:15.628496 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cddcdd-c729-4754-8759-3cf0ab461014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:15.629984 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Volume 2fe60dc4-3604-43a1-8bb2-f1289e7d80ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fe60dc4-3604-43a1-8bb2-f1289e7d80ab', 'volume_size': 1} Jan 29 21:08:15.630954 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] creating volume 'volume-2fe60dc4-3604-43a1-8bb2-f1289e7d80ab' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:08:15.632805 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:15.782367 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:08:15.783054 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:08:15.788269 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cddcdd-c729-4754-8759-3cf0ab461014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fe60dc4-3604-43a1-8bb2-f1289e7d80ab', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:15.795032 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf25c1cc-be86-4aed-84ff-b30ae73d3d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:15.807028 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Volume volume-2fe60dc4-3604-43a1-8bb2-f1289e7d80ab (2fe60dc4-3604-43a1-8bb2-f1289e7d80ab): created successfully Jan 29 21:08:15.811483 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf25c1cc-be86-4aed-84ff-b30ae73d3d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:15.820352 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Flow 'volume_create_manager' (e2d75006-a423-4c64-93d3-c7ac56d3e620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:15.833986 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-eb2112a2-3a66-42a3-93df-91e607443c11 tempest-VolumesServicesTestJSON-709478525 None] Created volume successfully. Jan 29 21:08:16.517227 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-f250dde2-2bf9-462b-85e2-785810075989 tempest-VolumesServicesTestJSON-709478525 None] Lock "b'cinder-2fe60dc4-3604-43a1-8bb2-f1289e7d80ab-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:08:16.578191 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f250dde2-2bf9-462b-85e2-785810075989 tempest-VolumesServicesTestJSON-709478525 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:16.672655 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f250dde2-2bf9-462b-85e2-785810075989 tempest-VolumesServicesTestJSON-709478525 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:08:16.673447 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f250dde2-2bf9-462b-85e2-785810075989 tempest-VolumesServicesTestJSON-709478525 None] Volume volume-2fe60dc4-3604-43a1-8bb2-f1289e7d80ab is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:08:16.684371 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f250dde2-2bf9-462b-85e2-785810075989 tempest-VolumesServicesTestJSON-709478525 None] deleting rbd volume volume-2fe60dc4-3604-43a1-8bb2-f1289e7d80ab {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:08:17.128164 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-f250dde2-2bf9-462b-85e2-785810075989 tempest-VolumesServicesTestJSON-709478525 None] Created reservations ['8d458548-7745-415f-9ecb-0aa9249e3a46', '530d12ce-501a-417d-b8ce-df4fcc7018ff', 'b5948979-f08b-4e95-8ded-9b069a72702d', '54020a34-edf6-48ff-9fbd-16a4a3cb3cfd'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:08:17.209292 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-024eccc8-95ec-40db-bb48-6163bdbdc654 tempest-TaggedBootDevicesTest_v242-78673303 None] Lock "b'cinder-d9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:08:17.275533 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f250dde2-2bf9-462b-85e2-785810075989 tempest-VolumesServicesTestJSON-709478525 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:17.318621 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f250dde2-2bf9-462b-85e2-785810075989 tempest-VolumesServicesTestJSON-709478525 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:17.370436 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-f250dde2-2bf9-462b-85e2-785810075989 tempest-VolumesServicesTestJSON-709478525 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:08:17.376759 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f250dde2-2bf9-462b-85e2-785810075989 tempest-VolumesServicesTestJSON-709478525 None] Deleted volume successfully. Jan 29 21:08:17.383621 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-024eccc8-95ec-40db-bb48-6163bdbdc654 tempest-TaggedBootDevicesTest_v242-78673303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:17.450179 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-024eccc8-95ec-40db-bb48-6163bdbdc654 tempest-TaggedBootDevicesTest_v242-78673303 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:08:17.450555 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-024eccc8-95ec-40db-bb48-6163bdbdc654 tempest-TaggedBootDevicesTest_v242-78673303 None] Volume volume-d9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:08:17.458076 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-024eccc8-95ec-40db-bb48-6163bdbdc654 tempest-TaggedBootDevicesTest_v242-78673303 None] deleting rbd volume volume-d9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:08:17.471436 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-f250dde2-2bf9-462b-85e2-785810075989 tempest-VolumesServicesTestJSON-709478525 None] Lock "b'cinder-2fe60dc4-3604-43a1-8bb2-f1289e7d80ab-delete_volume'" released by "delete_volume" :: held 0.954s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:08:17.752267 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-024eccc8-95ec-40db-bb48-6163bdbdc654 tempest-TaggedBootDevicesTest_v242-78673303 None] Created reservations ['c687865d-ed3f-433f-b403-65263d20373b', 'cbd931e7-979e-4060-a65d-fd0841c574b4', '83d39111-8871-455c-9c9e-020882a106f1', '64fb07e9-4533-4251-a92f-12b9e55b6dc4'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:08:17.805239 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-024eccc8-95ec-40db-bb48-6163bdbdc654 tempest-TaggedBootDevicesTest_v242-78673303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:17.893542 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-024eccc8-95ec-40db-bb48-6163bdbdc654 tempest-TaggedBootDevicesTest_v242-78673303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:17.974849 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-024eccc8-95ec-40db-bb48-6163bdbdc654 tempest-TaggedBootDevicesTest_v242-78673303 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:08:17.980667 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-024eccc8-95ec-40db-bb48-6163bdbdc654 tempest-TaggedBootDevicesTest_v242-78673303 None] Deleted volume successfully. Jan 29 21:08:17.997334 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-024eccc8-95ec-40db-bb48-6163bdbdc654 tempest-TaggedBootDevicesTest_v242-78673303 None] Lock "b'cinder-d9f072c6-7ed5-4a6f-9593-aa78ff5f5fd7-delete_volume'" released by "delete_volume" :: held 0.793s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:08:18.397791 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e4d14813-2fca-4dc9-ae73-1395b6146f13 tempest-TaggedBootDevicesTest_v242-78673303 None] Lock "b'cinder-7d9d3c11-4660-4244-b3d4-a3012eff5793-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:08:18.481563 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e4d14813-2fca-4dc9-ae73-1395b6146f13 tempest-TaggedBootDevicesTest_v242-78673303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:18.575184 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e4d14813-2fca-4dc9-ae73-1395b6146f13 tempest-TaggedBootDevicesTest_v242-78673303 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:08:18.576050 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e4d14813-2fca-4dc9-ae73-1395b6146f13 tempest-TaggedBootDevicesTest_v242-78673303 None] Volume volume-7d9d3c11-4660-4244-b3d4-a3012eff5793 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:08:18.595124 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e4d14813-2fca-4dc9-ae73-1395b6146f13 tempest-TaggedBootDevicesTest_v242-78673303 None] deleting rbd volume volume-7d9d3c11-4660-4244-b3d4-a3012eff5793 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:08:19.020441 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-e4d14813-2fca-4dc9-ae73-1395b6146f13 tempest-TaggedBootDevicesTest_v242-78673303 None] Created reservations ['59ddb35a-a9d3-4944-8904-b4a357698c0e', 'a387617e-5226-4f20-8c56-096d18b433d9', 'a669eee7-8ee6-4ff5-9938-c1232d60ac71', 'c778173f-01fb-45e6-8b18-979aa4f1f900'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:08:19.096740 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e4d14813-2fca-4dc9-ae73-1395b6146f13 tempest-TaggedBootDevicesTest_v242-78673303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:19.147098 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e4d14813-2fca-4dc9-ae73-1395b6146f13 tempest-TaggedBootDevicesTest_v242-78673303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:19.200287 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e4d14813-2fca-4dc9-ae73-1395b6146f13 tempest-TaggedBootDevicesTest_v242-78673303 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:08:19.213580 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e4d14813-2fca-4dc9-ae73-1395b6146f13 tempest-TaggedBootDevicesTest_v242-78673303 None] Deleted volume successfully. Jan 29 21:08:19.232865 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e4d14813-2fca-4dc9-ae73-1395b6146f13 tempest-TaggedBootDevicesTest_v242-78673303 None] Lock "b'cinder-7d9d3c11-4660-4244-b3d4-a3012eff5793-delete_volume'" released by "delete_volume" :: held 0.835s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:08:19.597640 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-7b605e77-d602-495b-ad30-0c87595b79c5 tempest-TaggedBootDevicesTest_v242-78673303 None] Lock "b'cinder-f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:08:19.662543 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7b605e77-d602-495b-ad30-0c87595b79c5 tempest-TaggedBootDevicesTest_v242-78673303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:19.787415 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7b605e77-d602-495b-ad30-0c87595b79c5 tempest-TaggedBootDevicesTest_v242-78673303 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:08:19.794224 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7b605e77-d602-495b-ad30-0c87595b79c5 tempest-TaggedBootDevicesTest_v242-78673303 None] deleting rbd volume volume-f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:08:20.130028 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7b605e77-d602-495b-ad30-0c87595b79c5 tempest-TaggedBootDevicesTest_v242-78673303 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 21:08:20.170985 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7b605e77-d602-495b-ad30-0c87595b79c5 tempest-TaggedBootDevicesTest_v242-78673303 None] deleting parent snapshot volume-f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 21:08:20.896150 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-7b605e77-d602-495b-ad30-0c87595b79c5 tempest-TaggedBootDevicesTest_v242-78673303 None] Created reservations ['d954a83e-c87c-401e-a9d8-6ca06b743a97', '29528665-c764-4637-8592-80db7ccd9508', 'd3912948-ee44-428e-bb23-cf5f8f05dfb2', '0e366778-ab09-47d4-bca3-413134c5967f'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:08:21.018497 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7b605e77-d602-495b-ad30-0c87595b79c5 tempest-TaggedBootDevicesTest_v242-78673303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:21.089031 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7b605e77-d602-495b-ad30-0c87595b79c5 tempest-TaggedBootDevicesTest_v242-78673303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:21.163892 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-7b605e77-d602-495b-ad30-0c87595b79c5 tempest-TaggedBootDevicesTest_v242-78673303 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:08:21.169107 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-7b605e77-d602-495b-ad30-0c87595b79c5 tempest-TaggedBootDevicesTest_v242-78673303 None] Deleted volume successfully. Jan 29 21:08:21.189838 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-7b605e77-d602-495b-ad30-0c87595b79c5 tempest-TaggedBootDevicesTest_v242-78673303 None] Lock "b'cinder-f5f2be31-af6f-4dcf-aba6-5f0e7ea19aa1-delete_volume'" released by "delete_volume" :: held 1.592s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:08:22.315314 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:08:22.319413 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:08:22.319852 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:08:22.349615 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Flow 'volume_create_manager' (c9b91f31-366b-41ab-8da3-122aa5e90352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:22.356434 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c55bbea-354e-44ab-bfa5-60abade609ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:22.383419 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:08:22.423618 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c55bbea-354e-44ab-bfa5-60abade609ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-564735649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=70c52bd5-04a4-4c93-bb18-2841cfbd7c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641efd3109984ef5af0709d78fd0d77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:08:22Z,use_quota=True,user_id='d66dd7c144b447799f149c9963af5452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:22.432843 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e568e109-0be2-4b33-8d50-9633547b5530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:22.442202 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e568e109-0be2-4b33-8d50-9633547b5530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:22.448576 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e367fcdc-c625-460e-8816-a657b703dc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:22.454438 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e367fcdc-c625-460e-8816-a657b703dc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c52bd5-04a4-4c93-bb18-2841cfbd7c66', 'volume_name': 'volume-70c52bd5-04a4-4c93-bb18-2841cfbd7c66', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:22.462590 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be01ec29-a495-4a52-abaa-0314a7d5212c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:22.466917 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be01ec29-a495-4a52-abaa-0314a7d5212c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:22.473067 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162f031f-0d17-4711-999e-95776584d74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:22.474268 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Volume 70c52bd5-04a4-4c93-bb18-2841cfbd7c66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c52bd5-04a4-4c93-bb18-2841cfbd7c66', 'volume_size': 1} Jan 29 21:08:22.474751 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] creating volume 'volume-70c52bd5-04a4-4c93-bb18-2841cfbd7c66' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:08:22.475893 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:22.556317 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:08:22.556848 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:08:22.562358 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162f031f-0d17-4711-999e-95776584d74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c52bd5-04a4-4c93-bb18-2841cfbd7c66', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:22.567845 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d451e522-79aa-4a8f-b7f7-9101eed6006e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:22.584562 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Volume volume-70c52bd5-04a4-4c93-bb18-2841cfbd7c66 (70c52bd5-04a4-4c93-bb18-2841cfbd7c66): created successfully Jan 29 21:08:22.590289 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d451e522-79aa-4a8f-b7f7-9101eed6006e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:22.597771 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Flow 'volume_create_manager' (c9b91f31-366b-41ab-8da3-122aa5e90352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:22.611157 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-643be168-588e-437a-ba3a-19c80f1908e0 tempest-VolumesListAdminTestJSON-2013815007 None] Created volume successfully. Jan 29 21:08:23.837345 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:08:23.840784 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:08:23.841461 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:08:23.861127 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Flow 'volume_create_manager' (b7106ee7-60d1-434e-91df-ae97705c9408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:23.868515 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0bc063-369d-4ec6-8251-32ce2e980339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:23.876186 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:08:23.892532 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0bc063-369d-4ec6-8251-32ce2e980339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2106543468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1296fa8c-3439-4a8b-9a2d-73ccfaccf08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641efd3109984ef5af0709d78fd0d77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:08:24Z,use_quota=True,user_id='d66dd7c144b447799f149c9963af5452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:23.898520 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5f100d-2a14-431c-97db-d24233b98e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:23.903017 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5f100d-2a14-431c-97db-d24233b98e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:23.908598 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0dcf36-6af3-4162-8f56-dcba367a1fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:23.913123 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0dcf36-6af3-4162-8f56-dcba367a1fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1296fa8c-3439-4a8b-9a2d-73ccfaccf08c', 'volume_name': 'volume-1296fa8c-3439-4a8b-9a2d-73ccfaccf08c', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:23.918483 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42111692-0438-4d27-9996-1ab355d65b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:23.922821 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42111692-0438-4d27-9996-1ab355d65b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:23.929009 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee6f0e6-f1b7-4dcb-9062-b721455b2daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:23.930308 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Volume 1296fa8c-3439-4a8b-9a2d-73ccfaccf08c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1296fa8c-3439-4a8b-9a2d-73ccfaccf08c', 'volume_size': 1} Jan 29 21:08:23.930876 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] creating volume 'volume-1296fa8c-3439-4a8b-9a2d-73ccfaccf08c' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:08:23.932085 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:24.008017 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:08:24.008638 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:08:24.012544 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee6f0e6-f1b7-4dcb-9062-b721455b2daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1296fa8c-3439-4a8b-9a2d-73ccfaccf08c', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:24.018350 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6974dfc-8002-4a85-92ec-566bb7d94197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:24.027270 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Volume volume-1296fa8c-3439-4a8b-9a2d-73ccfaccf08c (1296fa8c-3439-4a8b-9a2d-73ccfaccf08c): created successfully Jan 29 21:08:24.031152 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6974dfc-8002-4a85-92ec-566bb7d94197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:24.037252 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Flow 'volume_create_manager' (b7106ee7-60d1-434e-91df-ae97705c9408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:24.045153 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-07980c80-9c05-4c51-ad28-979ace891128 tempest-VolumesListAdminTestJSON-2013815007 None] Created volume successfully. Jan 29 21:08:25.499207 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:08:25.502615 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:08:25.503170 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:08:25.524159 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Flow 'volume_create_manager' (0ad7324f-1ebc-4445-ae48-c89de2699d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:25.531463 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37aa4d2c-89ff-43fe-bf76-fc3ff7cd04f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:25.538410 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:08:25.553361 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37aa4d2c-89ff-43fe-bf76-fc3ff7cd04f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1827759348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dd9be930-e656-43ee-ad3b-16210c5e6d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641efd3109984ef5af0709d78fd0d77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:08:25Z,use_quota=True,user_id='d66dd7c144b447799f149c9963af5452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:25.559452 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd24551-d028-48d7-b3ea-971b6a3e7e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:25.564537 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd24551-d028-48d7-b3ea-971b6a3e7e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:25.569840 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6371708-8e93-417a-b7d1-b7815df169c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:25.574206 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6371708-8e93-417a-b7d1-b7815df169c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd9be930-e656-43ee-ad3b-16210c5e6d41', 'volume_name': 'volume-dd9be930-e656-43ee-ad3b-16210c5e6d41', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:25.579932 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03e504b-a558-4d03-af78-396587558672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:25.584110 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03e504b-a558-4d03-af78-396587558672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:25.589194 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8542d8d-eb4b-428e-b811-2ea01476f47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:25.590448 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Volume dd9be930-e656-43ee-ad3b-16210c5e6d41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd9be930-e656-43ee-ad3b-16210c5e6d41', 'volume_size': 1} Jan 29 21:08:25.590879 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] creating volume 'volume-dd9be930-e656-43ee-ad3b-16210c5e6d41' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:08:25.592035 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:25.684831 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:08:25.685662 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:08:25.690648 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8542d8d-eb4b-428e-b811-2ea01476f47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd9be930-e656-43ee-ad3b-16210c5e6d41', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:25.697756 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76366943-2a08-454a-a6ed-225609b6a223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:25.708350 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Volume volume-dd9be930-e656-43ee-ad3b-16210c5e6d41 (dd9be930-e656-43ee-ad3b-16210c5e6d41): created successfully Jan 29 21:08:25.718747 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76366943-2a08-454a-a6ed-225609b6a223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:25.727142 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Flow 'volume_create_manager' (0ad7324f-1ebc-4445-ae48-c89de2699d4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:25.740553 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9c4e34c8-94e3-40f7-8ab5-b55895645dd8 tempest-VolumesListAdminTestJSON-2013815007 None] Created volume successfully. Jan 29 21:08:27.353804 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:08:27.362652 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:08:27.363287 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:08:27.388885 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Flow 'volume_create_manager' (62e714fc-1d57-4868-a4cf-13960d7201a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:27.397793 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c377784c-4040-4c9d-adb8-d90aa4d97ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:27.428341 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:08:27.452329 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c377784c-4040-4c9d-adb8-d90aa4d97ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7e831b54-2429-4534-893f-8a3edd1e344d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53bc04ecd3c94cd38f925425d7eba4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:08:27Z,use_quota=True,user_id='87763472774e481685dd8a1676dd52af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:27.462843 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79df6f4-0892-4a9a-a01a-bff0db62d3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:27.473686 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79df6f4-0892-4a9a-a01a-bff0db62d3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:27.479434 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a98667-0b31-441d-9fbb-e2e47dbf5301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:27.484590 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a98667-0b31-441d-9fbb-e2e47dbf5301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e831b54-2429-4534-893f-8a3edd1e344d', 'volume_name': 'volume-7e831b54-2429-4534-893f-8a3edd1e344d', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:27.498124 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562a420a-14b6-4029-9e55-d7685423bfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:27.503619 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562a420a-14b6-4029-9e55-d7685423bfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:27.508816 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f546882f-3da4-4ca7-86f5-3816daa03cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:27.509969 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Volume 7e831b54-2429-4534-893f-8a3edd1e344d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e831b54-2429-4534-893f-8a3edd1e344d', 'volume_size': 1} Jan 29 21:08:27.510364 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] creating volume 'volume-7e831b54-2429-4534-893f-8a3edd1e344d' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:08:27.511366 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:27.614577 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:08:27.615020 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:08:27.618731 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f546882f-3da4-4ca7-86f5-3816daa03cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e831b54-2429-4534-893f-8a3edd1e344d', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:27.623324 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27972b0-dcb2-4b29-bd14-4f6a833052c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:27.633205 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Volume volume-7e831b54-2429-4534-893f-8a3edd1e344d (7e831b54-2429-4534-893f-8a3edd1e344d): created successfully Jan 29 21:08:27.637239 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27972b0-dcb2-4b29-bd14-4f6a833052c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:27.643020 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Flow 'volume_create_manager' (62e714fc-1d57-4868-a4cf-13960d7201a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:27.653861 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-8d41eb12-70ab-49cf-9d9d-43612c532588 tempest-VolumesListAdminTestJSON-1581328317 None] Created volume successfully. Jan 29 21:08:28.427847 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e6275578-fd1d-408d-9a75-39906d32874e tempest-VolumesListAdminTestJSON-1581328317 None] Lock "b'cinder-7e831b54-2429-4534-893f-8a3edd1e344d-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:08:28.460904 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e6275578-fd1d-408d-9a75-39906d32874e tempest-VolumesListAdminTestJSON-1581328317 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:28.531140 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e6275578-fd1d-408d-9a75-39906d32874e tempest-VolumesListAdminTestJSON-1581328317 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:08:28.531771 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e6275578-fd1d-408d-9a75-39906d32874e tempest-VolumesListAdminTestJSON-1581328317 None] Volume volume-7e831b54-2429-4534-893f-8a3edd1e344d is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:08:28.539448 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e6275578-fd1d-408d-9a75-39906d32874e tempest-VolumesListAdminTestJSON-1581328317 None] deleting rbd volume volume-7e831b54-2429-4534-893f-8a3edd1e344d {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:08:28.553977 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-0b2fa950-aff2-4bc1-a27d-90d2758faa02 tempest-VolumesListAdminTestJSON-2013815007 None] Lock "b'cinder-dd9be930-e656-43ee-ad3b-16210c5e6d41-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:08:28.615943 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0b2fa950-aff2-4bc1-a27d-90d2758faa02 tempest-VolumesListAdminTestJSON-2013815007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:28.694311 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0b2fa950-aff2-4bc1-a27d-90d2758faa02 tempest-VolumesListAdminTestJSON-2013815007 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:08:28.694762 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0b2fa950-aff2-4bc1-a27d-90d2758faa02 tempest-VolumesListAdminTestJSON-2013815007 None] Volume volume-dd9be930-e656-43ee-ad3b-16210c5e6d41 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:08:28.706320 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0b2fa950-aff2-4bc1-a27d-90d2758faa02 tempest-VolumesListAdminTestJSON-2013815007 None] deleting rbd volume volume-dd9be930-e656-43ee-ad3b-16210c5e6d41 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:08:28.707937 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:08:28.710293 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:28.762221 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:28.824979 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:08:28.942071 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-e6275578-fd1d-408d-9a75-39906d32874e tempest-VolumesListAdminTestJSON-1581328317 None] Created reservations ['daa81864-8293-4c1e-a2f6-aace1c1436af', '133a3ff3-4fed-4c03-a6f9-5c46a313c911', '44050545-9417-4799-97d6-38e88af8e062', '03a41bd5-b606-43a6-9faa-12b6de5f3c5f'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:08:29.022212 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e6275578-fd1d-408d-9a75-39906d32874e tempest-VolumesListAdminTestJSON-1581328317 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:29.060195 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e6275578-fd1d-408d-9a75-39906d32874e tempest-VolumesListAdminTestJSON-1581328317 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:29.108830 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e6275578-fd1d-408d-9a75-39906d32874e tempest-VolumesListAdminTestJSON-1581328317 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:08:29.126553 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e6275578-fd1d-408d-9a75-39906d32874e tempest-VolumesListAdminTestJSON-1581328317 None] Deleted volume successfully. Jan 29 21:08:29.140783 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-0b2fa950-aff2-4bc1-a27d-90d2758faa02 tempest-VolumesListAdminTestJSON-2013815007 None] Created reservations ['aa97fb2e-122c-4b9a-8696-76808d778b2c', 'a73433cb-e05d-4ffb-be49-cd78891e2569', '97b0cc91-4cbb-4a1b-8342-01bb77fc4436', '1a65603e-bdc9-4ad4-8ff2-8096091ac9cf'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:08:29.148384 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e6275578-fd1d-408d-9a75-39906d32874e tempest-VolumesListAdminTestJSON-1581328317 None] Lock "b'cinder-7e831b54-2429-4534-893f-8a3edd1e344d-delete_volume'" released by "delete_volume" :: held 0.720s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:08:29.203351 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0b2fa950-aff2-4bc1-a27d-90d2758faa02 tempest-VolumesListAdminTestJSON-2013815007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:29.260852 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0b2fa950-aff2-4bc1-a27d-90d2758faa02 tempest-VolumesListAdminTestJSON-2013815007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:29.311411 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-0b2fa950-aff2-4bc1-a27d-90d2758faa02 tempest-VolumesListAdminTestJSON-2013815007 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:08:29.315769 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-0b2fa950-aff2-4bc1-a27d-90d2758faa02 tempest-VolumesListAdminTestJSON-2013815007 None] Deleted volume successfully. Jan 29 21:08:29.332456 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-0b2fa950-aff2-4bc1-a27d-90d2758faa02 tempest-VolumesListAdminTestJSON-2013815007 None] Lock "b'cinder-dd9be930-e656-43ee-ad3b-16210c5e6d41-delete_volume'" released by "delete_volume" :: held 0.778s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:08:29.692284 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e3384295-6c2a-41a0-9f23-1be9ae5944ae tempest-VolumesListAdminTestJSON-2013815007 None] Lock "b'cinder-1296fa8c-3439-4a8b-9a2d-73ccfaccf08c-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:08:29.765581 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e3384295-6c2a-41a0-9f23-1be9ae5944ae tempest-VolumesListAdminTestJSON-2013815007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:29.832445 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e3384295-6c2a-41a0-9f23-1be9ae5944ae tempest-VolumesListAdminTestJSON-2013815007 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:08:29.833002 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e3384295-6c2a-41a0-9f23-1be9ae5944ae tempest-VolumesListAdminTestJSON-2013815007 None] Volume volume-1296fa8c-3439-4a8b-9a2d-73ccfaccf08c is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:08:29.841764 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e3384295-6c2a-41a0-9f23-1be9ae5944ae tempest-VolumesListAdminTestJSON-2013815007 None] deleting rbd volume volume-1296fa8c-3439-4a8b-9a2d-73ccfaccf08c {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:08:30.199735 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-e3384295-6c2a-41a0-9f23-1be9ae5944ae tempest-VolumesListAdminTestJSON-2013815007 None] Created reservations ['140c69c4-dd3b-48e5-9550-c661aa844ecf', '5c5564e9-5d31-48b2-9588-7a3a56c4ad91', 'a1f7da2e-ed1c-481f-859f-86785c4827de', '6956d312-0f54-4c24-83c6-4b7b071976ed'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:08:30.264110 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e3384295-6c2a-41a0-9f23-1be9ae5944ae tempest-VolumesListAdminTestJSON-2013815007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:30.306555 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e3384295-6c2a-41a0-9f23-1be9ae5944ae tempest-VolumesListAdminTestJSON-2013815007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:30.356246 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e3384295-6c2a-41a0-9f23-1be9ae5944ae tempest-VolumesListAdminTestJSON-2013815007 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:08:30.360829 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e3384295-6c2a-41a0-9f23-1be9ae5944ae tempest-VolumesListAdminTestJSON-2013815007 None] Deleted volume successfully. Jan 29 21:08:30.376578 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e3384295-6c2a-41a0-9f23-1be9ae5944ae tempest-VolumesListAdminTestJSON-2013815007 None] Lock "b'cinder-1296fa8c-3439-4a8b-9a2d-73ccfaccf08c-delete_volume'" released by "delete_volume" :: held 0.685s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:08:30.896310 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-c075106b-1039-495b-bff8-dc10720db79f tempest-VolumesListAdminTestJSON-2013815007 None] Lock "b'cinder-70c52bd5-04a4-4c93-bb18-2841cfbd7c66-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:08:30.968042 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c075106b-1039-495b-bff8-dc10720db79f tempest-VolumesListAdminTestJSON-2013815007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:31.039303 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c075106b-1039-495b-bff8-dc10720db79f tempest-VolumesListAdminTestJSON-2013815007 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:08:31.040085 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c075106b-1039-495b-bff8-dc10720db79f tempest-VolumesListAdminTestJSON-2013815007 None] Volume volume-70c52bd5-04a4-4c93-bb18-2841cfbd7c66 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:08:31.054163 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c075106b-1039-495b-bff8-dc10720db79f tempest-VolumesListAdminTestJSON-2013815007 None] deleting rbd volume volume-70c52bd5-04a4-4c93-bb18-2841cfbd7c66 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:08:31.335710 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-c075106b-1039-495b-bff8-dc10720db79f tempest-VolumesListAdminTestJSON-2013815007 None] Created reservations ['7583a262-2498-4d5f-9cee-102f1628054a', '67a33d83-9cd5-42b1-a975-a24a2be0aaeb', '73938e76-460f-4954-acb4-334a97529d03', 'ef437e4a-c063-4177-ab18-3b56e894bef5'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:08:31.397308 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c075106b-1039-495b-bff8-dc10720db79f tempest-VolumesListAdminTestJSON-2013815007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:31.466962 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c075106b-1039-495b-bff8-dc10720db79f tempest-VolumesListAdminTestJSON-2013815007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:31.517713 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-c075106b-1039-495b-bff8-dc10720db79f tempest-VolumesListAdminTestJSON-2013815007 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:08:31.522471 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-c075106b-1039-495b-bff8-dc10720db79f tempest-VolumesListAdminTestJSON-2013815007 None] Deleted volume successfully. Jan 29 21:08:31.537058 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-c075106b-1039-495b-bff8-dc10720db79f tempest-VolumesListAdminTestJSON-2013815007 None] Lock "b'cinder-70c52bd5-04a4-4c93-bb18-2841cfbd7c66-delete_volume'" released by "delete_volume" :: held 0.641s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:08:36.454837 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:08:36.458790 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:08:36.459423 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:08:36.479785 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Flow 'volume_create_manager' (a51f6133-3080-41ad-90c8-4462538044b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:36.487211 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e6c036-ccd8-4d17-b42e-4675b2b41ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:36.494127 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:08:36.514449 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e6c036-ccd8-4d17-b42e-4675b2b41ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-406629184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1d26f24f-33fd-434b-b5d7-2adeead924cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa82328cfae42968bc9512c5a9b88a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:08:36Z,use_quota=True,user_id='132af397adae46c7a5ee29939c4c301e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:36.521416 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7492060-8a6d-4eb0-82da-192b6ebc22cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:36.526227 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7492060-8a6d-4eb0-82da-192b6ebc22cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:36.532613 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c2e478-3fd9-4ff1-9dcb-0bfd12beba56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:36.537579 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c2e478-3fd9-4ff1-9dcb-0bfd12beba56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d26f24f-33fd-434b-b5d7-2adeead924cc', 'volume_name': 'volume-1d26f24f-33fd-434b-b5d7-2adeead924cc', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:36.543558 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48366c1c-b6dd-44a3-9452-3893ffbb0cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:36.549631 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48366c1c-b6dd-44a3-9452-3893ffbb0cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:36.555103 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dee9021-f3b7-4797-b854-508bc5ebe5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:36.556398 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Volume 1d26f24f-33fd-434b-b5d7-2adeead924cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d26f24f-33fd-434b-b5d7-2adeead924cc', 'volume_size': 1} Jan 29 21:08:36.556949 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] creating volume 'volume-1d26f24f-33fd-434b-b5d7-2adeead924cc' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:08:36.558128 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:36.674417 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:08:36.675034 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:08:36.680330 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dee9021-f3b7-4797-b854-508bc5ebe5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d26f24f-33fd-434b-b5d7-2adeead924cc', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:36.686394 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ce2634-e8c2-40ee-b6d5-c1613117c310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:36.697756 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Volume volume-1d26f24f-33fd-434b-b5d7-2adeead924cc (1d26f24f-33fd-434b-b5d7-2adeead924cc): created successfully Jan 29 21:08:36.701659 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ce2634-e8c2-40ee-b6d5-c1613117c310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:36.714623 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Flow 'volume_create_manager' (a51f6133-3080-41ad-90c8-4462538044b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:36.726725 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-c848c6ee-582f-4245-bce3-468f25f736b4 tempest-SnapshotMetadataTestJSON-1969036081 None] Created volume successfully. Jan 29 21:08:37.787103 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7cabc201-75f5-40b4-aa86-b0f27ce1efc2 tempest-SnapshotMetadataTestJSON-1969036081 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:38.823699 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-7cabc201-75f5-40b4-aa86-b0f27ce1efc2 tempest-SnapshotMetadataTestJSON-1969036081 None] Create snapshot completed successfully Jan 29 21:08:41.102370 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-b6af1115-58df-4958-b21f-ce04ae4cbd3c tempest-SnapshotMetadataTestJSON-1969036081 None] Lock "b'cinder-1381ac96-c982-4353-b839-95e79cf11485-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:08:41.114714 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b6af1115-58df-4958-b21f-ce04ae4cbd3c tempest-SnapshotMetadataTestJSON-1969036081 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:41.829299 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-b6af1115-58df-4958-b21f-ce04ae4cbd3c tempest-SnapshotMetadataTestJSON-1969036081 None] Created reservations ['6ee3c083-506b-407a-8b9e-d4c6412d3413', '0f6b7753-adb6-4aeb-ae6c-557e2a33a5d3', 'e3fa3a85-a29f-4b29-a570-b37e038d7a87', '81361c4d-cddb-4b94-aaf1-df3bc33f3a32'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:08:41.874954 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-b6af1115-58df-4958-b21f-ce04ae4cbd3c tempest-SnapshotMetadataTestJSON-1969036081 None] Delete snapshot completed successfully. Jan 29 21:08:41.880735 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-b6af1115-58df-4958-b21f-ce04ae4cbd3c tempest-SnapshotMetadataTestJSON-1969036081 None] Lock "b'cinder-1381ac96-c982-4353-b839-95e79cf11485-delete_snapshot'" released by "delete_snapshot" :: held 0.779s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:08:42.292592 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-65d2d9d2-eaa1-40ef-a3dd-fdbd66cd0bff tempest-SnapshotMetadataTestJSON-1969036081 None] Lock "b'cinder-1d26f24f-33fd-434b-b5d7-2adeead924cc-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:08:42.348110 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-65d2d9d2-eaa1-40ef-a3dd-fdbd66cd0bff tempest-SnapshotMetadataTestJSON-1969036081 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:42.450869 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-65d2d9d2-eaa1-40ef-a3dd-fdbd66cd0bff tempest-SnapshotMetadataTestJSON-1969036081 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:08:42.452418 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-65d2d9d2-eaa1-40ef-a3dd-fdbd66cd0bff tempest-SnapshotMetadataTestJSON-1969036081 None] Volume volume-1d26f24f-33fd-434b-b5d7-2adeead924cc is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:08:42.471118 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-65d2d9d2-eaa1-40ef-a3dd-fdbd66cd0bff tempest-SnapshotMetadataTestJSON-1969036081 None] deleting rbd volume volume-1d26f24f-33fd-434b-b5d7-2adeead924cc {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:08:42.890870 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-65d2d9d2-eaa1-40ef-a3dd-fdbd66cd0bff tempest-SnapshotMetadataTestJSON-1969036081 None] Created reservations ['d74782b1-3330-4cd0-9f9e-23b1590c16a2', 'f83c2f3a-a625-4b90-bb19-dec6231ac6a8', 'ca416d2e-fe0e-4f9f-8b73-a8e38fbe64a3', '605388bf-bd74-4126-8952-d9dc0b187422'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:08:42.958977 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-65d2d9d2-eaa1-40ef-a3dd-fdbd66cd0bff tempest-SnapshotMetadataTestJSON-1969036081 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:43.033702 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-65d2d9d2-eaa1-40ef-a3dd-fdbd66cd0bff tempest-SnapshotMetadataTestJSON-1969036081 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:43.094085 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-65d2d9d2-eaa1-40ef-a3dd-fdbd66cd0bff tempest-SnapshotMetadataTestJSON-1969036081 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:08:43.098710 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-65d2d9d2-eaa1-40ef-a3dd-fdbd66cd0bff tempest-SnapshotMetadataTestJSON-1969036081 None] Deleted volume successfully. Jan 29 21:08:43.119372 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-65d2d9d2-eaa1-40ef-a3dd-fdbd66cd0bff tempest-SnapshotMetadataTestJSON-1969036081 None] Lock "b'cinder-1d26f24f-33fd-434b-b5d7-2adeead924cc-delete_volume'" released by "delete_volume" :: held 0.827s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:08:48.498932 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:08:48.503434 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:08:48.504557 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:08:48.536545 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Flow 'volume_create_manager' (c56446e9-dc30-45ff-adf8-7b2bf9038c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:48.547290 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0effa1-e98e-4075-bfb4-1147a4c7fc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:48.564179 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:08:48.584736 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0effa1-e98e-4075-bfb4-1147a4c7fc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-104523604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=14a23de9-3d32-4f24-a585-0c9798c9a2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b2ab5dcebee47afa2c1c5c180008fa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:08:48Z,use_quota=True,user_id='d9c7ab36371a4abb88ce9ec91d01cd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:48.593035 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bbe56c6-7320-4184-ac41-79431288c9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:48.598325 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bbe56c6-7320-4184-ac41-79431288c9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:48.603518 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b82bb1-080d-4fc7-a7e7-0f9339753702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:48.609570 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b82bb1-080d-4fc7-a7e7-0f9339753702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a23de9-3d32-4f24-a585-0c9798c9a2a0', 'volume_name': 'volume-14a23de9-3d32-4f24-a585-0c9798c9a2a0', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:48.614503 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fd5396-fada-4e5e-92d9-2c68c5a81286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:48.619090 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fd5396-fada-4e5e-92d9-2c68c5a81286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:48.624035 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3fcda5-9296-4116-8d18-d886b28153a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:48.625664 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Volume 14a23de9-3d32-4f24-a585-0c9798c9a2a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a23de9-3d32-4f24-a585-0c9798c9a2a0', 'volume_size': 1} Jan 29 21:08:48.626361 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] creating volume 'volume-14a23de9-3d32-4f24-a585-0c9798c9a2a0' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:08:48.627518 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:48.731170 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:08:48.731748 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:08:48.753143 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3fcda5-9296-4116-8d18-d886b28153a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a23de9-3d32-4f24-a585-0c9798c9a2a0', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:48.761707 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f902d760-d746-41fb-9c74-02e37e12f3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:48.771318 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Volume volume-14a23de9-3d32-4f24-a585-0c9798c9a2a0 (14a23de9-3d32-4f24-a585-0c9798c9a2a0): created successfully Jan 29 21:08:48.781432 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f902d760-d746-41fb-9c74-02e37e12f3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:48.803042 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Flow 'volume_create_manager' (c56446e9-dc30-45ff-adf8-7b2bf9038c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:48.814435 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-0c974c71-ae76-4232-a5ce-c09e0f5573cb tempest-VolumesTransfersV355Test-96126739 None] Created volume successfully. Jan 29 21:08:50.454614 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9a507b82-c6b9-4b10-8b00-321402e7d718 tempest-VolumesTransfersV355Test-567759471 None] Transfer volume completed successfully. Jan 29 21:08:51.135062 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-f7edbe32-867c-40a5-9c4b-4fcc1e7feb42 tempest-VolumesTransfersV355Test-2028591119 None] Lock "b'cinder-14a23de9-3d32-4f24-a585-0c9798c9a2a0-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:08:51.218791 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f7edbe32-867c-40a5-9c4b-4fcc1e7feb42 tempest-VolumesTransfersV355Test-2028591119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:51.330491 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f7edbe32-867c-40a5-9c4b-4fcc1e7feb42 tempest-VolumesTransfersV355Test-2028591119 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:08:51.331376 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f7edbe32-867c-40a5-9c4b-4fcc1e7feb42 tempest-VolumesTransfersV355Test-2028591119 None] Volume volume-14a23de9-3d32-4f24-a585-0c9798c9a2a0 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:08:51.344482 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f7edbe32-867c-40a5-9c4b-4fcc1e7feb42 tempest-VolumesTransfersV355Test-2028591119 None] deleting rbd volume volume-14a23de9-3d32-4f24-a585-0c9798c9a2a0 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:08:51.795172 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-f7edbe32-867c-40a5-9c4b-4fcc1e7feb42 tempest-VolumesTransfersV355Test-2028591119 None] Created reservations ['c9a784a1-5a1f-41a6-80e0-1f9b83ab2a86', '955138b9-b6f9-45a4-8851-3e9bc79dbc8f', '1abc3300-8c3d-4aa2-bb3a-45b851326a2f', '0b691b96-07a5-48da-b2c2-93f5f58163e5'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:08:51.855328 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f7edbe32-867c-40a5-9c4b-4fcc1e7feb42 tempest-VolumesTransfersV355Test-2028591119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:51.904221 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f7edbe32-867c-40a5-9c4b-4fcc1e7feb42 tempest-VolumesTransfersV355Test-2028591119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:51.995848 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-f7edbe32-867c-40a5-9c4b-4fcc1e7feb42 tempest-VolumesTransfersV355Test-2028591119 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:08:52.001743 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f7edbe32-867c-40a5-9c4b-4fcc1e7feb42 tempest-VolumesTransfersV355Test-2028591119 None] Deleted volume successfully. Jan 29 21:08:52.018762 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-f7edbe32-867c-40a5-9c4b-4fcc1e7feb42 tempest-VolumesTransfersV355Test-2028591119 None] Lock "b'cinder-14a23de9-3d32-4f24-a585-0c9798c9a2a0-delete_volume'" released by "delete_volume" :: held 0.884s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:08:52.864179 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:08:52.870085 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:08:52.870956 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:08:52.900312 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Flow 'volume_create_manager' (7a94bd64-b804-4fd7-baf6-a4f294a040eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:52.915198 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a9ec8d-1142-4303-aaa0-3dc6fb246b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:52.923757 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:08:52.944489 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a9ec8d-1142-4303-aaa0-3dc6fb246b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-511545592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1b1949bc-2b9f-421f-b7eb-85961cb7f95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b2ab5dcebee47afa2c1c5c180008fa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:08:53Z,use_quota=True,user_id='d9c7ab36371a4abb88ce9ec91d01cd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:52.959273 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6bea46-548f-47bf-90c9-5ac1775cd0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:52.964773 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6bea46-548f-47bf-90c9-5ac1775cd0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:52.974098 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5a090a-5da2-47f7-b041-a31c3d26536c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:52.979408 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5a090a-5da2-47f7-b041-a31c3d26536c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b1949bc-2b9f-421f-b7eb-85961cb7f95e', 'volume_name': 'volume-1b1949bc-2b9f-421f-b7eb-85961cb7f95e', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:52.989023 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa12d4a-e0aa-4dc3-8792-47b440d2c212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:52.994685 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa12d4a-e0aa-4dc3-8792-47b440d2c212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:53.000963 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587af96f-5e32-4c6f-a6b1-aa58837a6a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:53.002391 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Volume 1b1949bc-2b9f-421f-b7eb-85961cb7f95e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b1949bc-2b9f-421f-b7eb-85961cb7f95e', 'volume_size': 1} Jan 29 21:08:53.002946 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] creating volume 'volume-1b1949bc-2b9f-421f-b7eb-85961cb7f95e' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:08:53.004130 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:53.113595 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:08:53.114606 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:08:53.123394 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587af96f-5e32-4c6f-a6b1-aa58837a6a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b1949bc-2b9f-421f-b7eb-85961cb7f95e', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:53.129188 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937e6423-b330-45fe-9e94-cea13ca94dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:08:53.140906 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Volume volume-1b1949bc-2b9f-421f-b7eb-85961cb7f95e (1b1949bc-2b9f-421f-b7eb-85961cb7f95e): created successfully Jan 29 21:08:53.146493 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937e6423-b330-45fe-9e94-cea13ca94dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:08:53.154364 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Flow 'volume_create_manager' (7a94bd64-b804-4fd7-baf6-a4f294a040eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:08:53.165987 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-63fc1219-8b77-4353-ab6f-014c869db12e tempest-VolumesTransfersV355Test-96126739 None] Created volume successfully. Jan 29 21:08:54.606502 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-ff7de95a-b271-4b0a-a721-ebc47e5f936f tempest-VolumesTransfersV355Test-2028591119 None] Lock "b'cinder-1b1949bc-2b9f-421f-b7eb-85961cb7f95e-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:08:54.687784 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ff7de95a-b271-4b0a-a721-ebc47e5f936f tempest-VolumesTransfersV355Test-2028591119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:54.837899 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ff7de95a-b271-4b0a-a721-ebc47e5f936f tempest-VolumesTransfersV355Test-2028591119 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:08:54.838324 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ff7de95a-b271-4b0a-a721-ebc47e5f936f tempest-VolumesTransfersV355Test-2028591119 None] Volume volume-1b1949bc-2b9f-421f-b7eb-85961cb7f95e is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:08:54.850074 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ff7de95a-b271-4b0a-a721-ebc47e5f936f tempest-VolumesTransfersV355Test-2028591119 None] deleting rbd volume volume-1b1949bc-2b9f-421f-b7eb-85961cb7f95e {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:08:55.362448 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-ff7de95a-b271-4b0a-a721-ebc47e5f936f tempest-VolumesTransfersV355Test-2028591119 None] Created reservations ['15b7e3cb-167c-4ca9-a4b9-a125fe39f800', 'e249f916-40bd-40cd-987c-b46076604576', '79ea1b7e-b6f5-4fae-914b-f6b627342658', '3288f43e-7b0f-498a-893c-bd48bf542f91'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:08:55.452490 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ff7de95a-b271-4b0a-a721-ebc47e5f936f tempest-VolumesTransfersV355Test-2028591119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:55.524856 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ff7de95a-b271-4b0a-a721-ebc47e5f936f tempest-VolumesTransfersV355Test-2028591119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:08:55.630352 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-ff7de95a-b271-4b0a-a721-ebc47e5f936f tempest-VolumesTransfersV355Test-2028591119 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:08:55.637127 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ff7de95a-b271-4b0a-a721-ebc47e5f936f tempest-VolumesTransfersV355Test-2028591119 None] Deleted volume successfully. Jan 29 21:08:55.662447 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-ff7de95a-b271-4b0a-a721-ebc47e5f936f tempest-VolumesTransfersV355Test-2028591119 None] Lock "b'cinder-1b1949bc-2b9f-421f-b7eb-85961cb7f95e-delete_volume'" released by "delete_volume" :: held 1.056s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:09:05.017128 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:09:05.026116 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:09:05.029402 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:09:05.086791 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Flow 'volume_create_manager' (18703e85-9528-4d50-9a32-cbe05d1c6db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:09:05.109317 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a0e5fc-2f7a-482e-b598-4aab6218a2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:09:05.129570 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:09:05.165996 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a0e5fc-2f7a-482e-b598-4aab6218a2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2083107593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=51942290-e988-4ce7-b916-11e99cd4799d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337f56cfddf647ffb5c7fea47f812151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:09:05Z,use_quota=True,user_id='de2df0242e20489698c83ed62a45599e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:09:05.179541 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987b3804-5206-4b63-948a-b564824cc4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:09:05.189045 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987b3804-5206-4b63-948a-b564824cc4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:09:05.210300 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfd61dc-64a6-4056-af16-09d5cb632be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:09:05.233882 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfd61dc-64a6-4056-af16-09d5cb632be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51942290-e988-4ce7-b916-11e99cd4799d', 'volume_name': 'volume-51942290-e988-4ce7-b916-11e99cd4799d', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:09:05.263525 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba45365d-28f6-47bb-b3cd-756df7e176b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:09:05.271299 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba45365d-28f6-47bb-b3cd-756df7e176b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:09:05.293373 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda87eff-c905-4681-8cb9-24d993eda3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:09:05.301418 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Volume 51942290-e988-4ce7-b916-11e99cd4799d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51942290-e988-4ce7-b916-11e99cd4799d', 'volume_size': 1} Jan 29 21:09:05.301961 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] creating volume 'volume-51942290-e988-4ce7-b916-11e99cd4799d' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:09:05.303007 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:09:05.453687 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:09:05.454061 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:09:05.466932 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda87eff-c905-4681-8cb9-24d993eda3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51942290-e988-4ce7-b916-11e99cd4799d', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:09:05.476690 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1350f1d0-015c-4a9f-b6bb-ee7447488de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:09:05.506143 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Volume volume-51942290-e988-4ce7-b916-11e99cd4799d (51942290-e988-4ce7-b916-11e99cd4799d): created successfully Jan 29 21:09:05.513081 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1350f1d0-015c-4a9f-b6bb-ee7447488de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:09:05.519207 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Flow 'volume_create_manager' (18703e85-9528-4d50-9a32-cbe05d1c6db2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:09:05.530939 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-1237e120-3d98-4566-a3b4-cce8ea2998d7 tempest-VolumesActionsTest-887584591 None] Created volume successfully. Jan 29 21:09:28.707836 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:09:28.708588 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:09:28.765017 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:09:28.839779 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:09:31.256709 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e550e062-dedc-4eeb-99db-d558570fc8a4 tempest-VolumesActionsTest-887584591 None] Lock "b'cinder-51942290-e988-4ce7-b916-11e99cd4799d'" acquired by "attach_volume" :: waited 0.011s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:09:31.383446 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e550e062-dedc-4eeb-99db-d558570fc8a4 tempest-VolumesActionsTest-887584591 None] Attaching volume 51942290-e988-4ce7-b916-11e99cd4799d to instance d5220210-ebe3-4bd8-97da-29e3e07fcde8 at mountpoint /dev/sdb on host None. Jan 29 21:09:31.420722 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e550e062-dedc-4eeb-99db-d558570fc8a4 tempest-VolumesActionsTest-887584591 None] Attach volume completed successfully. Jan 29 21:09:31.425950 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e550e062-dedc-4eeb-99db-d558570fc8a4 tempest-VolumesActionsTest-887584591 None] Lock "b'cinder-51942290-e988-4ce7-b916-11e99cd4799d'" released by "attach_volume" :: held 0.169s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:09:31.589295 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-026766ca-4115-4fd3-a28e-bc4aa86651e8 tempest-VolumesActionsTest-887584591 None] Lock "b'cinder-51942290-e988-4ce7-b916-11e99cd4799d-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:09:31.590508 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-026766ca-4115-4fd3-a28e-bc4aa86651e8 tempest-VolumesActionsTest-887584591 None] Detaching volume 51942290-e988-4ce7-b916-11e99cd4799d from instance d5220210-ebe3-4bd8-97da-29e3e07fcde8. Jan 29 21:09:31.664451 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-026766ca-4115-4fd3-a28e-bc4aa86651e8 tempest-VolumesActionsTest-887584591 None] Detach volume completed successfully. Jan 29 21:09:31.673186 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-026766ca-4115-4fd3-a28e-bc4aa86651e8 tempest-VolumesActionsTest-887584591 None] Lock "b'cinder-51942290-e988-4ce7-b916-11e99cd4799d-detach_volume'" released by "detach_volume" :: held 0.084s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:09:52.243718 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-4859952e-e027-40e6-ab11-33b32ce0873c tempest-VolumesActionsTest-887584591 None] Lock "b'cinder-51942290-e988-4ce7-b916-11e99cd4799d'" acquired by "attach_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:09:52.293932 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4859952e-e027-40e6-ab11-33b32ce0873c tempest-VolumesActionsTest-887584591 None] Attaching volume 51942290-e988-4ce7-b916-11e99cd4799d to instance 063bae33-0693-49e0-8ddf-3662fdf636a4 at mountpoint /dev/sdb on host None. Jan 29 21:09:52.333105 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4859952e-e027-40e6-ab11-33b32ce0873c tempest-VolumesActionsTest-887584591 None] Attach volume completed successfully. Jan 29 21:09:52.341724 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-4859952e-e027-40e6-ab11-33b32ce0873c tempest-VolumesActionsTest-887584591 None] Lock "b'cinder-51942290-e988-4ce7-b916-11e99cd4799d'" released by "attach_volume" :: held 0.097s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:09:52.622794 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-53ffcf15-6531-4db7-b951-207acc275d69 tempest-VolumesActionsTest-887584591 None] Lock "b'cinder-51942290-e988-4ce7-b916-11e99cd4799d-detach_volume'" acquired by "detach_volume" :: waited 0.016s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:09:52.624022 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-53ffcf15-6531-4db7-b951-207acc275d69 tempest-VolumesActionsTest-887584591 None] Detaching volume 51942290-e988-4ce7-b916-11e99cd4799d from instance 063bae33-0693-49e0-8ddf-3662fdf636a4. Jan 29 21:09:52.673915 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-53ffcf15-6531-4db7-b951-207acc275d69 tempest-VolumesActionsTest-887584591 None] Detach volume completed successfully. Jan 29 21:09:52.679226 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-53ffcf15-6531-4db7-b951-207acc275d69 tempest-VolumesActionsTest-887584591 None] Lock "b'cinder-51942290-e988-4ce7-b916-11e99cd4799d-detach_volume'" released by "detach_volume" :: held 0.057s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:09:57.867406 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-31a03691-35d7-43e4-8abe-3a708d9bc437 tempest-VolumesActionsTest-887584591 None] Running cmd (subprocess): rbd export --pool volumes volume-51942290-e988-4ce7-b916-11e99cd4799d /opt/stack/data/cinder/conversion/volume-51942290-e988-4ce7-b916-11e99cd4799d-17dc560f-2b94-48ad-971f-c17911d19f15 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:09:58.871784 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-31a03691-35d7-43e4-8abe-3a708d9bc437 tempest-VolumesActionsTest-887584591 None] CMD "rbd export --pool volumes volume-51942290-e988-4ce7-b916-11e99cd4799d /opt/stack/data/cinder/conversion/volume-51942290-e988-4ce7-b916-11e99cd4799d-17dc560f-2b94-48ad-971f-c17911d19f15 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.003s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:09:58.891454 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.image_utils [None req-31a03691-35d7-43e4-8abe-3a708d9bc437 tempest-VolumesActionsTest-887584591 None] 17dc560f-2b94-48ad-971f-c17911d19f15 was raw, no need to convert to raw {{(pid=134283) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Jan 29 21:10:28.712931 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:10:28.716732 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:10:28.802322 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:10:28.882468 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:10:29.067386 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-31a03691-35d7-43e4-8abe-3a708d9bc437 tempest-VolumesActionsTest-887584591 None] Uploaded volume to glance image-id: 17dc560f-2b94-48ad-971f-c17911d19f15. {{(pid=134283) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1746}} Jan 29 21:10:29.100950 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-31a03691-35d7-43e4-8abe-3a708d9bc437 tempest-VolumesActionsTest-887584591 None] Copy volume to image completed successfully. Jan 29 21:10:31.131958 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-83801ac6-99ce-4bc8-a6d8-111ec8e6b025 tempest-VolumesActionsTest-887584591 None] Lock "b'cinder-51942290-e988-4ce7-b916-11e99cd4799d-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:10:31.201634 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-83801ac6-99ce-4bc8-a6d8-111ec8e6b025 tempest-VolumesActionsTest-887584591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:10:31.297038 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-83801ac6-99ce-4bc8-a6d8-111ec8e6b025 tempest-VolumesActionsTest-887584591 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:10:31.297497 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-83801ac6-99ce-4bc8-a6d8-111ec8e6b025 tempest-VolumesActionsTest-887584591 None] Volume volume-51942290-e988-4ce7-b916-11e99cd4799d is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:10:31.311678 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-83801ac6-99ce-4bc8-a6d8-111ec8e6b025 tempest-VolumesActionsTest-887584591 None] deleting rbd volume volume-51942290-e988-4ce7-b916-11e99cd4799d {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:10:31.795220 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-83801ac6-99ce-4bc8-a6d8-111ec8e6b025 tempest-VolumesActionsTest-887584591 None] Created reservations ['5b1950b4-7745-4da0-8e67-3066d30629c4', '8eb2ad8d-9e07-416f-80f1-2e89c250607f', '58ae513b-0772-434b-83d5-cd2820bd924b', '2699bb33-9954-492f-aba9-027210ced3bc'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:10:31.936139 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-83801ac6-99ce-4bc8-a6d8-111ec8e6b025 tempest-VolumesActionsTest-887584591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:10:32.051044 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-83801ac6-99ce-4bc8-a6d8-111ec8e6b025 tempest-VolumesActionsTest-887584591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:10:32.150317 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-83801ac6-99ce-4bc8-a6d8-111ec8e6b025 tempest-VolumesActionsTest-887584591 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:10:32.157615 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-83801ac6-99ce-4bc8-a6d8-111ec8e6b025 tempest-VolumesActionsTest-887584591 None] Deleted volume successfully. Jan 29 21:10:32.183911 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-83801ac6-99ce-4bc8-a6d8-111ec8e6b025 tempest-VolumesActionsTest-887584591 None] Lock "b'cinder-51942290-e988-4ce7-b916-11e99cd4799d-delete_volume'" released by "delete_volume" :: held 1.044s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:11:28.713909 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:11:28.716502 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:11:28.789323 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:11:28.845842 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:12:28.711717 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:12:28.713534 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:12:28.777777 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:12:28.844264 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:12:30.007636 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:12:30.013380 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:12:30.013984 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:12:30.038896 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Flow 'volume_create_manager' (9e6d09ab-fadf-4db4-ac38-f4885dff84c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:12:30.045741 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0752150b-9da8-45d0-9433-52be9853beb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:12:30.053724 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:12:30.076570 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0752150b-9da8-45d0-9433-52be9853beb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-520722244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7a12db09-3490-45ae-8049-9d5cb7d02c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5ffe7b97c841c0975501e87de3ec7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:12:30Z,use_quota=True,user_id='1051324b194a438eb8424565dd9552d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:12:30.082720 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137da32e-587c-4fa1-9152-90dcb250c796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:12:30.087874 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137da32e-587c-4fa1-9152-90dcb250c796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:12:30.092887 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad68a9f-06f8-441c-852d-7c956162bfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:12:30.097210 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad68a9f-06f8-441c-852d-7c956162bfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a12db09-3490-45ae-8049-9d5cb7d02c71', 'volume_name': 'volume-7a12db09-3490-45ae-8049-9d5cb7d02c71', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:12:30.102683 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb850d2-3860-456f-8061-3d8bb20c6254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:12:30.106686 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb850d2-3860-456f-8061-3d8bb20c6254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:12:30.111362 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee5e12c-a739-4828-ace6-e0fbfccb81f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:12:30.112431 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Volume 7a12db09-3490-45ae-8049-9d5cb7d02c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a12db09-3490-45ae-8049-9d5cb7d02c71', 'volume_size': 1} Jan 29 21:12:30.112826 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] creating volume 'volume-7a12db09-3490-45ae-8049-9d5cb7d02c71' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:12:30.113835 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:12:30.211899 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:12:30.212283 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:12:30.219621 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee5e12c-a739-4828-ace6-e0fbfccb81f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a12db09-3490-45ae-8049-9d5cb7d02c71', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:12:30.224303 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce7f329-0a6a-464a-9ab5-0c707a6dafe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:12:30.240512 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Volume volume-7a12db09-3490-45ae-8049-9d5cb7d02c71 (7a12db09-3490-45ae-8049-9d5cb7d02c71): created successfully Jan 29 21:12:30.244529 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce7f329-0a6a-464a-9ab5-0c707a6dafe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:12:30.251172 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Flow 'volume_create_manager' (9e6d09ab-fadf-4db4-ac38-f4885dff84c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:12:30.261012 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-61a31311-eaad-479c-ab0b-de408730b1c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Created volume successfully. Jan 29 21:12:31.222887 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2c30a1e1-2389-4cca-bb99-172d27d0c490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:12:31.942010 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-2c30a1e1-2389-4cca-bb99-172d27d0c490 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Create snapshot completed successfully Jan 29 21:12:32.715552 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-3c5cc493-6d70-4fb2-8084-955cb5c49299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Lock "b'cinder-76e27c77-42a8-493c-9296-156a996e9425-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:12:32.718172 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3c5cc493-6d70-4fb2-8084-955cb5c49299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:12:32.955605 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-3c5cc493-6d70-4fb2-8084-955cb5c49299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Created reservations ['b7adc3b8-3128-4357-8e01-c75f6fa0958b', '6ce1a2d4-b297-43bc-b9e6-f39ec8a9459a', '25163d98-d4bb-433d-8e47-158a128126cc', '883bd0a6-d34c-4f97-b07f-018e57f0ac66'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:12:33.006666 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-3c5cc493-6d70-4fb2-8084-955cb5c49299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Delete snapshot completed successfully. Jan 29 21:12:33.011907 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-3c5cc493-6d70-4fb2-8084-955cb5c49299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Lock "b'cinder-76e27c77-42a8-493c-9296-156a996e9425-delete_snapshot'" released by "delete_snapshot" :: held 0.296s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:12:33.852473 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e7ea2e6e-887c-4967-a2f8-bb63246ce362 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Lock "b'cinder-7a12db09-3490-45ae-8049-9d5cb7d02c71-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:12:33.924670 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e7ea2e6e-887c-4967-a2f8-bb63246ce362 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:12:34.013811 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e7ea2e6e-887c-4967-a2f8-bb63246ce362 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:12:34.014883 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e7ea2e6e-887c-4967-a2f8-bb63246ce362 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Volume volume-7a12db09-3490-45ae-8049-9d5cb7d02c71 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:12:34.021943 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e7ea2e6e-887c-4967-a2f8-bb63246ce362 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] deleting rbd volume volume-7a12db09-3490-45ae-8049-9d5cb7d02c71 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:12:34.254917 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-e7ea2e6e-887c-4967-a2f8-bb63246ce362 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Created reservations ['08fba110-989f-4b78-8ffa-86b17aa977db', '8142d00d-7ff7-4b67-9a54-6474015d3555', '96fbb772-8300-4c20-b267-c7e5c1e86142', 'd466e2d8-6f88-4f49-a9ac-be9479b01866'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:12:34.297142 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e7ea2e6e-887c-4967-a2f8-bb63246ce362 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:12:34.332574 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e7ea2e6e-887c-4967-a2f8-bb63246ce362 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:12:34.381317 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e7ea2e6e-887c-4967-a2f8-bb63246ce362 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:12:34.386686 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e7ea2e6e-887c-4967-a2f8-bb63246ce362 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Deleted volume successfully. Jan 29 21:12:34.401056 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e7ea2e6e-887c-4967-a2f8-bb63246ce362 tempest-VolumeSnapshotQuotasNegativeTestJSON-1927962663 None] Lock "b'cinder-7a12db09-3490-45ae-8049-9d5cb7d02c71-delete_volume'" released by "delete_volume" :: held 0.549s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:12:41.058894 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:12:41.062226 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:12:41.062674 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:12:41.082985 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Flow 'volume_create_manager' (eb8a8b00-7b35-4b3a-a8fc-6c316b92fe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:12:41.091104 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd08ad45-bea3-4084-b956-46e166fc5223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:12:41.097693 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:12:41.114778 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd08ad45-bea3-4084-b956-46e166fc5223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1217723722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f0830cc4-21e5-4427-b434-f0f0f2ae32e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b715a32b57b7413aafef163d223369d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:12:41Z,use_quota=True,user_id='50ca20a1ee774e4292495dd41ab04571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:12:41.121441 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f028139-5826-45c2-8d26-c13a62248869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:12:41.125780 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f028139-5826-45c2-8d26-c13a62248869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:12:41.132028 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9febc9a-c442-463d-ad4b-18bbc8ff7760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:12:41.136726 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9febc9a-c442-463d-ad4b-18bbc8ff7760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0830cc4-21e5-4427-b434-f0f0f2ae32e7', 'volume_name': 'volume-f0830cc4-21e5-4427-b434-f0f0f2ae32e7', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:12:41.142084 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795fce1f-6650-4133-bd11-b990d6c182e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:12:41.146297 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795fce1f-6650-4133-bd11-b990d6c182e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:12:41.151255 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca6515f-87ad-4e04-bd40-19b81b4133c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:12:41.152363 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Volume f0830cc4-21e5-4427-b434-f0f0f2ae32e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0830cc4-21e5-4427-b434-f0f0f2ae32e7', 'volume_size': 1} Jan 29 21:12:41.152829 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] creating volume 'volume-f0830cc4-21e5-4427-b434-f0f0f2ae32e7' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:12:41.153854 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:12:41.225520 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:12:41.225984 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:12:41.229801 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca6515f-87ad-4e04-bd40-19b81b4133c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0830cc4-21e5-4427-b434-f0f0f2ae32e7', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:12:41.234605 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609c4e9e-1a2e-4bac-b37d-609af7a2fb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:12:41.246703 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Volume volume-f0830cc4-21e5-4427-b434-f0f0f2ae32e7 (f0830cc4-21e5-4427-b434-f0f0f2ae32e7): created successfully Jan 29 21:12:41.251525 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609c4e9e-1a2e-4bac-b37d-609af7a2fb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:12:41.260027 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Flow 'volume_create_manager' (eb8a8b00-7b35-4b3a-a8fc-6c316b92fe4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:12:41.268880 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-eb66d679-ba94-4b40-85c1-dcaafab6a0b0 tempest-VolumesBackupsTest-2013611801 None] Created volume successfully. Jan 29 21:12:59.658244 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-1d7079a8-e9e1-41f3-8a39-c1c1ec9f9d27 req-61e0f742-d00b-4724-8bf7-203352422ba5 tempest-VolumesBackupsTest-2013611801 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:13:01.132669 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-1d7079a8-e9e1-41f3-8a39-c1c1ec9f9d27 req-61e0f742-d00b-4724-8bf7-203352422ba5 tempest-VolumesBackupsTest-2013611801 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.474s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:13:01.134113 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-1d7079a8-e9e1-41f3-8a39-c1c1ec9f9d27 req-61e0f742-d00b-4724-8bf7-203352422ba5 tempest-VolumesBackupsTest-2013611801 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f0830cc4-21e5-4427-b434-f0f0f2ae32e7', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'f0830cc4-21e5-4427-b434-f0f0f2ae32e7', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:13:01.190375 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-1d7079a8-e9e1-41f3-8a39-c1c1ec9f9d27 req-61e0f742-d00b-4724-8bf7-203352422ba5 tempest-VolumesBackupsTest-2013611801 None] Connection info returned from driver {'name': 'volumes/volume-f0830cc4-21e5-4427-b434-f0f0f2ae32e7', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f0830cc4-21e5-4427-b434-f0f0f2ae32e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'eabaa2a4-ac61-497b-9eef-79a1b69544cf'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:13:01.307460 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-1d7079a8-e9e1-41f3-8a39-c1c1ec9f9d27 req-61e0f742-d00b-4724-8bf7-203352422ba5 tempest-VolumesBackupsTest-2013611801 None] attachment_update completed successfully. Jan 29 21:13:03.609112 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-d3c233b5-7063-45a7-ac82-ccfb8e86e241 tempest-VolumesBackupsTest-2013611801 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:13:04.883538 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-d3c233b5-7063-45a7-ac82-ccfb8e86e241 tempest-VolumesBackupsTest-2013611801 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.274s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:13:04.884975 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d3c233b5-7063-45a7-ac82-ccfb8e86e241 tempest-VolumesBackupsTest-2013611801 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f0830cc4-21e5-4427-b434-f0f0f2ae32e7', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'f0830cc4-21e5-4427-b434-f0f0f2ae32e7', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:13:04.903078 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d3c233b5-7063-45a7-ac82-ccfb8e86e241 tempest-VolumesBackupsTest-2013611801 None] Initialize volume connection completed successfully. Jan 29 21:13:07.487063 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d3c233b5-7063-45a7-ac82-ccfb8e86e241 tempest-VolumesBackupsTest-2013611801 None] Terminate volume connection completed successfully. Jan 29 21:13:07.520277 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d3c233b5-7063-45a7-ac82-ccfb8e86e241 tempest-VolumesBackupsTest-2013611801 None] Remove volume export completed successfully. Jan 29 21:13:11.171193 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-ca0cfc90-589c-413e-82b0-371a382ba12c req-dfff36ae-42cf-460c-b2c1-67a46af5751d tempest-VolumesBackupsTest-2013611801 None] Terminate volume connection completed successfully. Jan 29 21:13:11.171825 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-ca0cfc90-589c-413e-82b0-371a382ba12c req-dfff36ae-42cf-460c-b2c1-67a46af5751d tempest-VolumesBackupsTest-2013611801 None] Deleting attachment eabaa2a4-ac61-497b-9eef-79a1b69544cf. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:13:15.531575 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-6bc344ad-7f86-4cf4-8309-77c911940e16 tempest-VolumesBackupsTest-2013611801 None] Lock "b'cinder-f0830cc4-21e5-4427-b434-f0f0f2ae32e7-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:13:15.567292 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6bc344ad-7f86-4cf4-8309-77c911940e16 tempest-VolumesBackupsTest-2013611801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:15.697255 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6bc344ad-7f86-4cf4-8309-77c911940e16 tempest-VolumesBackupsTest-2013611801 None] Volume volume-f0830cc4-21e5-4427-b434-f0f0f2ae32e7 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:13:15.712415 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6bc344ad-7f86-4cf4-8309-77c911940e16 tempest-VolumesBackupsTest-2013611801 None] deleting rbd volume volume-f0830cc4-21e5-4427-b434-f0f0f2ae32e7 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:13:15.925600 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-6bc344ad-7f86-4cf4-8309-77c911940e16 tempest-VolumesBackupsTest-2013611801 None] Created reservations ['2fe93031-50ea-4fdd-b794-0f272a627c3c', 'cea9b5dd-9cc6-42d0-8cec-a2cf0256eb4e', '1766dff0-bdf9-4f6f-a87f-66acccda6707', 'c86a4c22-7572-43d8-a8b0-88e52ceb74e3'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:13:15.970007 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6bc344ad-7f86-4cf4-8309-77c911940e16 tempest-VolumesBackupsTest-2013611801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:16.007912 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6bc344ad-7f86-4cf4-8309-77c911940e16 tempest-VolumesBackupsTest-2013611801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:16.044306 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-6bc344ad-7f86-4cf4-8309-77c911940e16 tempest-VolumesBackupsTest-2013611801 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:13:16.048593 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6bc344ad-7f86-4cf4-8309-77c911940e16 tempest-VolumesBackupsTest-2013611801 None] Deleted volume successfully. Jan 29 21:13:16.062379 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-6bc344ad-7f86-4cf4-8309-77c911940e16 tempest-VolumesBackupsTest-2013611801 None] Lock "b'cinder-f0830cc4-21e5-4427-b434-f0f0f2ae32e7-delete_volume'" released by "delete_volume" :: held 0.531s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:13:17.163489 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:13:17.167240 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:13:17.167578 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:13:17.194566 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Flow 'volume_create_manager' (59a8c252-5f34-483d-8963-6b4e8a94fc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:13:17.202235 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760d8621-caaa-4510-b368-25f25ea27e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:17.209970 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:13:17.229811 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760d8621-caaa-4510-b368-25f25ea27e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1906796047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9723b5a7-1252-49d7-b3f1-ae5426460e67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b715a32b57b7413aafef163d223369d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:13:17Z,use_quota=True,user_id='50ca20a1ee774e4292495dd41ab04571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:17.235408 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177d8385-e98e-468d-87c5-a7dca8314b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:17.240101 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177d8385-e98e-468d-87c5-a7dca8314b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:17.245583 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d4b7a2-8b5d-4d4f-8a07-a94607e96cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:17.354624 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d4b7a2-8b5d-4d4f-8a07-a94607e96cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9723b5a7-1252-49d7-b3f1-ae5426460e67', 'volume_name': 'volume-9723b5a7-1252-49d7-b3f1-ae5426460e67', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:17.359759 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca7bc3a-160b-4c07-ac82-2fe346103ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:17.363905 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca7bc3a-160b-4c07-ac82-2fe346103ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:17.368824 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d83304-ae18-40f1-992d-9b91d6d01525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:17.369979 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Volume 9723b5a7-1252-49d7-b3f1-ae5426460e67: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9723b5a7-1252-49d7-b3f1-ae5426460e67', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 21:13:17.370572 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Cloning 9723b5a7-1252-49d7-b3f1-ae5426460e67 from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 21:13:17.378530 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:13:17.388852 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 13, 17, 383497)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:13:17.389329 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:13:17.389727 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Found cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 29 21:13:17.394344 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:13:17.395328 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 21:13:17.401220 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 13, 17, 399058)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:13:17.401634 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:13:17.402026 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Creating from source image-volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 29 21:13:17.413507 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:17.473282 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] creating snapshot='volume-9723b5a7-1252-49d7-b3f1-ae5426460e67.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 21:13:17.896557 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] cloning 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe@volume-9723b5a7-1252-49d7-b3f1-ae5426460e67.clone_snap' to 'volume-9723b5a7-1252-49d7-b3f1-ae5426460e67' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 21:13:18.022768 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:13:18.023959 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:13:18.024331 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:13:18.040217 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 21:13:18.040889 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Marking volume 9723b5a7-1252-49d7-b3f1-ae5426460e67 as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 21:13:18.049112 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to 9723b5a7-1252-49d7-b3f1-ae5426460e67. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 21:13:18.049566 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Creating volume glance metadata for volume 9723b5a7-1252-49d7-b3f1-ae5426460e67 backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 21:13:18.115432 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d83304-ae18-40f1-992d-9b91d6d01525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9723b5a7-1252-49d7-b3f1-ae5426460e67', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:18.120384 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbf878c-ca91-4ac4-8230-df4e31c4d67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:18.129678 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Volume volume-9723b5a7-1252-49d7-b3f1-ae5426460e67 (9723b5a7-1252-49d7-b3f1-ae5426460e67): created successfully Jan 29 21:13:18.134648 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbf878c-ca91-4ac4-8230-df4e31c4d67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:18.141388 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Flow 'volume_create_manager' (59a8c252-5f34-483d-8963-6b4e8a94fc42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:13:18.150286 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-2713f3a2-23bd-4600-8158-b767ccfb48a0 tempest-VolumesBackupsTest-2013611801 None] Created volume successfully. Jan 29 21:13:19.477478 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-2d29c48e-6193-48ab-af52-e93508630b1e tempest-VolumesBackupsTest-2013611801 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:13:20.185470 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-2d29c48e-6193-48ab-af52-e93508630b1e tempest-VolumesBackupsTest-2013611801 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.707s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:13:20.186358 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2d29c48e-6193-48ab-af52-e93508630b1e tempest-VolumesBackupsTest-2013611801 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9723b5a7-1252-49d7-b3f1-ae5426460e67', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '9723b5a7-1252-49d7-b3f1-ae5426460e67', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:13:20.204058 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-2d29c48e-6193-48ab-af52-e93508630b1e tempest-VolumesBackupsTest-2013611801 None] Initialize volume connection completed successfully. Jan 29 21:13:28.709865 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:13:28.711626 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:28.750853 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:28.798029 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:13:29.212815 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-2d29c48e-6193-48ab-af52-e93508630b1e tempest-VolumesBackupsTest-2013611801 None] Terminate volume connection completed successfully. Jan 29 21:13:29.239177 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-2d29c48e-6193-48ab-af52-e93508630b1e tempest-VolumesBackupsTest-2013611801 None] Remove volume export completed successfully. Jan 29 21:13:30.262287 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:13:30.266844 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:13:30.267349 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:13:30.295318 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Flow 'volume_create_manager' (d3a273f3-eaa1-4074-8d14-87a9e1dbc693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:13:30.301912 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dfa089-645b-4030-bda0-fa257c92608d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:30.309350 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:13:30.324125 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dfa089-645b-4030-bda0-fa257c92608d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:13:30Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_318bf7e5-1cf6-4993-9ab9-636adc9dda50',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=47e1f328-e4d4-4c69-a891-74eeb1d28bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b715a32b57b7413aafef163d223369d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:13:30Z,use_quota=True,user_id='50ca20a1ee774e4292495dd41ab04571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:30.329999 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ecfae2-b38a-4619-9d35-21c145ddaa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:30.334322 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ecfae2-b38a-4619-9d35-21c145ddaa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:30.339835 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16e6834-6f4d-4f7e-a6e1-1b295a361d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:30.344214 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16e6834-6f4d-4f7e-a6e1-1b295a361d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47e1f328-e4d4-4c69-a891-74eeb1d28bdb', 'volume_name': 'volume-47e1f328-e4d4-4c69-a891-74eeb1d28bdb', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:30.349999 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d353040-b4dd-45c9-a6e8-8624b0723528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:30.354227 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d353040-b4dd-45c9-a6e8-8624b0723528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:30.360289 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffaeb1f-9056-43d0-ac53-b41a67df3b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:30.361651 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Volume 47e1f328-e4d4-4c69-a891-74eeb1d28bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47e1f328-e4d4-4c69-a891-74eeb1d28bdb', 'volume_size': 1} Jan 29 21:13:30.362058 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] creating volume 'volume-47e1f328-e4d4-4c69-a891-74eeb1d28bdb' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:13:30.363624 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:30.485970 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:13:30.486560 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:13:30.490740 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffaeb1f-9056-43d0-ac53-b41a67df3b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e1f328-e4d4-4c69-a891-74eeb1d28bdb', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:30.496171 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cee53e6-10da-4c71-861d-d4f9a78800b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:30.507894 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Volume volume-47e1f328-e4d4-4c69-a891-74eeb1d28bdb (47e1f328-e4d4-4c69-a891-74eeb1d28bdb): created successfully Jan 29 21:13:30.512493 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cee53e6-10da-4c71-861d-d4f9a78800b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:30.518288 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Flow 'volume_create_manager' (d3a273f3-eaa1-4074-8d14-87a9e1dbc693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:13:30.530132 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Created volume successfully. Jan 29 21:13:31.299399 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:13:32.083119 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.784s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:13:32.084547 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-47e1f328-e4d4-4c69-a891-74eeb1d28bdb', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '47e1f328-e4d4-4c69-a891-74eeb1d28bdb', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:13:32.104517 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Initialize volume connection completed successfully. Jan 29 21:13:39.314044 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Terminate volume connection completed successfully. Jan 29 21:13:39.334344 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-bb21a9a0-0265-480e-965b-371304ba242d tempest-VolumesBackupsTest-2013611801 None] Remove volume export completed successfully. Jan 29 21:13:39.691799 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-44bf6b1d-0ff7-48fc-bc0b-5c3d7a90dff6 tempest-VolumesBackupsTest-2013611801 None] Lock "b'cinder-47e1f328-e4d4-4c69-a891-74eeb1d28bdb-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:13:39.746065 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-44bf6b1d-0ff7-48fc-bc0b-5c3d7a90dff6 tempest-VolumesBackupsTest-2013611801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:39.972287 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-44bf6b1d-0ff7-48fc-bc0b-5c3d7a90dff6 tempest-VolumesBackupsTest-2013611801 None] Volume volume-47e1f328-e4d4-4c69-a891-74eeb1d28bdb is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:13:39.991029 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-44bf6b1d-0ff7-48fc-bc0b-5c3d7a90dff6 tempest-VolumesBackupsTest-2013611801 None] deleting rbd volume volume-47e1f328-e4d4-4c69-a891-74eeb1d28bdb {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:13:40.474543 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-44bf6b1d-0ff7-48fc-bc0b-5c3d7a90dff6 tempest-VolumesBackupsTest-2013611801 None] Created reservations ['cdd60741-c7f2-4d46-ac25-b6afa4ed5122', '029f771b-3937-44b0-bf01-47db45fb5736', '559f0fb5-bbf9-4747-a60b-5a69a33b1dba', 'f7fa3831-e5e5-45f2-9b46-4e54495ee611'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:13:40.518432 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-44bf6b1d-0ff7-48fc-bc0b-5c3d7a90dff6 tempest-VolumesBackupsTest-2013611801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:40.541954 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-44bf6b1d-0ff7-48fc-bc0b-5c3d7a90dff6 tempest-VolumesBackupsTest-2013611801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:40.570264 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-44bf6b1d-0ff7-48fc-bc0b-5c3d7a90dff6 tempest-VolumesBackupsTest-2013611801 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:13:40.574562 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-44bf6b1d-0ff7-48fc-bc0b-5c3d7a90dff6 tempest-VolumesBackupsTest-2013611801 None] Deleted volume successfully. Jan 29 21:13:40.594891 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-44bf6b1d-0ff7-48fc-bc0b-5c3d7a90dff6 tempest-VolumesBackupsTest-2013611801 None] Lock "b'cinder-47e1f328-e4d4-4c69-a891-74eeb1d28bdb-delete_volume'" released by "delete_volume" :: held 0.903s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:13:41.958944 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-8a2c9fc5-e64d-4906-9755-bceab1a8a844 tempest-VolumesBackupsTest-2013611801 None] Lock "b'cinder-9723b5a7-1252-49d7-b3f1-ae5426460e67-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:13:42.005647 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8a2c9fc5-e64d-4906-9755-bceab1a8a844 tempest-VolumesBackupsTest-2013611801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:43.103927 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8a2c9fc5-e64d-4906-9755-bceab1a8a844 tempest-VolumesBackupsTest-2013611801 None] deleting rbd volume volume-9723b5a7-1252-49d7-b3f1-ae5426460e67 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:13:43.332791 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8a2c9fc5-e64d-4906-9755-bceab1a8a844 tempest-VolumesBackupsTest-2013611801 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 21:13:43.370836 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8a2c9fc5-e64d-4906-9755-bceab1a8a844 tempest-VolumesBackupsTest-2013611801 None] deleting parent snapshot volume-9723b5a7-1252-49d7-b3f1-ae5426460e67.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 21:13:44.180292 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-8a2c9fc5-e64d-4906-9755-bceab1a8a844 tempest-VolumesBackupsTest-2013611801 None] Created reservations ['f10c0253-5858-43e2-ab03-314a99967f34', '8d2e1d8d-44de-44f4-8b39-e1a4f483586d', 'f8051ee1-a100-406d-813d-025b2aff9f0e', '65b09683-5d71-45a4-a0ac-8ec8bbd4094c'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:13:44.259963 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8a2c9fc5-e64d-4906-9755-bceab1a8a844 tempest-VolumesBackupsTest-2013611801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:44.306391 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8a2c9fc5-e64d-4906-9755-bceab1a8a844 tempest-VolumesBackupsTest-2013611801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:44.358187 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-8a2c9fc5-e64d-4906-9755-bceab1a8a844 tempest-VolumesBackupsTest-2013611801 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:13:44.367171 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-8a2c9fc5-e64d-4906-9755-bceab1a8a844 tempest-VolumesBackupsTest-2013611801 None] Deleted volume successfully. Jan 29 21:13:44.387170 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-8a2c9fc5-e64d-4906-9755-bceab1a8a844 tempest-VolumesBackupsTest-2013611801 None] Lock "b'cinder-9723b5a7-1252-49d7-b3f1-ae5426460e67-delete_volume'" released by "delete_volume" :: held 2.428s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:13:47.542837 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:13:47.551187 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:13:47.552249 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:13:47.574842 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Flow 'volume_create_manager' (4f22fa30-1c42-4b65-8d2f-ebd912fe613a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:13:47.581651 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfed2db0-26a8-4919-968b-64b61233f240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:47.589212 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:13:47.615007 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfed2db0-26a8-4919-968b-64b61233f240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-1524618510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=92971f7d-729a-472f-a613-4eb09fc0961e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07cef8983ba8460d95867e59daf580ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:13:48Z,use_quota=True,user_id='2301aaeb4893419a937bd862f7f5eab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:47.621012 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad014a8a-1c6c-4902-b152-d080ae14ee7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:47.625331 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad014a8a-1c6c-4902-b152-d080ae14ee7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:47.631174 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc59870a-8e65-43a5-bcc3-78da47f645c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:47.635759 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc59870a-8e65-43a5-bcc3-78da47f645c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92971f7d-729a-472f-a613-4eb09fc0961e', 'volume_name': 'volume-92971f7d-729a-472f-a613-4eb09fc0961e', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:47.640889 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74314d08-e7f9-4016-abf0-f542c596325c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:47.645935 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74314d08-e7f9-4016-abf0-f542c596325c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:47.650753 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a2ec3e-dbe1-4cb0-8d38-142534c57114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:47.651943 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Volume 92971f7d-729a-472f-a613-4eb09fc0961e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92971f7d-729a-472f-a613-4eb09fc0961e', 'volume_size': 1} Jan 29 21:13:47.652403 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] creating volume 'volume-92971f7d-729a-472f-a613-4eb09fc0961e' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:13:47.653482 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:47.727268 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:13:47.727633 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:13:47.731409 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a2ec3e-dbe1-4cb0-8d38-142534c57114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92971f7d-729a-472f-a613-4eb09fc0961e', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:47.736008 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7117d2-65b1-4c05-9a70-6f58bdeddf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:47.750634 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Volume volume-92971f7d-729a-472f-a613-4eb09fc0961e (92971f7d-729a-472f-a613-4eb09fc0961e): created successfully Jan 29 21:13:47.756098 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7117d2-65b1-4c05-9a70-6f58bdeddf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:47.761967 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Flow 'volume_create_manager' (4f22fa30-1c42-4b65-8d2f-ebd912fe613a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:13:47.770235 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9df799e5-ccb7-4b59-aeeb-c95d32535f9b tempest-VolumesBackupsV39Test-648724410 None] Created volume successfully. Jan 29 21:13:48.926572 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-9122f769-939c-4fa9-a9e2-02ce59c99c41 tempest-VolumesBackupsV39Test-648724410 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:13:49.648931 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-9122f769-939c-4fa9-a9e2-02ce59c99c41 tempest-VolumesBackupsV39Test-648724410 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.722s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:13:49.650041 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9122f769-939c-4fa9-a9e2-02ce59c99c41 tempest-VolumesBackupsV39Test-648724410 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-92971f7d-729a-472f-a613-4eb09fc0961e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '92971f7d-729a-472f-a613-4eb09fc0961e', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:13:49.669682 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9122f769-939c-4fa9-a9e2-02ce59c99c41 tempest-VolumesBackupsV39Test-648724410 None] Initialize volume connection completed successfully. Jan 29 21:13:51.939752 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9122f769-939c-4fa9-a9e2-02ce59c99c41 tempest-VolumesBackupsV39Test-648724410 None] Terminate volume connection completed successfully. Jan 29 21:13:52.001572 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9122f769-939c-4fa9-a9e2-02ce59c99c41 tempest-VolumesBackupsV39Test-648724410 None] Remove volume export completed successfully. Jan 29 21:13:53.810030 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4a536b39-0b0a-4fdf-a414-3146a3331525 tempest-GroupsTest-947446246 None] Group tempest-Group1-767917092: creating Jan 29 21:13:53.826398 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4a536b39-0b0a-4fdf-a414-3146a3331525 tempest-GroupsTest-947446246 None] Group tempest-Group1-767917092: created successfully Jan 29 21:13:53.835577 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4a536b39-0b0a-4fdf-a414-3146a3331525 tempest-GroupsTest-947446246 None] Create group completed successfully. Jan 29 21:13:54.117776 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-9e77726c-b61b-4c8c-bc62-57e40d866509 tempest-VolumesBackupsV39Test-648724410 None] Lock "b'cinder-92971f7d-729a-472f-a613-4eb09fc0961e-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:13:54.153307 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9e77726c-b61b-4c8c-bc62-57e40d866509 tempest-VolumesBackupsV39Test-648724410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:54.771076 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9e77726c-b61b-4c8c-bc62-57e40d866509 tempest-VolumesBackupsV39Test-648724410 None] Volume volume-92971f7d-729a-472f-a613-4eb09fc0961e is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:13:54.780766 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9e77726c-b61b-4c8c-bc62-57e40d866509 tempest-VolumesBackupsV39Test-648724410 None] deleting rbd volume volume-92971f7d-729a-472f-a613-4eb09fc0961e {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:13:54.967330 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-0660ba3e-b8ae-4c6e-b2fd-428349a44db7 tempest-GroupsTest-947446246 None] Group tempest-Group2-1613067913: creating Jan 29 21:13:54.977937 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-9e77726c-b61b-4c8c-bc62-57e40d866509 tempest-VolumesBackupsV39Test-648724410 None] Created reservations ['192dc7fb-d223-4fd5-86dc-1840bd94b49d', '4dc1a750-cb2e-4c5b-ab2a-78ac6e4873ca', 'a70e3d97-bc56-4af6-b2fe-ce6c91a5e612', '1f51d622-f06e-49c3-a16a-e6b01f5cd791'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:13:54.995167 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-0660ba3e-b8ae-4c6e-b2fd-428349a44db7 tempest-GroupsTest-947446246 None] Group tempest-Group2-1613067913: created successfully Jan 29 21:13:55.004766 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-0660ba3e-b8ae-4c6e-b2fd-428349a44db7 tempest-GroupsTest-947446246 None] Create group completed successfully. Jan 29 21:13:55.026436 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9e77726c-b61b-4c8c-bc62-57e40d866509 tempest-VolumesBackupsV39Test-648724410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:55.049282 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9e77726c-b61b-4c8c-bc62-57e40d866509 tempest-VolumesBackupsV39Test-648724410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:55.072138 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-9e77726c-b61b-4c8c-bc62-57e40d866509 tempest-VolumesBackupsV39Test-648724410 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:13:55.076114 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9e77726c-b61b-4c8c-bc62-57e40d866509 tempest-VolumesBackupsV39Test-648724410 None] Deleted volume successfully. Jan 29 21:13:55.087443 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-9e77726c-b61b-4c8c-bc62-57e40d866509 tempest-VolumesBackupsV39Test-648724410 None] Lock "b'cinder-92971f7d-729a-472f-a613-4eb09fc0961e-delete_volume'" released by "delete_volume" :: held 0.970s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:13:56.353258 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:13:56.357105 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:13:56.357628 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:13:56.377485 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Flow 'volume_create_manager' (05532f2e-f64e-439c-bbf9-e5efd775d0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:13:56.384076 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e62fdd-14a0-424e-9180-fec3dd0ae148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:56.390523 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:13:56.405146 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e62fdd-14a0-424e-9180-fec3dd0ae148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1167834791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41e907b3-83ab-43d3-b7fc-c390dc4aed79,host='ncdv-master-1@ceph#ceph',id=ac96431a-2b80-45e0-9e7a-0011e8ccd220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f44eca3d18e4991bfc1b7b0e458e095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:13:56Z,use_quota=True,user_id='f00fdb0e996d4e64856877d38ecd769a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63819c0a-902b-4aef-9980-dca0f70b7e2a),volume_type_id=63819c0a-902b-4aef-9980-dca0f70b7e2a)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:56.411120 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b81878-dd5c-4d1e-83c7-850bc9cb0388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:56.415654 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b81878-dd5c-4d1e-83c7-850bc9cb0388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:56.420814 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfa5c1e-fc8a-4d8c-bc72-c7adf00838c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:56.425313 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfa5c1e-fc8a-4d8c-bc72-c7adf00838c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac96431a-2b80-45e0-9e7a-0011e8ccd220', 'volume_name': 'volume-ac96431a-2b80-45e0-9e7a-0011e8ccd220', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:56.431064 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c8f4a8-004a-4ed0-9e69-8289befe153c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:56.435179 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c8f4a8-004a-4ed0-9e69-8289befe153c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:56.439985 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe74f702-5876-4bc3-98a9-d4e45970da16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:56.441157 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Volume ac96431a-2b80-45e0-9e7a-0011e8ccd220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac96431a-2b80-45e0-9e7a-0011e8ccd220', 'volume_size': 1} Jan 29 21:13:56.441551 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] creating volume 'volume-ac96431a-2b80-45e0-9e7a-0011e8ccd220' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:13:56.442526 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:56.494558 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] extra_specs: {} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:13:56.495110 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] extra_specs: {} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:13:56.498950 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe74f702-5876-4bc3-98a9-d4e45970da16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac96431a-2b80-45e0-9e7a-0011e8ccd220', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:56.503878 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebcfd20-95a5-4b15-9b16-79b86fc9a040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:56.513465 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Volume volume-ac96431a-2b80-45e0-9e7a-0011e8ccd220 (ac96431a-2b80-45e0-9e7a-0011e8ccd220): created successfully Jan 29 21:13:56.517143 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebcfd20-95a5-4b15-9b16-79b86fc9a040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:56.522727 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Flow 'volume_create_manager' (05532f2e-f64e-439c-bbf9-e5efd775d0db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:13:56.530535 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6c7da79e-763e-4391-a539-3635d0a9de83 tempest-GroupsTest-947446246 None] Created volume successfully. Jan 29 21:13:56.967469 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:13:56.970578 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:13:56.971015 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:13:56.989806 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Flow 'volume_create_manager' (58126e9b-55e1-4684-a895-b7bed079571a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:13:56.996660 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b66fad-9d16-4ae9-9bd6-b6bc3c1b4603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:57.002853 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:13:57.016438 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b66fad-9d16-4ae9-9bd6-b6bc3c1b4603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-797208674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4a35cf24-abf2-405d-9357-94682a8af6b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14b75a3a6b5407a9bd03e7e8ab3774f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:13:57Z,use_quota=True,user_id='7fecd86ffb3e40b8af7c12aafe38127b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:57.022425 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d04c07-d593-4e77-b932-cf3b90f8d1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:57.026561 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d04c07-d593-4e77-b932-cf3b90f8d1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:57.031674 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cc9e23-7ee0-4688-b430-818188e99e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:57.108803 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cc9e23-7ee0-4688-b430-818188e99e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a35cf24-abf2-405d-9357-94682a8af6b8', 'volume_name': 'volume-4a35cf24-abf2-405d-9357-94682a8af6b8', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:57.113734 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7273e00-1489-4e29-93fb-b4eb2399900b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:57.117759 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7273e00-1489-4e29-93fb-b4eb2399900b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:57.122443 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bf59b8-e4ff-4d89-b3f1-e0cd6e78f065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:57.123536 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Volume 4a35cf24-abf2-405d-9357-94682a8af6b8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a35cf24-abf2-405d-9357-94682a8af6b8', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 21:13:57.124094 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Cloning 4a35cf24-abf2-405d-9357-94682a8af6b8 from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 21:13:57.132336 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:13:57.142922 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 13, 57, 137180)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:13:57.143516 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:13:57.144734 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Found cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 29 21:13:57.149904 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:13:57.150794 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 21:13:57.156023 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 13, 57, 153956)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:13:57.156430 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:13:57.156807 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Creating from source image-volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 29 21:13:57.167617 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:57.219093 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] creating snapshot='volume-4a35cf24-abf2-405d-9357-94682a8af6b8.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 21:13:57.968923 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] cloning 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe@volume-4a35cf24-abf2-405d-9357-94682a8af6b8.clone_snap' to 'volume-4a35cf24-abf2-405d-9357-94682a8af6b8' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 21:13:57.997747 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a2ae7a3-f802-48a6-ac68-31091730ec43 tempest-GroupsTest-947446246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:58.037050 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a2ae7a3-f802-48a6-ac68-31091730ec43 tempest-GroupsTest-947446246 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:13:58.037591 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a2ae7a3-f802-48a6-ac68-31091730ec43 tempest-GroupsTest-947446246 None] Volume volume-ac96431a-2b80-45e0-9e7a-0011e8ccd220 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:13:58.041832 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a2ae7a3-f802-48a6-ac68-31091730ec43 tempest-GroupsTest-947446246 None] deleting rbd volume volume-ac96431a-2b80-45e0-9e7a-0011e8ccd220 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:13:58.090961 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:13:58.091973 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:13:58.092346 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:13:58.111091 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 21:13:58.111716 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Marking volume 4a35cf24-abf2-405d-9357-94682a8af6b8 as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 21:13:58.120692 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to 4a35cf24-abf2-405d-9357-94682a8af6b8. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 21:13:58.121239 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Creating volume glance metadata for volume 4a35cf24-abf2-405d-9357-94682a8af6b8 backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 21:13:58.170580 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bf59b8-e4ff-4d89-b3f1-e0cd6e78f065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a35cf24-abf2-405d-9357-94682a8af6b8', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:58.176206 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1003f1-39fd-4ca0-86ba-bc6959d56248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:58.190714 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Volume volume-4a35cf24-abf2-405d-9357-94682a8af6b8 (4a35cf24-abf2-405d-9357-94682a8af6b8): created successfully Jan 29 21:13:58.194395 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1003f1-39fd-4ca0-86ba-bc6959d56248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:58.199893 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Flow 'volume_create_manager' (58126e9b-55e1-4684-a895-b7bed079571a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:13:58.214452 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-56974d44-0f9f-43c1-9fa0-b46812444a1b tempest-VolumesCloneTest-1603377700 None] Created volume successfully. Jan 29 21:13:58.236681 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-3a2ae7a3-f802-48a6-ac68-31091730ec43 tempest-GroupsTest-947446246 None] Created reservations ['afc56f6f-f51f-4699-a285-842949144605'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:13:58.252138 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-3a2ae7a3-f802-48a6-ac68-31091730ec43 tempest-GroupsTest-947446246 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-938934600 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-938934600, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:13:58.252929 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-3a2ae7a3-f802-48a6-ac68-31091730ec43 tempest-GroupsTest-947446246 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-938934600 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-938934600, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:13:58.264893 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-3a2ae7a3-f802-48a6-ac68-31091730ec43 tempest-GroupsTest-947446246 None] Created reservations ['33bff496-5c72-4cba-90c0-827c57202049', '9cf8ef3c-120a-45cf-a617-8b5f75ec64c2', '66f3d47e-561d-4807-bfd0-c2d718dd09d0', '6ff910af-ed19-44f3-b321-bf70a5c452dd'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:13:58.330675 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a2ae7a3-f802-48a6-ac68-31091730ec43 tempest-GroupsTest-947446246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:58.353365 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3a2ae7a3-f802-48a6-ac68-31091730ec43 tempest-GroupsTest-947446246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:58.375306 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-3a2ae7a3-f802-48a6-ac68-31091730ec43 tempest-GroupsTest-947446246 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:13:58.379212 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-3a2ae7a3-f802-48a6-ac68-31091730ec43 tempest-GroupsTest-947446246 None] Delete group completed successfully. Jan 29 21:13:58.957884 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-8c561358-eb56-466b-af7a-47f6b1acf2fe tempest-GroupsTest-947446246 None] Created reservations ['47104aa1-e330-4c9e-adb0-5774e7f5998d'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:13:58.989903 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8c561358-eb56-466b-af7a-47f6b1acf2fe tempest-GroupsTest-947446246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:59.020405 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8c561358-eb56-466b-af7a-47f6b1acf2fe tempest-GroupsTest-947446246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:59.048187 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-8c561358-eb56-466b-af7a-47f6b1acf2fe tempest-GroupsTest-947446246 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:13:59.053409 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-8c561358-eb56-466b-af7a-47f6b1acf2fe tempest-GroupsTest-947446246 None] Delete group completed successfully. Jan 29 21:13:59.495026 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:13:59.498454 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:13:59.498876 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:13:59.528206 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Flow 'volume_create_manager' (360e98f8-2997-4464-8b3d-2206c545850a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:13:59.534787 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd77805d-f31c-445b-ab91-04f2fa0fe692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:59.542211 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:13:59.556620 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd77805d-f31c-445b-ab91-04f2fa0fe692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1993202483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e046ab6d-48ad-4d02-a532-0c9294dc9952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14b75a3a6b5407a9bd03e7e8ab3774f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4a35cf24-abf2-405d-9357-94682a8af6b8,status='creating',terminated_at=None,updated_at=2022-01-29T21:13:59Z,use_quota=True,user_id='7fecd86ffb3e40b8af7c12aafe38127b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:59.562101 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6e9530-959d-49fd-9f5a-916d08d9cbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:59.566783 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6e9530-959d-49fd-9f5a-916d08d9cbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:59.572030 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71aa4e5c-db3a-4c0a-905e-28f5f269b833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:59.587880 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71aa4e5c-db3a-4c0a-905e-28f5f269b833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e046ab6d-48ad-4d02-a532-0c9294dc9952', 'volume_name': 'volume-e046ab6d-48ad-4d02-a532-0c9294dc9952', 'volume_size': 1, 'source_volid': '4a35cf24-abf2-405d-9357-94682a8af6b8', 'source_volstatus': 'available'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:59.592915 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c20a3ae-9c4b-4bbf-814b-f4f29d4978f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:59.597039 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c20a3ae-9c4b-4bbf-814b-f4f29d4978f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:13:59.601870 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafc60c6-623b-42cb-bc15-11b5699280ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:13:59.602961 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Volume e046ab6d-48ad-4d02-a532-0c9294dc9952: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e046ab6d-48ad-4d02-a532-0c9294dc9952', 'volume_size': 1, 'source_volid': '4a35cf24-abf2-405d-9357-94682a8af6b8', 'source_volstatus': 'available'} Jan 29 21:13:59.613730 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:13:59.672275 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] creating snapshot='volume-e046ab6d-48ad-4d02-a532-0c9294dc9952.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 21:13:59.986524 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] cloning 'volume-4a35cf24-abf2-405d-9357-94682a8af6b8@volume-e046ab6d-48ad-4d02-a532-0c9294dc9952.clone_snap' to 'volume-e046ab6d-48ad-4d02-a532-0c9294dc9952' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 21:14:00.154335 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:14:00.155939 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:14:00.156378 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:14:00.172227 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 21:14:00.172888 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Marking volume e046ab6d-48ad-4d02-a532-0c9294dc9952 as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 21:14:00.185798 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Copying metadata from source volume 4a35cf24-abf2-405d-9357-94682a8af6b8 to e046ab6d-48ad-4d02-a532-0c9294dc9952. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Jan 29 21:14:00.216403 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafc60c6-623b-42cb-bc15-11b5699280ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e046ab6d-48ad-4d02-a532-0c9294dc9952', 'volume_size': 1, 'source_volid': '4a35cf24-abf2-405d-9357-94682a8af6b8', 'source_volstatus': 'available'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:00.221585 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78facd0-22d4-4849-b412-ba5b2dd34b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:00.231097 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Volume volume-e046ab6d-48ad-4d02-a532-0c9294dc9952 (e046ab6d-48ad-4d02-a532-0c9294dc9952): created successfully Jan 29 21:14:00.235346 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78facd0-22d4-4849-b412-ba5b2dd34b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:00.241656 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Flow 'volume_create_manager' (360e98f8-2997-4464-8b3d-2206c545850a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:00.254306 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f25b466e-a053-4d8f-a164-aacdee5096d4 tempest-VolumesCloneTest-1603377700 None] Created volume successfully. Jan 29 21:14:00.377313 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-025eda33-add1-4e71-8ba2-e76fc346ff65 tempest-GroupsTest-947446246 None] Group tempest-GroupsTest-Group-1320858736: creating Jan 29 21:14:00.392498 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-025eda33-add1-4e71-8ba2-e76fc346ff65 tempest-GroupsTest-947446246 None] Group tempest-GroupsTest-Group-1320858736: created successfully Jan 29 21:14:00.401097 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-025eda33-add1-4e71-8ba2-e76fc346ff65 tempest-GroupsTest-947446246 None] Create group completed successfully. Jan 29 21:14:00.825696 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:14:00.828866 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:14:00.829354 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:14:00.848492 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Flow 'volume_create_manager' (28707fa4-63ed-48a4-916b-a57cdf17ebfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:00.855019 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f085fd-b7e5-4f13-acc4-3862a987773a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:00.861217 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:14:00.875374 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f085fd-b7e5-4f13-acc4-3862a987773a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1832791931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1596eb41-4961-414a-bd5f-94b9d457e351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14b75a3a6b5407a9bd03e7e8ab3774f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:14:01Z,use_quota=True,user_id='7fecd86ffb3e40b8af7c12aafe38127b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:00.880810 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e3ea83-e5d5-480c-b04e-fa24ab305067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:00.884961 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e3ea83-e5d5-480c-b04e-fa24ab305067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:00.890134 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1015f1d-3a6c-4ea7-9256-54bd36b3e4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:00.894341 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1015f1d-3a6c-4ea7-9256-54bd36b3e4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1596eb41-4961-414a-bd5f-94b9d457e351', 'volume_name': 'volume-1596eb41-4961-414a-bd5f-94b9d457e351', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:00.899279 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e59086f-d9bf-4c6e-89a2-a1cf57e02260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:00.903309 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e59086f-d9bf-4c6e-89a2-a1cf57e02260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:00.908064 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc85fad8-7fd1-4cdd-962a-68b66d9f9835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:00.909161 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Volume 1596eb41-4961-414a-bd5f-94b9d457e351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1596eb41-4961-414a-bd5f-94b9d457e351', 'volume_size': 1} Jan 29 21:14:00.909551 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] creating volume 'volume-1596eb41-4961-414a-bd5f-94b9d457e351' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:14:00.911065 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:00.955235 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:14:00.955610 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:14:00.959357 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc85fad8-7fd1-4cdd-962a-68b66d9f9835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1596eb41-4961-414a-bd5f-94b9d457e351', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:00.964284 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfc514d-efc1-4b47-8f4e-974fa0eec3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:00.973722 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Volume volume-1596eb41-4961-414a-bd5f-94b9d457e351 (1596eb41-4961-414a-bd5f-94b9d457e351): created successfully Jan 29 21:14:00.977249 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfc514d-efc1-4b47-8f4e-974fa0eec3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:00.982661 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Flow 'volume_create_manager' (28707fa4-63ed-48a4-916b-a57cdf17ebfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:00.990892 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-db4f5480-e311-4fff-8fb3-d694290a7732 tempest-VolumesCloneTest-1603377700 None] Created volume successfully. Jan 29 21:14:01.727753 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:14:01.730937 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:14:01.731374 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:14:01.750968 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Flow 'volume_create_manager' (e9b5cb49-9ca0-4bd4-9863-224473623588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:01.758276 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4441a6ee-0ba3-4da0-b11b-b53ae2e06d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:01.764507 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:14:01.778905 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4441a6ee-0ba3-4da0-b11b-b53ae2e06d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-582675161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08218eb7-0507-44c4-8c53-d832379bd2a0,host='ncdv-master-1@ceph#ceph',id=a45346c4-88c1-4a48-a920-c9f57c87f3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f44eca3d18e4991bfc1b7b0e458e095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:14:02Z,use_quota=True,user_id='f00fdb0e996d4e64856877d38ecd769a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7733416-9a96-4894-af1d-6813e3286270),volume_type_id=e7733416-9a96-4894-af1d-6813e3286270)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:01.784528 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338c1ebe-77c1-4fab-b53d-d0232f598df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:01.788633 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338c1ebe-77c1-4fab-b53d-d0232f598df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:01.793818 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ebf71f-e054-4142-82e6-f45964c39d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:01.798036 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ebf71f-e054-4142-82e6-f45964c39d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a45346c4-88c1-4a48-a920-c9f57c87f3f0', 'volume_name': 'volume-a45346c4-88c1-4a48-a920-c9f57c87f3f0', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:01.803288 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc75cc3e-c9bc-4f68-b0ad-26554d034da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:01.807327 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc75cc3e-c9bc-4f68-b0ad-26554d034da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:01.812091 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a646ba25-7ad8-4d5f-89b8-8a49412e9b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:01.813247 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Volume a45346c4-88c1-4a48-a920-c9f57c87f3f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a45346c4-88c1-4a48-a920-c9f57c87f3f0', 'volume_size': 1} Jan 29 21:14:01.813640 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] creating volume 'volume-a45346c4-88c1-4a48-a920-c9f57c87f3f0' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:14:01.814618 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:01.862054 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] extra_specs: {} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:14:01.862425 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] extra_specs: {} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:14:01.866249 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a646ba25-7ad8-4d5f-89b8-8a49412e9b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a45346c4-88c1-4a48-a920-c9f57c87f3f0', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:01.871088 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a2e276-ad80-4538-8e2d-687f7d6b7182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:01.880649 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Volume volume-a45346c4-88c1-4a48-a920-c9f57c87f3f0 (a45346c4-88c1-4a48-a920-c9f57c87f3f0): created successfully Jan 29 21:14:01.884289 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a2e276-ad80-4538-8e2d-687f7d6b7182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:01.889711 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Flow 'volume_create_manager' (e9b5cb49-9ca0-4bd4-9863-224473623588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:01.897814 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-17767691-c846-48d2-b28f-a63bcd0b96bb tempest-GroupsTest-947446246 None] Created volume successfully. Jan 29 21:14:02.170044 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:14:02.173195 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:14:02.173638 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:14:02.201722 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Flow 'volume_create_manager' (351e8dcc-215c-4add-b984-a55c183175f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:02.208249 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115596f9-125e-4f16-b6f2-5cf485a86ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:02.214464 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:14:02.228566 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115596f9-125e-4f16-b6f2-5cf485a86ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-560880389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6ac29331-2131-4e4a-9162-8bb74e526adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14b75a3a6b5407a9bd03e7e8ab3774f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:14:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1596eb41-4961-414a-bd5f-94b9d457e351,status='creating',terminated_at=None,updated_at=2022-01-29T21:14:02Z,use_quota=True,user_id='7fecd86ffb3e40b8af7c12aafe38127b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:02.234047 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007d6db9-9544-4d5f-80c7-bc4933397698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:02.238278 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007d6db9-9544-4d5f-80c7-bc4933397698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:02.243986 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e322d9fd-6179-4390-8a3c-bcf7ca72f3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:02.259332 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e322d9fd-6179-4390-8a3c-bcf7ca72f3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6ac29331-2131-4e4a-9162-8bb74e526adb', 'volume_name': 'volume-6ac29331-2131-4e4a-9162-8bb74e526adb', 'volume_size': 2, 'source_volid': '1596eb41-4961-414a-bd5f-94b9d457e351', 'source_volstatus': 'available'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:02.264724 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e65b17a-41aa-4b69-8936-619b780eae3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:02.268808 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e65b17a-41aa-4b69-8936-619b780eae3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:02.273679 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3b7210-5904-4fbb-aa93-38bec5c6c684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:02.274757 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Volume 6ac29331-2131-4e4a-9162-8bb74e526adb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6ac29331-2131-4e4a-9162-8bb74e526adb', 'volume_size': 2, 'source_volid': '1596eb41-4961-414a-bd5f-94b9d457e351', 'source_volstatus': 'available'} Jan 29 21:14:02.285222 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:02.320288 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] creating snapshot='volume-6ac29331-2131-4e4a-9162-8bb74e526adb.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 21:14:03.006069 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] cloning 'volume-1596eb41-4961-414a-bd5f-94b9d457e351@volume-6ac29331-2131-4e4a-9162-8bb74e526adb.clone_snap' to 'volume-6ac29331-2131-4e4a-9162-8bb74e526adb' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 21:14:03.110693 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Volume volume-1596eb41-4961-414a-bd5f-94b9d457e351 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:14:03.115290 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:14:03.115690 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:14:03.127525 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] resize volume 'volume-6ac29331-2131-4e4a-9162-8bb74e526adb' from 1 to 2 {{(pid=134283) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:694}} Jan 29 21:14:03.128201 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:03.201601 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:14:03.205090 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:14:03.205628 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:14:03.224849 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Flow 'volume_create_manager' (cee6ad83-8817-463d-a6f7-84aaddbe02a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:03.231840 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ccf9ab-d98b-4857-a909-8ed9fa59f808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:03.239531 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:14:03.260975 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 21:14:03.264797 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3b7210-5904-4fbb-aa93-38bec5c6c684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac29331-2131-4e4a-9162-8bb74e526adb', 'volume_size': 2, 'source_volid': '1596eb41-4961-414a-bd5f-94b9d457e351', 'source_volstatus': 'available'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:03.269510 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730dd98d-8d76-4dd9-9f06-b566b49376ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:03.277972 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ccf9ab-d98b-4857-a909-8ed9fa59f808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-634149547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08218eb7-0507-44c4-8c53-d832379bd2a0,host='ncdv-master-1@ceph#ceph',id=1fe416b8-eb69-4f7e-bd55-136e5afd0077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f44eca3d18e4991bfc1b7b0e458e095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:14:03Z,use_quota=True,user_id='f00fdb0e996d4e64856877d38ecd769a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7733416-9a96-4894-af1d-6813e3286270),volume_type_id=e7733416-9a96-4894-af1d-6813e3286270)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:03.283427 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff050842-110a-4925-b7d2-1fc58264ff4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:03.288134 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff050842-110a-4925-b7d2-1fc58264ff4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:03.293402 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6feb3057-c9db-474d-8320-b008e8b5816e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:03.297644 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6feb3057-c9db-474d-8320-b008e8b5816e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe416b8-eb69-4f7e-bd55-136e5afd0077', 'volume_name': 'volume-1fe416b8-eb69-4f7e-bd55-136e5afd0077', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:03.303567 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f14d38-6abc-4a3e-8f6a-496b53f0717d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:03.307636 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f14d38-6abc-4a3e-8f6a-496b53f0717d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:03.312452 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d982c9b4-55e2-4756-8cc6-cc5c8e67c7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:03.313592 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Volume 1fe416b8-eb69-4f7e-bd55-136e5afd0077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe416b8-eb69-4f7e-bd55-136e5afd0077', 'volume_size': 1} Jan 29 21:14:03.313982 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] creating volume 'volume-1fe416b8-eb69-4f7e-bd55-136e5afd0077' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:14:03.314945 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:03.341452 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Volume volume-6ac29331-2131-4e4a-9162-8bb74e526adb (6ac29331-2131-4e4a-9162-8bb74e526adb): created successfully Jan 29 21:14:03.346802 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730dd98d-8d76-4dd9-9f06-b566b49376ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:03.354227 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Flow 'volume_create_manager' (351e8dcc-215c-4add-b984-a55c183175f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:03.360519 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] extra_specs: {} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:14:03.360892 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] extra_specs: {} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:14:03.365365 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d982c9b4-55e2-4756-8cc6-cc5c8e67c7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe416b8-eb69-4f7e-bd55-136e5afd0077', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:03.369987 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbdc2f57-7a5e-4649-a04c-eec8600376a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:03.381985 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Volume volume-1fe416b8-eb69-4f7e-bd55-136e5afd0077 (1fe416b8-eb69-4f7e-bd55-136e5afd0077): created successfully Jan 29 21:14:03.385529 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbdc2f57-7a5e-4649-a04c-eec8600376a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:03.390966 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Flow 'volume_create_manager' (cee6ad83-8817-463d-a6f7-84aaddbe02a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:03.395141 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-7e26b7c4-c78f-4167-8220-b0150de32a27 tempest-VolumesCloneTest-1603377700 None] Created volume successfully. Jan 29 21:14:03.401226 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-11d49912-a141-4c3c-914d-e94e3f95d1a0 tempest-GroupsTest-947446246 None] Created volume successfully. Jan 29 21:14:04.257492 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9ae08152-e5f1-43b9-b028-a8387eec5a2c tempest-GroupsTest-947446246 None] Update group completed successfully. Jan 29 21:14:04.343498 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-dce8ed64-56c3-44d2-82a9-6023558c7d66 tempest-VolumesCloneTest-1603377700 None] Lock "b'cinder-6ac29331-2131-4e4a-9162-8bb74e526adb-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:04.373074 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dce8ed64-56c3-44d2-82a9-6023558c7d66 tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:04.419448 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dce8ed64-56c3-44d2-82a9-6023558c7d66 tempest-VolumesCloneTest-1603377700 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:14:04.424215 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dce8ed64-56c3-44d2-82a9-6023558c7d66 tempest-VolumesCloneTest-1603377700 None] deleting rbd volume volume-6ac29331-2131-4e4a-9162-8bb74e526adb {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:14:04.546564 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dce8ed64-56c3-44d2-82a9-6023558c7d66 tempest-VolumesCloneTest-1603377700 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 21:14:04.564950 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dce8ed64-56c3-44d2-82a9-6023558c7d66 tempest-VolumesCloneTest-1603377700 None] Volume volume-1596eb41-4961-414a-bd5f-94b9d457e351 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:14:04.565481 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dce8ed64-56c3-44d2-82a9-6023558c7d66 tempest-VolumesCloneTest-1603377700 None] deleting parent snapshot volume-6ac29331-2131-4e4a-9162-8bb74e526adb.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 21:14:05.053753 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-dce8ed64-56c3-44d2-82a9-6023558c7d66 tempest-VolumesCloneTest-1603377700 None] Created reservations ['58db82fd-309a-492f-8bc0-c372c384e7f1', '5e7dc2b9-6534-44f6-9f4b-d1db4f17855e', '0ab79371-2637-400a-bdad-f20edfa0bc1c', '8da42bc7-9de2-423f-8d51-d8b80f4f2e77'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:05.092670 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dce8ed64-56c3-44d2-82a9-6023558c7d66 tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:05.114742 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dce8ed64-56c3-44d2-82a9-6023558c7d66 tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:05.136456 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-dce8ed64-56c3-44d2-82a9-6023558c7d66 tempest-VolumesCloneTest-1603377700 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:14:05.140301 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-dce8ed64-56c3-44d2-82a9-6023558c7d66 tempest-VolumesCloneTest-1603377700 None] Deleted volume successfully. Jan 29 21:14:05.152385 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-dce8ed64-56c3-44d2-82a9-6023558c7d66 tempest-VolumesCloneTest-1603377700 None] Lock "b'cinder-6ac29331-2131-4e4a-9162-8bb74e526adb-delete_volume'" released by "delete_volume" :: held 0.809s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:05.461974 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-420c25b5-3e9c-4351-9e48-42570742f3e2 tempest-VolumesCloneTest-1603377700 None] Lock "b'cinder-1596eb41-4961-414a-bd5f-94b9d457e351-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:05.519563 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-420c25b5-3e9c-4351-9e48-42570742f3e2 tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:05.556162 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-420c25b5-3e9c-4351-9e48-42570742f3e2 tempest-VolumesCloneTest-1603377700 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:14:05.556545 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-420c25b5-3e9c-4351-9e48-42570742f3e2 tempest-VolumesCloneTest-1603377700 None] Volume volume-1596eb41-4961-414a-bd5f-94b9d457e351 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:14:05.560527 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-420c25b5-3e9c-4351-9e48-42570742f3e2 tempest-VolumesCloneTest-1603377700 None] deleting rbd volume volume-1596eb41-4961-414a-bd5f-94b9d457e351 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:14:05.584123 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d7fc3196-b4b1-4d8d-a9a9-ded82b40a8a6 tempest-GroupsTest-947446246 None] Update group completed successfully. Jan 29 21:14:05.720568 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-420c25b5-3e9c-4351-9e48-42570742f3e2 tempest-VolumesCloneTest-1603377700 None] Created reservations ['0bdb95aa-708e-4c8c-8ddb-bf822d12ba26', 'daf1ccde-6fa2-4bad-8630-21f18e249ea9', '16f350c0-40fb-4c90-a189-c2b7070cd2d5', '0512f57d-ac9e-497a-8496-b3875f32ac70'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:05.761699 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-420c25b5-3e9c-4351-9e48-42570742f3e2 tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:05.784788 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-420c25b5-3e9c-4351-9e48-42570742f3e2 tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:05.819685 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-420c25b5-3e9c-4351-9e48-42570742f3e2 tempest-VolumesCloneTest-1603377700 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:14:05.824461 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-420c25b5-3e9c-4351-9e48-42570742f3e2 tempest-VolumesCloneTest-1603377700 None] Deleted volume successfully. Jan 29 21:14:05.837264 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-420c25b5-3e9c-4351-9e48-42570742f3e2 tempest-VolumesCloneTest-1603377700 None] Lock "b'cinder-1596eb41-4961-414a-bd5f-94b9d457e351-delete_volume'" released by "delete_volume" :: held 0.375s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:06.591731 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-557068d3-696a-4c41-a5db-f0887598e2aa tempest-VolumesCloneTest-1603377700 None] Lock "b'cinder-e046ab6d-48ad-4d02-a532-0c9294dc9952-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:06.629175 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-557068d3-696a-4c41-a5db-f0887598e2aa tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:06.703385 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-557068d3-696a-4c41-a5db-f0887598e2aa tempest-VolumesCloneTest-1603377700 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:14:06.710647 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-557068d3-696a-4c41-a5db-f0887598e2aa tempest-VolumesCloneTest-1603377700 None] deleting rbd volume volume-e046ab6d-48ad-4d02-a532-0c9294dc9952 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:14:06.882401 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-557068d3-696a-4c41-a5db-f0887598e2aa tempest-VolumesCloneTest-1603377700 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 21:14:06.937695 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-557068d3-696a-4c41-a5db-f0887598e2aa tempest-VolumesCloneTest-1603377700 None] deleting parent snapshot volume-e046ab6d-48ad-4d02-a532-0c9294dc9952.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 21:14:08.021854 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:08.056222 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:14:08.056647 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] Volume volume-1fe416b8-eb69-4f7e-bd55-136e5afd0077 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:14:08.060327 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] deleting rbd volume volume-1fe416b8-eb69-4f7e-bd55-136e5afd0077 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:14:08.077832 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-557068d3-696a-4c41-a5db-f0887598e2aa tempest-VolumesCloneTest-1603377700 None] Created reservations ['6727b0af-98b4-4b9a-9416-fd13dd104ad0', '96f80f53-58a8-4847-a3d2-64590b392db5', 'a45aa57c-a627-4744-813f-fd62650ff381', '84eb908e-b8cb-4230-b17b-e0f93b355c6a'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:08.119882 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-557068d3-696a-4c41-a5db-f0887598e2aa tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:08.144077 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-557068d3-696a-4c41-a5db-f0887598e2aa tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:08.169936 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-557068d3-696a-4c41-a5db-f0887598e2aa tempest-VolumesCloneTest-1603377700 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:14:08.174059 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-557068d3-696a-4c41-a5db-f0887598e2aa tempest-VolumesCloneTest-1603377700 None] Deleted volume successfully. Jan 29 21:14:08.187527 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-557068d3-696a-4c41-a5db-f0887598e2aa tempest-VolumesCloneTest-1603377700 None] Lock "b'cinder-e046ab6d-48ad-4d02-a532-0c9294dc9952-delete_volume'" released by "delete_volume" :: held 1.596s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:08.202602 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:08.239533 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:14:08.240033 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] Volume volume-a45346c4-88c1-4a48-a920-c9f57c87f3f0 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:14:08.243624 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] deleting rbd volume volume-a45346c4-88c1-4a48-a920-c9f57c87f3f0 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:14:08.411660 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] Created reservations ['7531c368-3386-4b9e-a711-fb0d594ec3ab'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:08.427844 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1416401266 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1416401266, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:14:08.428641 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1416401266 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1416401266, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:14:08.440804 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] Created reservations ['0089e825-07f9-4b53-9430-13670706f608', 'ddb024f1-0863-41d3-bd57-5724bb15d0fb', 'f9714740-0ae5-4afc-b836-80a6b29f7615', '7280e69b-0767-4584-bca8-5cf7c76d1a87'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:08.505472 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] Created reservations ['f56c87ca-021c-47e4-a77d-a9d9beb8676d', 'fdcfa54d-9a3c-47be-afc0-6d8dc2ee19ca', '1b939019-0194-4574-ae5c-140166073940', '7ca3e06a-1c6f-4448-8c2b-ad98073d1d73'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:08.570418 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:08.591857 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:08.614686 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:14:08.618379 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9b77ec3b-5ae9-45f2-9241-2c95582c912d tempest-GroupsTest-947446246 None] Delete group completed successfully. Jan 29 21:14:08.756685 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-c4f146e1-ede5-4602-af55-653287efceb6 tempest-VolumesCloneTest-1603377700 None] Lock "b'cinder-4a35cf24-abf2-405d-9357-94682a8af6b8-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:08.787964 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c4f146e1-ede5-4602-af55-653287efceb6 tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:08.845769 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c4f146e1-ede5-4602-af55-653287efceb6 tempest-VolumesCloneTest-1603377700 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:14:08.851151 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c4f146e1-ede5-4602-af55-653287efceb6 tempest-VolumesCloneTest-1603377700 None] deleting rbd volume volume-4a35cf24-abf2-405d-9357-94682a8af6b8 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:14:08.972279 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c4f146e1-ede5-4602-af55-653287efceb6 tempest-VolumesCloneTest-1603377700 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 21:14:09.000177 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c4f146e1-ede5-4602-af55-653287efceb6 tempest-VolumesCloneTest-1603377700 None] deleting parent snapshot volume-4a35cf24-abf2-405d-9357-94682a8af6b8.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 21:14:10.016612 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-c4f146e1-ede5-4602-af55-653287efceb6 tempest-VolumesCloneTest-1603377700 None] Created reservations ['c233d00d-90e4-4871-8262-5cf317fc8996', 'fe93594b-b576-4c3b-aec4-c515bc9ff8d6', 'adf954f9-e4bf-4991-b7cf-4e5812792fc7', '23892941-f30a-4dfb-9913-55d3915bbe02'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:10.058202 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c4f146e1-ede5-4602-af55-653287efceb6 tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:10.081648 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c4f146e1-ede5-4602-af55-653287efceb6 tempest-VolumesCloneTest-1603377700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:10.105892 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-c4f146e1-ede5-4602-af55-653287efceb6 tempest-VolumesCloneTest-1603377700 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:14:10.110067 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-c4f146e1-ede5-4602-af55-653287efceb6 tempest-VolumesCloneTest-1603377700 None] Deleted volume successfully. Jan 29 21:14:10.121785 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-c4f146e1-ede5-4602-af55-653287efceb6 tempest-VolumesCloneTest-1603377700 None] Lock "b'cinder-4a35cf24-abf2-405d-9357-94682a8af6b8-delete_volume'" released by "delete_volume" :: held 1.365s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:12.086574 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:14:12.090266 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:14:12.090773 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:14:12.110239 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Flow 'volume_create_manager' (1f7dd6f2-5df9-4085-8b3f-f043c0e5596c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:12.116851 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681e3a6d-f98b-4b3e-9617-6d8ad138bd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:12.123303 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:14:12.137941 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681e3a6d-f98b-4b3e-9617-6d8ad138bd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1310956337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d8cd7d9c-a78d-49fb-90ce-a7c609636f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6333825180145da92c4dab49bac0446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:14:12Z,use_quota=True,user_id='adfebf3c24a74d73bd249a52c0fa0f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:12.143500 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6d27b4-d841-4699-8d6f-53732cde5316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:12.148223 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6d27b4-d841-4699-8d6f-53732cde5316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:12.153421 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd608c7d-b4ba-4834-a922-9b05ef34b721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:12.157691 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd608c7d-b4ba-4834-a922-9b05ef34b721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8cd7d9c-a78d-49fb-90ce-a7c609636f75', 'volume_name': 'volume-d8cd7d9c-a78d-49fb-90ce-a7c609636f75', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:12.162719 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ce3963-5c4d-44cc-a080-bee47e05c7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:12.166763 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ce3963-5c4d-44cc-a080-bee47e05c7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:12.171527 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3574c446-daee-4c9f-8c6d-002384d9fda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:12.172608 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Volume d8cd7d9c-a78d-49fb-90ce-a7c609636f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8cd7d9c-a78d-49fb-90ce-a7c609636f75', 'volume_size': 1} Jan 29 21:14:12.173020 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] creating volume 'volume-d8cd7d9c-a78d-49fb-90ce-a7c609636f75' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:14:12.174001 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:12.232673 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:14:12.233293 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:14:12.237089 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3574c446-daee-4c9f-8c6d-002384d9fda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8cd7d9c-a78d-49fb-90ce-a7c609636f75', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:12.241787 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07921b3-8c8d-4aaf-af63-db606bc84ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:12.250449 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Volume volume-d8cd7d9c-a78d-49fb-90ce-a7c609636f75 (d8cd7d9c-a78d-49fb-90ce-a7c609636f75): created successfully Jan 29 21:14:12.254357 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07921b3-8c8d-4aaf-af63-db606bc84ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:12.260354 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Flow 'volume_create_manager' (1f7dd6f2-5df9-4085-8b3f-f043c0e5596c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:12.267841 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-b0db3d7f-fe3d-44f2-9c1b-5ddec4c71fd3 tempest-VolumesBackupsAdminTest-936429362 None] Created volume successfully. Jan 29 21:14:13.363565 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-ccbd0e26-ed1b-4034-8103-a1d9e00fbf58 tempest-VolumesBackupsAdminTest-936429362 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:14:13.984413 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:14:13.989523 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:14:13.990215 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:14:14.010852 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Flow 'volume_create_manager' (9a286196-4eba-4459-8e52-6cdfd3dc8df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:14.017833 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2f0a1b-dd56-4033-a9f9-095a0b811bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:14.023076 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-ccbd0e26-ed1b-4034-8103-a1d9e00fbf58 tempest-VolumesBackupsAdminTest-936429362 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.660s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:14:14.023779 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ccbd0e26-ed1b-4034-8103-a1d9e00fbf58 tempest-VolumesBackupsAdminTest-936429362 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d8cd7d9c-a78d-49fb-90ce-a7c609636f75', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'd8cd7d9c-a78d-49fb-90ce-a7c609636f75', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:14:14.028483 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:14:14.046634 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2f0a1b-dd56-4033-a9f9-095a0b811bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1131772420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d45207b-a5a1-4c67-875a-3425b3d689da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c8d11b7b1f4b12b39e8deac62a726c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:14:14Z,use_quota=True,user_id='ed8d1bbd319f42399293e695f57f2a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:14.052804 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2fde5e-0fd5-438f-a7b3-ab557793168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:14.056909 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2fde5e-0fd5-438f-a7b3-ab557793168d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:14.061982 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e88fda-a704-4620-801c-1535d307060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:14.066155 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e88fda-a704-4620-801c-1535d307060d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d45207b-a5a1-4c67-875a-3425b3d689da', 'volume_name': 'volume-5d45207b-a5a1-4c67-875a-3425b3d689da', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:14.076035 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6891e2b-c7fa-4319-be35-aca27829e16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:14.080094 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6891e2b-c7fa-4319-be35-aca27829e16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:14.084799 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd6f94c-c16d-4270-b04b-09fea1a21906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:14.085892 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Volume 5d45207b-a5a1-4c67-875a-3425b3d689da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d45207b-a5a1-4c67-875a-3425b3d689da', 'volume_size': 1} Jan 29 21:14:14.086290 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] creating volume 'volume-5d45207b-a5a1-4c67-875a-3425b3d689da' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:14:14.087372 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:14.115768 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ccbd0e26-ed1b-4034-8103-a1d9e00fbf58 tempest-VolumesBackupsAdminTest-936429362 None] Initialize volume connection completed successfully. Jan 29 21:14:14.135810 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:14:14.136190 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:14:14.140126 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd6f94c-c16d-4270-b04b-09fea1a21906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d45207b-a5a1-4c67-875a-3425b3d689da', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:14.146103 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e53155-6c9e-4beb-bc36-3f59b3a426e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:14.160225 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Volume volume-5d45207b-a5a1-4c67-875a-3425b3d689da (5d45207b-a5a1-4c67-875a-3425b3d689da): created successfully Jan 29 21:14:14.164354 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e53155-6c9e-4beb-bc36-3f59b3a426e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:14.170187 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Flow 'volume_create_manager' (9a286196-4eba-4459-8e52-6cdfd3dc8df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:14.180800 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ee72cda5-5e22-4cd3-8739-3909e7dd9f54 tempest-VolumesNegativeTest-680436633 None] Created volume successfully. Jan 29 21:14:16.105597 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ccbd0e26-ed1b-4034-8103-a1d9e00fbf58 tempest-VolumesBackupsAdminTest-936429362 None] Terminate volume connection completed successfully. Jan 29 21:14:16.120243 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ccbd0e26-ed1b-4034-8103-a1d9e00fbf58 tempest-VolumesBackupsAdminTest-936429362 None] Remove volume export completed successfully. Jan 29 21:14:18.138767 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:14:18.142563 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:14:18.143063 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:14:18.164803 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Flow 'volume_create_manager' (49d6a875-c1ba-4f89-b833-d02433951c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:18.171394 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b80ee0-5e1a-4f2a-9a45-03d9d07e3b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:18.179589 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:14:18.193955 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b80ee0-5e1a-4f2a-9a45-03d9d07e3b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:14:18Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_3f51c3c7-6180-4fe7-a5af-64c3c501f14e',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=93eb89bc-d004-4e77-9222-3e4292575b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6333825180145da92c4dab49bac0446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:14:18Z,use_quota=True,user_id='adfebf3c24a74d73bd249a52c0fa0f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:18.200945 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88cddf9c-60a9-472e-8c77-19a0276f7593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:18.205191 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88cddf9c-60a9-472e-8c77-19a0276f7593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:18.210393 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97e786f-362e-4611-a441-8ed1e24c287a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:18.214660 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97e786f-362e-4611-a441-8ed1e24c287a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93eb89bc-d004-4e77-9222-3e4292575b20', 'volume_name': 'volume-93eb89bc-d004-4e77-9222-3e4292575b20', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:18.219693 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df22e456-0713-473f-8eff-e75953c2aae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:18.224266 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df22e456-0713-473f-8eff-e75953c2aae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:18.230051 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40aa2c86-0f24-4034-a901-81274369e69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:18.231149 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Volume 93eb89bc-d004-4e77-9222-3e4292575b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93eb89bc-d004-4e77-9222-3e4292575b20', 'volume_size': 1} Jan 29 21:14:18.231607 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] creating volume 'volume-93eb89bc-d004-4e77-9222-3e4292575b20' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:14:18.232622 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:18.290283 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:14:18.290697 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:14:18.294595 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40aa2c86-0f24-4034-a901-81274369e69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93eb89bc-d004-4e77-9222-3e4292575b20', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:18.299334 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49004ce9-ed5d-4bef-8764-542f97719a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:18.310063 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Volume volume-93eb89bc-d004-4e77-9222-3e4292575b20 (93eb89bc-d004-4e77-9222-3e4292575b20): created successfully Jan 29 21:14:18.313962 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49004ce9-ed5d-4bef-8764-542f97719a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:18.319730 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Flow 'volume_create_manager' (49d6a875-c1ba-4f89-b833-d02433951c08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:18.327855 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Created volume successfully. Jan 29 21:14:19.194251 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:14:19.846052 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.651s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:14:19.846761 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-93eb89bc-d004-4e77-9222-3e4292575b20', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '93eb89bc-d004-4e77-9222-3e4292575b20', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:14:19.861687 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Initialize volume connection completed successfully. Jan 29 21:14:21.208190 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Terminate volume connection completed successfully. Jan 29 21:14:21.226208 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ebdd4af3-347b-4595-9e4c-f5e1cdf7d92f tempest-VolumesBackupsAdminTest-936429362 None] Remove volume export completed successfully. Jan 29 21:14:22.375045 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-fe28a913-0d03-41c0-8519-28afe3b7a2c9 tempest-VolumesBackupsAdminTest-936429362 None] Lock "b'cinder-93eb89bc-d004-4e77-9222-3e4292575b20-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:22.408595 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fe28a913-0d03-41c0-8519-28afe3b7a2c9 tempest-VolumesBackupsAdminTest-936429362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:23.064944 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fe28a913-0d03-41c0-8519-28afe3b7a2c9 tempest-VolumesBackupsAdminTest-936429362 None] Volume volume-93eb89bc-d004-4e77-9222-3e4292575b20 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:14:23.080480 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fe28a913-0d03-41c0-8519-28afe3b7a2c9 tempest-VolumesBackupsAdminTest-936429362 None] deleting rbd volume volume-93eb89bc-d004-4e77-9222-3e4292575b20 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:14:23.236835 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-fe28a913-0d03-41c0-8519-28afe3b7a2c9 tempest-VolumesBackupsAdminTest-936429362 None] Created reservations ['db51f787-a6bf-4e96-8ade-893f3e344d09', '74414c40-f50e-4aa4-8845-dcd48c134182', '01e87a85-7f13-47f4-8002-4ac5d3f428a1', '96bae92e-a8ac-4f8c-bd97-6205b2668965'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:23.275337 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fe28a913-0d03-41c0-8519-28afe3b7a2c9 tempest-VolumesBackupsAdminTest-936429362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:23.297918 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-fe28a913-0d03-41c0-8519-28afe3b7a2c9 tempest-VolumesBackupsAdminTest-936429362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:23.320305 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-fe28a913-0d03-41c0-8519-28afe3b7a2c9 tempest-VolumesBackupsAdminTest-936429362 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:14:23.324684 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-fe28a913-0d03-41c0-8519-28afe3b7a2c9 tempest-VolumesBackupsAdminTest-936429362 None] Deleted volume successfully. Jan 29 21:14:23.336861 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-fe28a913-0d03-41c0-8519-28afe3b7a2c9 tempest-VolumesBackupsAdminTest-936429362 None] Lock "b'cinder-93eb89bc-d004-4e77-9222-3e4292575b20-delete_volume'" released by "delete_volume" :: held 0.962s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:24.846852 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:14:24.851235 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:14:24.851845 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:14:24.872362 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Flow 'volume_create_manager' (c2b12bca-aae0-44ac-ab49-78335495b2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:24.879563 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b177cb7-b506-4295-b2fd-ebea3e868259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:24.886062 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:14:24.902251 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b177cb7-b506-4295-b2fd-ebea3e868259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1966990283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=87559b37-b61d-4d6e-bf95-537f1fe13f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6333825180145da92c4dab49bac0446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:14:25Z,use_quota=True,user_id='adfebf3c24a74d73bd249a52c0fa0f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:24.907674 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd6eff1-06db-4a5c-82ef-9f4b6f800063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:24.912438 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd6eff1-06db-4a5c-82ef-9f4b6f800063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:24.917614 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad03049-7493-4741-a4da-fdb15f443b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:24.921848 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad03049-7493-4741-a4da-fdb15f443b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87559b37-b61d-4d6e-bf95-537f1fe13f01', 'volume_name': 'volume-87559b37-b61d-4d6e-bf95-537f1fe13f01', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:24.927856 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7d3296-8df2-4233-9d89-f8df2726017f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:24.931910 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7d3296-8df2-4233-9d89-f8df2726017f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:24.936666 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (effbc3c7-3a51-4cb1-94b0-a08ecab74dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:24.937773 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Volume 87559b37-b61d-4d6e-bf95-537f1fe13f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87559b37-b61d-4d6e-bf95-537f1fe13f01', 'volume_size': 1} Jan 29 21:14:24.938171 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] creating volume 'volume-87559b37-b61d-4d6e-bf95-537f1fe13f01' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:14:24.939134 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:24.983390 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:14:24.983764 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:14:24.987454 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (effbc3c7-3a51-4cb1-94b0-a08ecab74dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87559b37-b61d-4d6e-bf95-537f1fe13f01', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:24.992691 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e79c46-e050-45d2-8bd2-c6d05bd272fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:25.001276 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Volume volume-87559b37-b61d-4d6e-bf95-537f1fe13f01 (87559b37-b61d-4d6e-bf95-537f1fe13f01): created successfully Jan 29 21:14:25.004774 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e79c46-e050-45d2-8bd2-c6d05bd272fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:25.010246 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Flow 'volume_create_manager' (c2b12bca-aae0-44ac-ab49-78335495b2c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:25.017044 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-419e2a43-dccd-4dec-8240-51641ce7936e tempest-VolumesBackupsAdminTest-936429362 None] Created volume successfully. Jan 29 21:14:26.163073 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-a922e704-a9f1-4e80-b3ce-3494f29e6f21 tempest-VolumesBackupsAdminTest-936429362 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:14:26.809215 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-a922e704-a9f1-4e80-b3ce-3494f29e6f21 tempest-VolumesBackupsAdminTest-936429362 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.646s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:14:26.810015 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a922e704-a9f1-4e80-b3ce-3494f29e6f21 tempest-VolumesBackupsAdminTest-936429362 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-87559b37-b61d-4d6e-bf95-537f1fe13f01', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '87559b37-b61d-4d6e-bf95-537f1fe13f01', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:14:26.824475 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-a922e704-a9f1-4e80-b3ce-3494f29e6f21 tempest-VolumesBackupsAdminTest-936429362 None] Initialize volume connection completed successfully. Jan 29 21:14:28.706506 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:14:28.708223 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:28.734154 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:28.758562 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:14:29.237076 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-a922e704-a9f1-4e80-b3ce-3494f29e6f21 tempest-VolumesBackupsAdminTest-936429362 None] Terminate volume connection completed successfully. Jan 29 21:14:29.256295 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-a922e704-a9f1-4e80-b3ce-3494f29e6f21 tempest-VolumesBackupsAdminTest-936429362 None] Remove volume export completed successfully. Jan 29 21:14:31.294459 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-7110c275-41b7-42ea-98d7-92978ff58d66 tempest-VolumesNegativeTest-680436633 None] Lock "b'cinder-5d45207b-a5a1-4c67-875a-3425b3d689da-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:31.330682 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7110c275-41b7-42ea-98d7-92978ff58d66 tempest-VolumesNegativeTest-680436633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:31.377157 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7110c275-41b7-42ea-98d7-92978ff58d66 tempest-VolumesNegativeTest-680436633 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:14:31.377606 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7110c275-41b7-42ea-98d7-92978ff58d66 tempest-VolumesNegativeTest-680436633 None] Volume volume-5d45207b-a5a1-4c67-875a-3425b3d689da is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:14:31.382343 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7110c275-41b7-42ea-98d7-92978ff58d66 tempest-VolumesNegativeTest-680436633 None] deleting rbd volume volume-5d45207b-a5a1-4c67-875a-3425b3d689da {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:14:31.543057 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-7110c275-41b7-42ea-98d7-92978ff58d66 tempest-VolumesNegativeTest-680436633 None] Created reservations ['220a3aff-99d7-46c9-95ee-0b06312c0ec7', '4faa3f7e-8420-4e0f-83e2-0eb98cbd14ba', '5a81190e-c7e7-4a0e-80e4-e59cc516a1ce', 'b7067048-12cb-4bdd-afd0-a1153e48ca39'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:31.583866 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7110c275-41b7-42ea-98d7-92978ff58d66 tempest-VolumesNegativeTest-680436633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:31.605565 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7110c275-41b7-42ea-98d7-92978ff58d66 tempest-VolumesNegativeTest-680436633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:31.628601 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-7110c275-41b7-42ea-98d7-92978ff58d66 tempest-VolumesNegativeTest-680436633 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:14:31.633084 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-7110c275-41b7-42ea-98d7-92978ff58d66 tempest-VolumesNegativeTest-680436633 None] Deleted volume successfully. Jan 29 21:14:31.644163 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-7110c275-41b7-42ea-98d7-92978ff58d66 tempest-VolumesNegativeTest-680436633 None] Lock "b'cinder-5d45207b-a5a1-4c67-875a-3425b3d689da-delete_volume'" released by "delete_volume" :: held 0.350s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:32.394101 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-eb4b6fb7-50af-4912-bf1a-eda6bacc6b4e tempest-VolumesBackupsAdminTest-936429362 None] Lock "b'cinder-87559b37-b61d-4d6e-bf95-537f1fe13f01-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:32.429446 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-eb4b6fb7-50af-4912-bf1a-eda6bacc6b4e tempest-VolumesBackupsAdminTest-936429362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:33.167792 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-eb4b6fb7-50af-4912-bf1a-eda6bacc6b4e tempest-VolumesBackupsAdminTest-936429362 None] Volume volume-87559b37-b61d-4d6e-bf95-537f1fe13f01 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:14:33.182050 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-eb4b6fb7-50af-4912-bf1a-eda6bacc6b4e tempest-VolumesBackupsAdminTest-936429362 None] deleting rbd volume volume-87559b37-b61d-4d6e-bf95-537f1fe13f01 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:14:33.363871 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-eb4b6fb7-50af-4912-bf1a-eda6bacc6b4e tempest-VolumesBackupsAdminTest-936429362 None] Created reservations ['760a0741-3742-4b09-b21d-e2bc7e9abc20', 'db5de180-1a77-473d-a214-636456fd2ab3', 'cd7492d1-276e-467a-8094-6c662be3d676', '18821ee7-541e-47fc-800c-0f58cd322eda'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:33.407259 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-eb4b6fb7-50af-4912-bf1a-eda6bacc6b4e tempest-VolumesBackupsAdminTest-936429362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:33.434464 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-eb4b6fb7-50af-4912-bf1a-eda6bacc6b4e tempest-VolumesBackupsAdminTest-936429362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:33.473158 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-eb4b6fb7-50af-4912-bf1a-eda6bacc6b4e tempest-VolumesBackupsAdminTest-936429362 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:14:33.477451 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-eb4b6fb7-50af-4912-bf1a-eda6bacc6b4e tempest-VolumesBackupsAdminTest-936429362 None] Deleted volume successfully. Jan 29 21:14:33.495340 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-eb4b6fb7-50af-4912-bf1a-eda6bacc6b4e tempest-VolumesBackupsAdminTest-936429362 None] Lock "b'cinder-87559b37-b61d-4d6e-bf95-537f1fe13f01-delete_volume'" released by "delete_volume" :: held 1.101s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:33.528743 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-09d4c6c6-0af9-4826-b241-b20239be0efc tempest-VolumesBackupsAdminTest-936429362 None] Lock "b'cinder-d8cd7d9c-a78d-49fb-90ce-a7c609636f75-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:33.563331 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-09d4c6c6-0af9-4826-b241-b20239be0efc tempest-VolumesBackupsAdminTest-936429362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:34.166677 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-09d4c6c6-0af9-4826-b241-b20239be0efc tempest-VolumesBackupsAdminTest-936429362 None] Volume volume-d8cd7d9c-a78d-49fb-90ce-a7c609636f75 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:14:34.176775 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-09d4c6c6-0af9-4826-b241-b20239be0efc tempest-VolumesBackupsAdminTest-936429362 None] deleting rbd volume volume-d8cd7d9c-a78d-49fb-90ce-a7c609636f75 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:14:34.210091 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:14:34.214414 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:14:34.214991 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:14:34.240250 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Flow 'volume_create_manager' (e847fd15-ced4-4591-a2ef-b33c87b8af82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:34.248226 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6860701-68b7-4235-be63-107457a1c43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:34.256766 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:14:34.272771 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6860701-68b7-4235-be63-107457a1c43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1641495213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bcbdbcf0-5722-42de-9c97-2bd4d816dff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dece511074f43c2a8baf20ec4b824e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:14:34Z,use_quota=True,user_id='3fe4c3464a394747a76cffd664069f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:34.278947 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18391026-92da-4ec1-9e7e-16b2e28f542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:34.283823 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18391026-92da-4ec1-9e7e-16b2e28f542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:34.290578 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58842e8e-7fa8-4f08-a416-05545e0b75a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:34.295209 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58842e8e-7fa8-4f08-a416-05545e0b75a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcbdbcf0-5722-42de-9c97-2bd4d816dff0', 'volume_name': 'volume-bcbdbcf0-5722-42de-9c97-2bd4d816dff0', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:34.300302 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b00b43-6550-405c-9b0f-65a8a2fd238e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:34.304703 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b00b43-6550-405c-9b0f-65a8a2fd238e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:34.309512 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb1556e-e828-42a0-850f-a5e39f190a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:34.310775 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Volume bcbdbcf0-5722-42de-9c97-2bd4d816dff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcbdbcf0-5722-42de-9c97-2bd4d816dff0', 'volume_size': 1} Jan 29 21:14:34.311232 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] creating volume 'volume-bcbdbcf0-5722-42de-9c97-2bd4d816dff0' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:14:34.312303 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:34.363878 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:14:34.364251 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:14:34.368023 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb1556e-e828-42a0-850f-a5e39f190a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcbdbcf0-5722-42de-9c97-2bd4d816dff0', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:34.372648 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f62fbb0-f87d-4ee1-8268-0b9e10598430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:34.391536 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Volume volume-bcbdbcf0-5722-42de-9c97-2bd4d816dff0 (bcbdbcf0-5722-42de-9c97-2bd4d816dff0): created successfully Jan 29 21:14:34.395716 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f62fbb0-f87d-4ee1-8268-0b9e10598430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:34.401293 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Flow 'volume_create_manager' (e847fd15-ced4-4591-a2ef-b33c87b8af82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:34.410580 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-3b285826-3ed0-4c90-9be6-93d938d7b22b tempest-VolumesSnapshotListTestJSON-369411838 None] Created volume successfully. Jan 29 21:14:34.413876 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-09d4c6c6-0af9-4826-b241-b20239be0efc tempest-VolumesBackupsAdminTest-936429362 None] Created reservations ['e5fc853f-4bc6-4a7e-9b7c-0a64be97c1ac', 'b9778ce4-5fc0-4ab9-8875-9f6e515e1e60', '5b949c24-38b7-4650-85d9-77623a9d6347', 'b356b061-6e8e-4f25-930a-581fbcd1c4a9'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:34.453355 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-09d4c6c6-0af9-4826-b241-b20239be0efc tempest-VolumesBackupsAdminTest-936429362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:34.476935 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-09d4c6c6-0af9-4826-b241-b20239be0efc tempest-VolumesBackupsAdminTest-936429362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:34.500875 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-09d4c6c6-0af9-4826-b241-b20239be0efc tempest-VolumesBackupsAdminTest-936429362 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:14:34.504691 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-09d4c6c6-0af9-4826-b241-b20239be0efc tempest-VolumesBackupsAdminTest-936429362 None] Deleted volume successfully. Jan 29 21:14:34.516130 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-09d4c6c6-0af9-4826-b241-b20239be0efc tempest-VolumesBackupsAdminTest-936429362 None] Lock "b'cinder-d8cd7d9c-a78d-49fb-90ce-a7c609636f75-delete_volume'" released by "delete_volume" :: held 0.987s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:35.172198 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b319f477-8c3c-4062-bbd0-c4dda7b88861 tempest-VolumesSnapshotListTestJSON-369411838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:36.235741 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-b319f477-8c3c-4062-bbd0-c4dda7b88861 tempest-VolumesSnapshotListTestJSON-369411838 None] Create snapshot completed successfully Jan 29 21:14:36.923258 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:14:36.928031 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:14:36.928468 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:14:36.947075 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Flow 'volume_create_manager' (3aae4284-af7d-4a39-9ce3-9ba9d2e052e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:36.953541 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf62cfd2-b44d-4f72-82f0-5f40ff29f9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:36.960099 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:14:36.976489 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf62cfd2-b44d-4f72-82f0-5f40ff29f9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1543042432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e7e15ca7-fa50-4c51-8d7c-62b87974109f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d8c59d261784252923475a5f0086b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:14:37Z,use_quota=True,user_id='d9e8caa392ba4eb1b45f570ce350a42f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:36.981902 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a9bf18-d36d-45fd-a6da-bfb984830582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:36.986025 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a9bf18-d36d-45fd-a6da-bfb984830582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:36.991851 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a316f7f5-8cc2-43a9-a21b-2d9e541549f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:36.996014 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a316f7f5-8cc2-43a9-a21b-2d9e541549f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7e15ca7-fa50-4c51-8d7c-62b87974109f', 'volume_name': 'volume-e7e15ca7-fa50-4c51-8d7c-62b87974109f', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:37.000903 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0af8f6-90c0-447e-b24f-ccaee6c06da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:37.004920 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0af8f6-90c0-447e-b24f-ccaee6c06da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:37.009636 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d86b436-7c04-48ec-b4b1-20a161bd2e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:37.010689 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Volume e7e15ca7-fa50-4c51-8d7c-62b87974109f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7e15ca7-fa50-4c51-8d7c-62b87974109f', 'volume_size': 1} Jan 29 21:14:37.011073 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] creating volume 'volume-e7e15ca7-fa50-4c51-8d7c-62b87974109f' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:14:37.012029 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:37.056970 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:14:37.057439 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:14:37.061236 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d86b436-7c04-48ec-b4b1-20a161bd2e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7e15ca7-fa50-4c51-8d7c-62b87974109f', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:37.065855 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90bbe8c7-d172-41d3-9b2c-8a64b1a6b2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:37.074690 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Volume volume-e7e15ca7-fa50-4c51-8d7c-62b87974109f (e7e15ca7-fa50-4c51-8d7c-62b87974109f): created successfully Jan 29 21:14:37.078274 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90bbe8c7-d172-41d3-9b2c-8a64b1a6b2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:37.083804 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Flow 'volume_create_manager' (3aae4284-af7d-4a39-9ce3-9ba9d2e052e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:37.090619 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-65657e0f-eac9-4c6d-905f-9af22a23fff0 tempest-VolumesListTestJSON-1194676500 None] Created volume successfully. Jan 29 21:14:37.363255 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c441b020-a31f-49dc-abdf-b7ee65b1f4d4 tempest-VolumesSnapshotListTestJSON-369411838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:38.267007 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-c441b020-a31f-49dc-abdf-b7ee65b1f4d4 tempest-VolumesSnapshotListTestJSON-369411838 None] Create snapshot completed successfully Jan 29 21:14:38.280592 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:14:38.283889 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:14:38.284330 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:14:38.305089 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Flow 'volume_create_manager' (3388e9c6-a21a-4c98-98c9-1e77849564ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:38.311618 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0127f4a7-7fec-4502-b833-b226bc2da818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:38.317836 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:14:38.331702 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0127f4a7-7fec-4502-b833-b226bc2da818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-854361650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e2b2b6ab-b66b-4282-bf79-1e0cb6b2420b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d8c59d261784252923475a5f0086b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:14:38Z,use_quota=True,user_id='d9e8caa392ba4eb1b45f570ce350a42f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:38.337169 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b9f11a-c260-4ab3-9d72-8a22dfb91030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:38.341349 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b9f11a-c260-4ab3-9d72-8a22dfb91030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:38.346503 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a65a6d-5e2a-40a1-976c-51e12474526e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:38.351226 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a65a6d-5e2a-40a1-976c-51e12474526e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2b2b6ab-b66b-4282-bf79-1e0cb6b2420b', 'volume_name': 'volume-e2b2b6ab-b66b-4282-bf79-1e0cb6b2420b', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:38.356184 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc399cf-277a-4ec3-ab67-e4e07c309279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:38.360232 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc399cf-277a-4ec3-ab67-e4e07c309279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:38.367650 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f2b766-ec12-42f9-9dab-14ee4d2332b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:38.367650 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Volume e2b2b6ab-b66b-4282-bf79-1e0cb6b2420b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2b2b6ab-b66b-4282-bf79-1e0cb6b2420b', 'volume_size': 1} Jan 29 21:14:38.367650 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] creating volume 'volume-e2b2b6ab-b66b-4282-bf79-1e0cb6b2420b' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:14:38.368383 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:38.420395 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:14:38.420787 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:14:38.424656 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f2b766-ec12-42f9-9dab-14ee4d2332b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2b2b6ab-b66b-4282-bf79-1e0cb6b2420b', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:38.430238 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e45354d-fc8e-4aa4-ab91-585f26057dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:38.438736 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Volume volume-e2b2b6ab-b66b-4282-bf79-1e0cb6b2420b (e2b2b6ab-b66b-4282-bf79-1e0cb6b2420b): created successfully Jan 29 21:14:38.442487 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e45354d-fc8e-4aa4-ab91-585f26057dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:38.448851 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Flow 'volume_create_manager' (3388e9c6-a21a-4c98-98c9-1e77849564ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:38.456719 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-7fdb33ad-2a4f-4115-90c8-11343f4cb289 tempest-VolumesListTestJSON-1194676500 None] Created volume successfully. Jan 29 21:14:38.544097 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2f0b3104-7829-4ea7-a478-f8548231a56f tempest-VolumesSnapshotListTestJSON-369411838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:39.272434 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-2f0b3104-7829-4ea7-a478-f8548231a56f tempest-VolumesSnapshotListTestJSON-369411838 None] Create snapshot completed successfully Jan 29 21:14:39.600653 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:14:39.600653 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:14:39.600653 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:14:39.622209 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Flow 'volume_create_manager' (d3dfe9f9-301b-47b6-8c43-b7598d07fb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:39.624855 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794cb365-cda7-4f8e-9ddd-84f2b142733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:39.632065 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:14:39.647002 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794cb365-cda7-4f8e-9ddd-84f2b142733f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1084579241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dbcaac17-e323-42d8-98e4-4a4622d95512,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d8c59d261784252923475a5f0086b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:14:40Z,use_quota=True,user_id='d9e8caa392ba4eb1b45f570ce350a42f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:39.652467 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc2d493-5335-4aed-9b54-e6618e4829e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:39.656539 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc2d493-5335-4aed-9b54-e6618e4829e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:39.662257 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f091cd19-5f28-43f8-a209-c99973507459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:39.666422 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f091cd19-5f28-43f8-a209-c99973507459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbcaac17-e323-42d8-98e4-4a4622d95512', 'volume_name': 'volume-dbcaac17-e323-42d8-98e4-4a4622d95512', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:39.671423 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47eb127-a119-4a3d-b144-407d769a5509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:39.675406 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47eb127-a119-4a3d-b144-407d769a5509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:39.680916 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3864d84e-a4d3-4e0f-b66f-93791557ca55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:39.682007 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Volume dbcaac17-e323-42d8-98e4-4a4622d95512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbcaac17-e323-42d8-98e4-4a4622d95512', 'volume_size': 1} Jan 29 21:14:39.682393 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] creating volume 'volume-dbcaac17-e323-42d8-98e4-4a4622d95512' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:14:39.683493 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:39.731574 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:14:39.731947 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:14:39.735676 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3864d84e-a4d3-4e0f-b66f-93791557ca55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbcaac17-e323-42d8-98e4-4a4622d95512', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:39.740967 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d89d526-c7f7-4170-aa23-c814e8847c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:39.749719 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Volume volume-dbcaac17-e323-42d8-98e4-4a4622d95512 (dbcaac17-e323-42d8-98e4-4a4622d95512): created successfully Jan 29 21:14:39.753543 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d89d526-c7f7-4170-aa23-c814e8847c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:39.759733 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Flow 'volume_create_manager' (d3dfe9f9-301b-47b6-8c43-b7598d07fb1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:39.767452 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f819e5b2-6555-46f4-8de4-391899b339b4 tempest-VolumesListTestJSON-1194676500 None] Created volume successfully. Jan 29 21:14:40.206473 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-1ae43e63-8183-45ff-9113-d44c3bdf0cf2 tempest-VolumesSnapshotListTestJSON-369411838 None] Lock "b'cinder-cc437dec-032e-4ba6-b49b-c94cd2e1f9c7-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:40.208037 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-1ae43e63-8183-45ff-9113-d44c3bdf0cf2 tempest-VolumesSnapshotListTestJSON-369411838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:41.314301 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-1ae43e63-8183-45ff-9113-d44c3bdf0cf2 tempest-VolumesSnapshotListTestJSON-369411838 None] Created reservations ['9da693a5-2a46-4997-94bf-e1705cc10770', '11dc9680-74e6-4ef3-ab0a-829b20ed525f', '500a0559-3564-4189-9660-bcc114a9a82d', '761c3ef4-cec7-4bfd-8800-badc56ccf9c4'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:41.349995 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-1ae43e63-8183-45ff-9113-d44c3bdf0cf2 tempest-VolumesSnapshotListTestJSON-369411838 None] Delete snapshot completed successfully. Jan 29 21:14:41.354851 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-1ae43e63-8183-45ff-9113-d44c3bdf0cf2 tempest-VolumesSnapshotListTestJSON-369411838 None] Lock "b'cinder-cc437dec-032e-4ba6-b49b-c94cd2e1f9c7-delete_snapshot'" released by "delete_snapshot" :: held 1.148s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:42.322288 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-6a36fdba-8c5f-4f95-9249-0233ae7cc7f5 tempest-VolumesSnapshotListTestJSON-369411838 None] Lock "b'cinder-65bb7297-0f6e-46f3-a89b-28f70f5ce7cf-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:42.324720 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6a36fdba-8c5f-4f95-9249-0233ae7cc7f5 tempest-VolumesSnapshotListTestJSON-369411838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:42.750690 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-dc076aa0-0019-42e8-81ce-bb284c3b2ba2 tempest-VolumesListTestJSON-1194676500 None] Lock "b'cinder-dbcaac17-e323-42d8-98e4-4a4622d95512-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:42.787038 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dc076aa0-0019-42e8-81ce-bb284c3b2ba2 tempest-VolumesListTestJSON-1194676500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:42.818132 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dc076aa0-0019-42e8-81ce-bb284c3b2ba2 tempest-VolumesListTestJSON-1194676500 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:14:42.818596 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dc076aa0-0019-42e8-81ce-bb284c3b2ba2 tempest-VolumesListTestJSON-1194676500 None] Volume volume-dbcaac17-e323-42d8-98e4-4a4622d95512 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:14:42.822295 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dc076aa0-0019-42e8-81ce-bb284c3b2ba2 tempest-VolumesListTestJSON-1194676500 None] deleting rbd volume volume-dbcaac17-e323-42d8-98e4-4a4622d95512 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:14:42.983471 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-dc076aa0-0019-42e8-81ce-bb284c3b2ba2 tempest-VolumesListTestJSON-1194676500 None] Created reservations ['481553cf-c22d-43e2-aa5b-0899b9f47a57', '6dba9e37-0437-40c1-91f7-7dbf62a66107', '7b8a308c-b056-44e9-8198-9eb6c1c4dca9', '9b674d35-4502-4954-9c4c-1f4b8eee209c'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:43.023509 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dc076aa0-0019-42e8-81ce-bb284c3b2ba2 tempest-VolumesListTestJSON-1194676500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:43.044309 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dc076aa0-0019-42e8-81ce-bb284c3b2ba2 tempest-VolumesListTestJSON-1194676500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:43.068476 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-dc076aa0-0019-42e8-81ce-bb284c3b2ba2 tempest-VolumesListTestJSON-1194676500 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:14:43.072367 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-dc076aa0-0019-42e8-81ce-bb284c3b2ba2 tempest-VolumesListTestJSON-1194676500 None] Deleted volume successfully. Jan 29 21:14:43.089614 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-dc076aa0-0019-42e8-81ce-bb284c3b2ba2 tempest-VolumesListTestJSON-1194676500 None] Lock "b'cinder-dbcaac17-e323-42d8-98e4-4a4622d95512-delete_volume'" released by "delete_volume" :: held 0.339s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:43.321484 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-6a36fdba-8c5f-4f95-9249-0233ae7cc7f5 tempest-VolumesSnapshotListTestJSON-369411838 None] Created reservations ['07038fcc-bc4d-47a7-aefd-04450e59a79a', '31d5c375-dd01-4cd9-87a0-f96d3db0136d', '910379b4-eded-42b2-9a8a-679b2e7a839c', 'a7e36ba5-f042-4134-97ae-0e5c508feb77'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:43.361418 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6a36fdba-8c5f-4f95-9249-0233ae7cc7f5 tempest-VolumesSnapshotListTestJSON-369411838 None] Delete snapshot completed successfully. Jan 29 21:14:43.367090 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-6a36fdba-8c5f-4f95-9249-0233ae7cc7f5 tempest-VolumesSnapshotListTestJSON-369411838 None] Lock "b'cinder-65bb7297-0f6e-46f3-a89b-28f70f5ce7cf-delete_snapshot'" released by "delete_snapshot" :: held 1.045s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:43.425385 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-807e2ef0-3a63-437c-be20-f7a656de7e9d tempest-VolumesSnapshotListTestJSON-369411838 None] Lock "b'cinder-f09c860c-b50d-44da-88ec-400fd9e0c980-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:43.428333 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-807e2ef0-3a63-437c-be20-f7a656de7e9d tempest-VolumesSnapshotListTestJSON-369411838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:43.869279 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-87c10fec-af7c-43b9-8bd7-c9f545fe585d tempest-VolumesListTestJSON-1194676500 None] Lock "b'cinder-e2b2b6ab-b66b-4282-bf79-1e0cb6b2420b-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:43.898242 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-87c10fec-af7c-43b9-8bd7-c9f545fe585d tempest-VolumesListTestJSON-1194676500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:43.933124 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-87c10fec-af7c-43b9-8bd7-c9f545fe585d tempest-VolumesListTestJSON-1194676500 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:14:43.933540 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-87c10fec-af7c-43b9-8bd7-c9f545fe585d tempest-VolumesListTestJSON-1194676500 None] Volume volume-e2b2b6ab-b66b-4282-bf79-1e0cb6b2420b is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:14:43.937012 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-87c10fec-af7c-43b9-8bd7-c9f545fe585d tempest-VolumesListTestJSON-1194676500 None] deleting rbd volume volume-e2b2b6ab-b66b-4282-bf79-1e0cb6b2420b {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:14:44.087328 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-87c10fec-af7c-43b9-8bd7-c9f545fe585d tempest-VolumesListTestJSON-1194676500 None] Created reservations ['c676c1f8-75bb-4565-a9e0-0eb392a830ad', '9da0c75f-c821-475b-bb29-3f494cdc2302', 'a1f17472-4aff-4de3-98ef-316bcc94c1c2', '3cb462ff-c244-4be6-b23b-38636214ddd8'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:44.125146 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-87c10fec-af7c-43b9-8bd7-c9f545fe585d tempest-VolumesListTestJSON-1194676500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:44.145737 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-87c10fec-af7c-43b9-8bd7-c9f545fe585d tempest-VolumesListTestJSON-1194676500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:44.168053 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-87c10fec-af7c-43b9-8bd7-c9f545fe585d tempest-VolumesListTestJSON-1194676500 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:14:44.172894 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-87c10fec-af7c-43b9-8bd7-c9f545fe585d tempest-VolumesListTestJSON-1194676500 None] Deleted volume successfully. Jan 29 21:14:44.183655 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-87c10fec-af7c-43b9-8bd7-c9f545fe585d tempest-VolumesListTestJSON-1194676500 None] Lock "b'cinder-e2b2b6ab-b66b-4282-bf79-1e0cb6b2420b-delete_volume'" released by "delete_volume" :: held 0.314s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:44.326082 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-807e2ef0-3a63-437c-be20-f7a656de7e9d tempest-VolumesSnapshotListTestJSON-369411838 None] Created reservations ['7f7ed38e-bdab-4adb-8aa7-335d00f0acaa', '80c6cf95-e81a-41c8-ad56-82a3a3e0a347', '76cd1e1c-e1d0-47ea-ba71-d9a2bd245f27', 'c1d58206-4e78-413e-93fc-cfe1bf0cbba6'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:44.356855 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-807e2ef0-3a63-437c-be20-f7a656de7e9d tempest-VolumesSnapshotListTestJSON-369411838 None] Delete snapshot completed successfully. Jan 29 21:14:44.361073 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-807e2ef0-3a63-437c-be20-f7a656de7e9d tempest-VolumesSnapshotListTestJSON-369411838 None] Lock "b'cinder-f09c860c-b50d-44da-88ec-400fd9e0c980-delete_snapshot'" released by "delete_snapshot" :: held 0.936s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:44.523227 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-5ad86010-bbd4-49a2-8805-bdc1854ca5a3 tempest-VolumesSnapshotListTestJSON-369411838 None] Lock "b'cinder-bcbdbcf0-5722-42de-9c97-2bd4d816dff0-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:44.555814 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5ad86010-bbd4-49a2-8805-bdc1854ca5a3 tempest-VolumesSnapshotListTestJSON-369411838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:44.589084 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5ad86010-bbd4-49a2-8805-bdc1854ca5a3 tempest-VolumesSnapshotListTestJSON-369411838 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:14:44.589514 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5ad86010-bbd4-49a2-8805-bdc1854ca5a3 tempest-VolumesSnapshotListTestJSON-369411838 None] Volume volume-bcbdbcf0-5722-42de-9c97-2bd4d816dff0 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:14:44.593139 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5ad86010-bbd4-49a2-8805-bdc1854ca5a3 tempest-VolumesSnapshotListTestJSON-369411838 None] deleting rbd volume volume-bcbdbcf0-5722-42de-9c97-2bd4d816dff0 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:14:44.749835 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-5ad86010-bbd4-49a2-8805-bdc1854ca5a3 tempest-VolumesSnapshotListTestJSON-369411838 None] Created reservations ['974acc63-9c6b-41f1-ab4c-b9e1117d904e', 'a5762478-10ac-42b0-bc81-f974122df217', 'e9d6e0e2-2916-41cd-8d56-357364c2750f', 'b1cdf0fe-c9e4-48e0-98cf-9b47532ca756'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:44.789541 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5ad86010-bbd4-49a2-8805-bdc1854ca5a3 tempest-VolumesSnapshotListTestJSON-369411838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:44.812161 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5ad86010-bbd4-49a2-8805-bdc1854ca5a3 tempest-VolumesSnapshotListTestJSON-369411838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:44.835552 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-5ad86010-bbd4-49a2-8805-bdc1854ca5a3 tempest-VolumesSnapshotListTestJSON-369411838 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:14:44.840249 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-5ad86010-bbd4-49a2-8805-bdc1854ca5a3 tempest-VolumesSnapshotListTestJSON-369411838 None] Deleted volume successfully. Jan 29 21:14:44.852400 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-5ad86010-bbd4-49a2-8805-bdc1854ca5a3 tempest-VolumesSnapshotListTestJSON-369411838 None] Lock "b'cinder-bcbdbcf0-5722-42de-9c97-2bd4d816dff0-delete_volume'" released by "delete_volume" :: held 0.329s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:44.988774 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-9edc1ba5-e64d-42cb-b488-e626fabab754 tempest-VolumesListTestJSON-1194676500 None] Lock "b'cinder-e7e15ca7-fa50-4c51-8d7c-62b87974109f-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:45.019464 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9edc1ba5-e64d-42cb-b488-e626fabab754 tempest-VolumesListTestJSON-1194676500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:45.056038 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9edc1ba5-e64d-42cb-b488-e626fabab754 tempest-VolumesListTestJSON-1194676500 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:14:45.056490 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9edc1ba5-e64d-42cb-b488-e626fabab754 tempest-VolumesListTestJSON-1194676500 None] Volume volume-e7e15ca7-fa50-4c51-8d7c-62b87974109f is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:14:45.060155 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9edc1ba5-e64d-42cb-b488-e626fabab754 tempest-VolumesListTestJSON-1194676500 None] deleting rbd volume volume-e7e15ca7-fa50-4c51-8d7c-62b87974109f {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:14:45.226075 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-9edc1ba5-e64d-42cb-b488-e626fabab754 tempest-VolumesListTestJSON-1194676500 None] Created reservations ['c05de5a8-925d-4baf-a251-7e1a5dd8b8ee', '3f343291-85ae-4442-b391-e035326e50b0', 'ff1fb2ea-68c1-46c0-b930-8f158a1d6606', '14118706-cb29-4691-8bf0-d0eac61a7016'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:45.267743 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9edc1ba5-e64d-42cb-b488-e626fabab754 tempest-VolumesListTestJSON-1194676500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:45.290093 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9edc1ba5-e64d-42cb-b488-e626fabab754 tempest-VolumesListTestJSON-1194676500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:45.314271 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-9edc1ba5-e64d-42cb-b488-e626fabab754 tempest-VolumesListTestJSON-1194676500 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:14:45.319132 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9edc1ba5-e64d-42cb-b488-e626fabab754 tempest-VolumesListTestJSON-1194676500 None] Deleted volume successfully. Jan 29 21:14:45.331100 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-9edc1ba5-e64d-42cb-b488-e626fabab754 tempest-VolumesListTestJSON-1194676500 None] Lock "b'cinder-e7e15ca7-fa50-4c51-8d7c-62b87974109f-delete_volume'" released by "delete_volume" :: held 0.342s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:47.474497 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:14:47.477772 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:14:47.478212 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:14:47.497018 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Flow 'volume_create_manager' (36b4d8ad-608e-49c4-a433-825ef0418eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:47.503871 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f5f99c-26cd-47fc-a82f-e71d8543a448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:47.510259 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:14:47.524118 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f5f99c-26cd-47fc-a82f-e71d8543a448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1743090232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ca373b72-a8c3-4a4f-a477-29b4d5412d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821e3d7eafc14f5bb8b34bb9f6f38081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:14:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:14:47Z,use_quota=True,user_id='d1da678c553849dfb02ac177f8957979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:47.529587 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead57f81-9eb6-46df-99d8-a9563393107c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:47.533772 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead57f81-9eb6-46df-99d8-a9563393107c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:47.539400 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92885659-9c19-4a06-be2a-39bda2d80127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:47.543589 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92885659-9c19-4a06-be2a-39bda2d80127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca373b72-a8c3-4a4f-a477-29b4d5412d67', 'volume_name': 'volume-ca373b72-a8c3-4a4f-a477-29b4d5412d67', 'volume_size': 2}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:47.548510 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0989c3ad-cb62-4302-91a5-26f240903e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:47.553490 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0989c3ad-cb62-4302-91a5-26f240903e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:47.558213 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a1623b-fa5c-46a4-96a5-8170c69acd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:47.559278 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Volume ca373b72-a8c3-4a4f-a477-29b4d5412d67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca373b72-a8c3-4a4f-a477-29b4d5412d67', 'volume_size': 2} Jan 29 21:14:47.559669 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] creating volume 'volume-ca373b72-a8c3-4a4f-a477-29b4d5412d67' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:14:47.560635 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:47.603930 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:14:47.604227 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:14:47.609234 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a1623b-fa5c-46a4-96a5-8170c69acd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca373b72-a8c3-4a4f-a477-29b4d5412d67', 'volume_size': 2}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:47.613952 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e768ff-4afb-4460-8b15-b2645319e035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:14:47.623258 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Volume volume-ca373b72-a8c3-4a4f-a477-29b4d5412d67 (ca373b72-a8c3-4a4f-a477-29b4d5412d67): created successfully Jan 29 21:14:47.626935 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e768ff-4afb-4460-8b15-b2645319e035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:14:47.632399 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Flow 'volume_create_manager' (36b4d8ad-608e-49c4-a433-825ef0418eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:14:47.639376 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d57af74e-c9fa-40ac-8a8e-37fa81754bda tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Created volume successfully. Jan 29 21:14:48.654921 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-54ecdaaf-ff26-4f53-862a-109bf681c15b tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:49.050769 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-54ecdaaf-ff26-4f53-862a-109bf681c15b tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Create snapshot completed successfully Jan 29 21:14:49.772192 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-f36a9ce0-77d5-4a6d-a8e2-321a9029b0dc tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Lock "b'cinder-e7c646a5-beb2-49e8-a668-eab073efeed8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:49.773664 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f36a9ce0-77d5-4a6d-a8e2-321a9029b0dc tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:50.075061 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-f36a9ce0-77d5-4a6d-a8e2-321a9029b0dc tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Created reservations ['89937c0d-0ab5-46db-8de8-49bc5e8db5d4', '85c90344-53e0-4fb4-a0e6-ee28421b5383', 'c2644f47-48ac-4bbf-976b-22200b7446c3', '19a417a6-937f-4342-9646-09de6ab082c0'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:50.105941 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f36a9ce0-77d5-4a6d-a8e2-321a9029b0dc tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Delete snapshot completed successfully. Jan 29 21:14:50.110428 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-f36a9ce0-77d5-4a6d-a8e2-321a9029b0dc tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Lock "b'cinder-e7c646a5-beb2-49e8-a668-eab073efeed8-delete_snapshot'" released by "delete_snapshot" :: held 0.338s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:14:50.863385 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-5e281f1a-71ec-4b3f-a647-bf5cca2d286f tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Lock "b'cinder-ca373b72-a8c3-4a4f-a477-29b4d5412d67-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:14:50.916282 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5e281f1a-71ec-4b3f-a647-bf5cca2d286f tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:50.951931 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5e281f1a-71ec-4b3f-a647-bf5cca2d286f tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:14:50.952350 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5e281f1a-71ec-4b3f-a647-bf5cca2d286f tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Volume volume-ca373b72-a8c3-4a4f-a477-29b4d5412d67 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:14:50.955905 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5e281f1a-71ec-4b3f-a647-bf5cca2d286f tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] deleting rbd volume volume-ca373b72-a8c3-4a4f-a477-29b4d5412d67 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:14:51.141860 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-5e281f1a-71ec-4b3f-a647-bf5cca2d286f tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Created reservations ['46af41e4-3192-4d02-bcf1-5375bb0b8b56', '2a85b928-1ee8-4fac-9aa6-ff6e8f6aba16', 'aa4e6957-33f7-4be6-863b-d6f5aa7a0b50', 'dacc9856-4d14-4305-a55d-d2c9e02b791e'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:14:51.181207 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5e281f1a-71ec-4b3f-a647-bf5cca2d286f tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:51.202906 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5e281f1a-71ec-4b3f-a647-bf5cca2d286f tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:14:51.229936 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-5e281f1a-71ec-4b3f-a647-bf5cca2d286f tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:14:51.233885 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-5e281f1a-71ec-4b3f-a647-bf5cca2d286f tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Deleted volume successfully. Jan 29 21:14:51.245371 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-5e281f1a-71ec-4b3f-a647-bf5cca2d286f tempest-VolumesSnapshotNegativeTestJSON-1721611491 None] Lock "b'cinder-ca373b72-a8c3-4a4f-a477-29b4d5412d67-delete_volume'" released by "delete_volume" :: held 0.382s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:15:28.703458 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:15:28.704148 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:15:28.725505 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:15:28.757465 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:16:28.702673 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:16:28.703407 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:16:28.771810 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:16:28.837257 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:17:19.857852 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:17:19.863365 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:17:19.863822 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:17:19.888081 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Flow 'volume_create_manager' (6941608f-9c53-45a9-95f1-531e3bb704fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:17:19.895966 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a29a7b-651f-4ac7-a365-563602bfdcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:19.906750 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:17:19.923369 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a29a7b-651f-4ac7-a365-563602bfdcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-185713994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=45417566-c581-4bd8-bc43-fd9db252b797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849725927e7d4988bff638454bbbe9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:17:20Z,use_quota=True,user_id='caac10c44e2f4ea790e0c008155bcf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:19.929541 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b238553-d8fb-4108-8ca5-d0aeef2c49ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:19.933749 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b238553-d8fb-4108-8ca5-d0aeef2c49ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:19.940378 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f22010b-294d-42a3-8f0a-f840f97eb0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:20.061773 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f22010b-294d-42a3-8f0a-f840f97eb0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45417566-c581-4bd8-bc43-fd9db252b797', 'volume_name': 'volume-45417566-c581-4bd8-bc43-fd9db252b797', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:20.067428 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6cae393-c299-4fb8-9123-c7b98d5dc134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:20.071914 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6cae393-c299-4fb8-9123-c7b98d5dc134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:20.093398 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87762bcb-900b-401c-9bb9-e026fc5fedb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:20.095794 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Volume 45417566-c581-4bd8-bc43-fd9db252b797: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45417566-c581-4bd8-bc43-fd9db252b797', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 21:17:20.097798 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Cloning 45417566-c581-4bd8-bc43-fd9db252b797 from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 21:17:20.122693 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.024s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:17:20.138326 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 17, 20, 131469)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:17:20.139799 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:17:20.141574 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Found cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 29 21:17:20.150506 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 0.027s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:17:20.155804 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 21:17:20.176147 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 17, 20, 164584)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:17:20.176547 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:17:20.177408 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Creating from source image-volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 29 21:17:20.200228 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:17:20.294936 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] creating snapshot='volume-45417566-c581-4bd8-bc43-fd9db252b797.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 21:17:20.820448 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] cloning 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe@volume-45417566-c581-4bd8-bc43-fd9db252b797.clone_snap' to 'volume-45417566-c581-4bd8-bc43-fd9db252b797' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 21:17:21.035018 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:17:21.036827 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:17:21.037454 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:17:21.065162 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 21:17:21.065961 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Marking volume 45417566-c581-4bd8-bc43-fd9db252b797 as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 21:17:21.077470 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to 45417566-c581-4bd8-bc43-fd9db252b797. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 21:17:21.078479 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Creating volume glance metadata for volume 45417566-c581-4bd8-bc43-fd9db252b797 backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 21:17:21.142155 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87762bcb-900b-401c-9bb9-e026fc5fedb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45417566-c581-4bd8-bc43-fd9db252b797', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:21.148651 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47973c98-9308-4b87-a2d9-738c0e301d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:21.162402 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Volume volume-45417566-c581-4bd8-bc43-fd9db252b797 (45417566-c581-4bd8-bc43-fd9db252b797): created successfully Jan 29 21:17:21.172125 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47973c98-9308-4b87-a2d9-738c0e301d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:21.180239 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Flow 'volume_create_manager' (6941608f-9c53-45a9-95f1-531e3bb704fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:17:21.193197 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-48af39de-8083-468a-bc20-0cdabc0cd1d1 tempest-TestVolumeBootPattern-1467177201 None] Created volume successfully. Jan 29 21:17:22.336518 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c23ae405-10bf-4625-81bb-a9c022056703 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:17:23.395096 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-c23ae405-10bf-4625-81bb-a9c022056703 tempest-TestVolumeBootPattern-1467177201 None] Create snapshot completed successfully Jan 29 21:17:27.749740 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:17:27.761463 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:17:27.762507 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:17:27.820754 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Flow 'volume_create_manager' (5a667001-4add-446b-aaaf-94ea10e5ba17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:17:27.841714 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06d1611-8e00-4626-b917-37a3026c9ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:27.860948 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:17:27.896090 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06d1611-8e00-4626-b917-37a3026c9ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:17:27Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f6d7a1bf-90af-4153-8301-9ddb386ce824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849725927e7d4988bff638454bbbe9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7032c0bb-6876-4f87-bee0-c3d3c310c7e1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:17:28Z,use_quota=True,user_id='caac10c44e2f4ea790e0c008155bcf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:27.912632 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cba04b1-14e5-41a4-b02f-93ab0ff348f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:27.918947 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cba04b1-14e5-41a4-b02f-93ab0ff348f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:27.933608 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d254801-81d7-4ff4-b4e3-3c99aadf7754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:27.943745 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d254801-81d7-4ff4-b4e3-3c99aadf7754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f6d7a1bf-90af-4153-8301-9ddb386ce824', 'volume_name': 'volume-f6d7a1bf-90af-4153-8301-9ddb386ce824', 'volume_size': 1, 'snapshot_id': '7032c0bb-6876-4f87-bee0-c3d3c310c7e1'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:27.964222 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f32dbb1-496e-404d-9eee-7cbfe3e7cd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:27.979227 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f32dbb1-496e-404d-9eee-7cbfe3e7cd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:27.985497 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699fe769-8f06-434d-8fea-d4dca3b5ab33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:27.986845 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Volume f6d7a1bf-90af-4153-8301-9ddb386ce824: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f6d7a1bf-90af-4153-8301-9ddb386ce824', 'volume_size': 1, 'snapshot_id': '7032c0bb-6876-4f87-bee0-c3d3c310c7e1'} Jan 29 21:17:28.008014 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] cloning volumes/volume-45417566-c581-4bd8-bc43-fd9db252b797@snapshot-7032c0bb-6876-4f87-bee0-c3d3c310c7e1 to volume-f6d7a1bf-90af-4153-8301-9ddb386ce824 {{(pid=134283) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 29 21:17:28.009108 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:17:28.131407 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:17:28.450841 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:17:28.451358 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:17:28.478265 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Marking volume f6d7a1bf-90af-4153-8301-9ddb386ce824 as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 21:17:28.497505 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Copying metadata from snapshot 7032c0bb-6876-4f87-bee0-c3d3c310c7e1 to f6d7a1bf-90af-4153-8301-9ddb386ce824. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Jan 29 21:17:28.601909 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699fe769-8f06-434d-8fea-d4dca3b5ab33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d7a1bf-90af-4153-8301-9ddb386ce824', 'volume_size': 1, 'snapshot_id': '7032c0bb-6876-4f87-bee0-c3d3c310c7e1'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:28.616493 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab82d7db-fb80-4f6c-a72a-d9f5c4c503f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:28.636095 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Volume volume-f6d7a1bf-90af-4153-8301-9ddb386ce824 (f6d7a1bf-90af-4153-8301-9ddb386ce824): created successfully Jan 29 21:17:28.640112 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab82d7db-fb80-4f6c-a72a-d9f5c4c503f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:28.647136 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Flow 'volume_create_manager' (5a667001-4add-446b-aaaf-94ea10e5ba17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:17:28.667040 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-5e6914e2-cd06-423c-9c4c-85f446a1da42 tempest-TestVolumeBootPattern-1467177201 None] Created volume successfully. Jan 29 21:17:28.705173 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:17:28.705971 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:17:28.773976 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:17:28.872512 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:17:31.090013 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-35773b2e-96a1-4f06-bca9-012c023e6aef tempest-TestVolumeBootPattern-1467177201 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:17:31.838701 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-35773b2e-96a1-4f06-bca9-012c023e6aef tempest-TestVolumeBootPattern-1467177201 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.748s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:17:31.841337 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-35773b2e-96a1-4f06-bca9-012c023e6aef tempest-TestVolumeBootPattern-1467177201 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f6d7a1bf-90af-4153-8301-9ddb386ce824', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'f6d7a1bf-90af-4153-8301-9ddb386ce824', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:17:31.867444 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-35773b2e-96a1-4f06-bca9-012c023e6aef tempest-TestVolumeBootPattern-1467177201 None] Connection info returned from driver {'name': 'volumes/volume-f6d7a1bf-90af-4153-8301-9ddb386ce824', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f6d7a1bf-90af-4153-8301-9ddb386ce824', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'de6033fb-48b3-435d-ba47-f0188e8fe902'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:17:31.919843 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-85b1692d-bb18-4ebf-8d43-3408be4b9e94 req-35773b2e-96a1-4f06-bca9-012c023e6aef tempest-TestVolumeBootPattern-1467177201 None] attachment_update completed successfully. Jan 29 21:17:45.366790 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-34873522-0655-4259-b393-965db44140f4 req-c227b4b4-a133-42af-a276-3669e3df8870 tempest-TestVolumeBootPattern-1467177201 None] Terminate volume connection completed successfully. Jan 29 21:17:45.367437 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-34873522-0655-4259-b393-965db44140f4 req-c227b4b4-a133-42af-a276-3669e3df8870 tempest-TestVolumeBootPattern-1467177201 None] Deleting attachment de6033fb-48b3-435d-ba47-f0188e8fe902. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:17:45.492104 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-34873522-0655-4259-b393-965db44140f4 req-c2058d80-15dc-400e-9a53-8ff238030479 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-f6d7a1bf-90af-4153-8301-9ddb386ce824-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:17:45.520041 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-34873522-0655-4259-b393-965db44140f4 req-c2058d80-15dc-400e-9a53-8ff238030479 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:17:45.599157 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-34873522-0655-4259-b393-965db44140f4 req-c2058d80-15dc-400e-9a53-8ff238030479 tempest-TestVolumeBootPattern-1467177201 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:17:45.605707 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-34873522-0655-4259-b393-965db44140f4 req-c2058d80-15dc-400e-9a53-8ff238030479 tempest-TestVolumeBootPattern-1467177201 None] deleting rbd volume volume-f6d7a1bf-90af-4153-8301-9ddb386ce824 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:17:45.828893 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [req-34873522-0655-4259-b393-965db44140f4 req-c2058d80-15dc-400e-9a53-8ff238030479 tempest-TestVolumeBootPattern-1467177201 None] Created reservations ['78340940-0606-4dd5-be3b-450771dcd04e', '1aa810aa-dbc0-47ee-acb9-d9a7138d59d1', '77efb750-04d4-4763-8b7f-1fcaa7857d64', 'c2591f0e-df5e-4922-9fda-0e192e3cab56'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:17:45.877875 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-34873522-0655-4259-b393-965db44140f4 req-c2058d80-15dc-400e-9a53-8ff238030479 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:17:45.912420 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-34873522-0655-4259-b393-965db44140f4 req-c2058d80-15dc-400e-9a53-8ff238030479 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:17:45.942144 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [req-34873522-0655-4259-b393-965db44140f4 req-c2058d80-15dc-400e-9a53-8ff238030479 tempest-TestVolumeBootPattern-1467177201 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:17:45.947343 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-34873522-0655-4259-b393-965db44140f4 req-c2058d80-15dc-400e-9a53-8ff238030479 tempest-TestVolumeBootPattern-1467177201 None] Deleted volume successfully. Jan 29 21:17:45.959517 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-34873522-0655-4259-b393-965db44140f4 req-c2058d80-15dc-400e-9a53-8ff238030479 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-f6d7a1bf-90af-4153-8301-9ddb386ce824-delete_volume'" released by "delete_volume" :: held 0.470s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:17:46.683047 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-5d27ef5d-1432-41ba-a6fa-2514efb0fbbd tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-7032c0bb-6876-4f87-bee0-c3d3c310c7e1-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:17:46.686019 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5d27ef5d-1432-41ba-a6fa-2514efb0fbbd tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:17:47.885695 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-5d27ef5d-1432-41ba-a6fa-2514efb0fbbd tempest-TestVolumeBootPattern-1467177201 None] Created reservations ['a81d6955-3344-4219-b8a4-38a7547633e3', 'dc5328b8-69a6-4194-9d58-5ca4ac3790ba', 'cb4455e3-0870-403b-b0fc-eecc31b0ed6e', '1d2e7365-b1d0-4c43-abae-c0894fc99686'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:17:47.926060 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-5d27ef5d-1432-41ba-a6fa-2514efb0fbbd tempest-TestVolumeBootPattern-1467177201 None] Delete snapshot completed successfully. Jan 29 21:17:47.930936 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-5d27ef5d-1432-41ba-a6fa-2514efb0fbbd tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-7032c0bb-6876-4f87-bee0-c3d3c310c7e1-delete_snapshot'" released by "delete_snapshot" :: held 1.249s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:17:48.788734 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:17:48.795799 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:17:48.796306 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:17:48.816437 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Flow 'volume_create_manager' (6ded7080-e10a-4da1-beec-c68714a6db7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:17:48.823025 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4318de06-1e90-4181-9dc3-7547c6f5315f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:48.834920 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:17:48.847645 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e9c634dc-9ec4-4088-9712-5d79e2efc43a tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-45417566-c581-4bd8-bc43-fd9db252b797-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:17:48.855179 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4318de06-1e90-4181-9dc3-7547c6f5315f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1359097286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae6f04a79c84770a4886b60cb268966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:17:49Z,use_quota=True,user_id='66b1c193b6654ff9b2e7354a3e058a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:48.861193 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078b6495-0006-481a-8749-0b14a4f5375b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:48.865308 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078b6495-0006-481a-8749-0b14a4f5375b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:48.870352 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98f5350-8362-4ce9-b457-98c05ca0af44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:48.874504 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98f5350-8362-4ce9-b457-98c05ca0af44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6', 'volume_name': 'volume-ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:48.879405 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519d53e0-7c72-4353-8384-ea828bffe542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:48.883412 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519d53e0-7c72-4353-8384-ea828bffe542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:48.888131 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a13aaa5-c292-495c-a96c-f6e9acd61cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:48.889199 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Volume ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6', 'volume_size': 1} Jan 29 21:17:48.889590 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] creating volume 'volume-ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:17:48.890512 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:17:48.940629 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e9c634dc-9ec4-4088-9712-5d79e2efc43a tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:17:49.000308 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e9c634dc-9ec4-4088-9712-5d79e2efc43a tempest-TestVolumeBootPattern-1467177201 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:17:49.007145 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e9c634dc-9ec4-4088-9712-5d79e2efc43a tempest-TestVolumeBootPattern-1467177201 None] deleting rbd volume volume-45417566-c581-4bd8-bc43-fd9db252b797 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:17:49.015734 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:17:49.016089 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:17:49.019759 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a13aaa5-c292-495c-a96c-f6e9acd61cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:49.024397 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb57baf8-5a9f-4047-a8e0-0f5492875c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:49.034419 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Volume volume-ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6 (ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6): created successfully Jan 29 21:17:49.039394 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb57baf8-5a9f-4047-a8e0-0f5492875c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:49.045869 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Flow 'volume_create_manager' (6ded7080-e10a-4da1-beec-c68714a6db7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:17:49.055359 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e5fded69-d465-4d43-b7e6-89ac30b58254 tempest-AttachVolumeShelveTestJSON-1922477119 None] Created volume successfully. Jan 29 21:17:49.181238 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e9c634dc-9ec4-4088-9712-5d79e2efc43a tempest-TestVolumeBootPattern-1467177201 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 21:17:49.211338 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e9c634dc-9ec4-4088-9712-5d79e2efc43a tempest-TestVolumeBootPattern-1467177201 None] deleting parent snapshot volume-45417566-c581-4bd8-bc43-fd9db252b797.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 21:17:49.878340 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-e9c634dc-9ec4-4088-9712-5d79e2efc43a tempest-TestVolumeBootPattern-1467177201 None] Created reservations ['f217414e-7cac-415c-9391-3b8fbffbc6b1', 'a6f6bbe7-3757-45f0-b5ac-0e675766c6a8', '01b59077-5d26-4d68-b9e8-274c61642c0b', '354685bb-5e29-433c-90b6-8fd9d4f7325b'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:17:49.919328 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e9c634dc-9ec4-4088-9712-5d79e2efc43a tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:17:49.942289 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e9c634dc-9ec4-4088-9712-5d79e2efc43a tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:17:49.964240 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e9c634dc-9ec4-4088-9712-5d79e2efc43a tempest-TestVolumeBootPattern-1467177201 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:17:49.968398 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e9c634dc-9ec4-4088-9712-5d79e2efc43a tempest-TestVolumeBootPattern-1467177201 None] Deleted volume successfully. Jan 29 21:17:49.979454 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e9c634dc-9ec4-4088-9712-5d79e2efc43a tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-45417566-c581-4bd8-bc43-fd9db252b797-delete_volume'" released by "delete_volume" :: held 1.132s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:17:51.337742 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:17:51.341301 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:17:51.341667 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:17:51.359984 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Flow 'volume_create_manager' (d7381098-d4eb-4e51-a70d-401f3a0fa03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:17:51.366801 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ccd1c5-b4b2-4b7c-be11-7b02ebbea2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:51.373157 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:17:51.389665 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ccd1c5-b4b2-4b7c-be11-7b02ebbea2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1046149246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b21bbfe1-fa85-46ed-8145-d66956cae9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849725927e7d4988bff638454bbbe9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:17:51Z,use_quota=True,user_id='caac10c44e2f4ea790e0c008155bcf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:51.395570 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f951a09b-1e93-4c7f-aed9-cec60977436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:51.399698 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f951a09b-1e93-4c7f-aed9-cec60977436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:51.404798 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1289b25-7b5e-4533-b9a0-e485cf71241d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:51.481744 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1289b25-7b5e-4533-b9a0-e485cf71241d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b21bbfe1-fa85-46ed-8145-d66956cae9ee', 'volume_name': 'volume-b21bbfe1-fa85-46ed-8145-d66956cae9ee', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:51.487250 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415737d0-c771-4dd1-ac81-4555c0be4990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:51.491348 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415737d0-c771-4dd1-ac81-4555c0be4990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:51.496091 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21612f41-b04d-4441-9333-7147c84e10ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:51.497522 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Volume b21bbfe1-fa85-46ed-8145-d66956cae9ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b21bbfe1-fa85-46ed-8145-d66956cae9ee', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 21:17:51.498093 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Cloning b21bbfe1-fa85-46ed-8145-d66956cae9ee from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 21:17:51.506310 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:17:51.515865 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 17, 51, 510852)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:17:51.516294 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:17:51.516684 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Found cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 29 21:17:51.520433 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:17:51.521355 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 21:17:51.526522 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 17, 51, 524354)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:17:51.526925 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:17:51.527356 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Creating from source image-volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 29 21:17:51.538362 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:17:51.587923 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] creating snapshot='volume-b21bbfe1-fa85-46ed-8145-d66956cae9ee.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 21:17:51.852573 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] cloning 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe@volume-b21bbfe1-fa85-46ed-8145-d66956cae9ee.clone_snap' to 'volume-b21bbfe1-fa85-46ed-8145-d66956cae9ee' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 21:17:51.974771 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:17:51.975990 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:17:51.976366 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:17:51.994508 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 21:17:51.995131 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Marking volume b21bbfe1-fa85-46ed-8145-d66956cae9ee as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 21:17:52.002385 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to b21bbfe1-fa85-46ed-8145-d66956cae9ee. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 21:17:52.002805 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Creating volume glance metadata for volume b21bbfe1-fa85-46ed-8145-d66956cae9ee backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 21:17:52.048067 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21612f41-b04d-4441-9333-7147c84e10ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21bbfe1-fa85-46ed-8145-d66956cae9ee', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:52.052877 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad97c82-2b05-4f0f-a090-aa11b1c60873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:17:52.060109 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Volume volume-b21bbfe1-fa85-46ed-8145-d66956cae9ee (b21bbfe1-fa85-46ed-8145-d66956cae9ee): created successfully Jan 29 21:17:52.063611 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad97c82-2b05-4f0f-a090-aa11b1c60873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:17:52.068976 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Flow 'volume_create_manager' (d7381098-d4eb-4e51-a70d-401f3a0fa03e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:17:52.077289 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-67f245f8-f347-4e80-9774-1d2b431c6938 tempest-TestVolumeBootPattern-1467177201 None] Created volume successfully. Jan 29 21:17:54.076818 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-04d4e474-e83f-451a-ae63-5833c770a4df req-a2226932-bc5b-4ced-8ea2-996755434290 tempest-TestVolumeBootPattern-1467177201 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:17:54.726395 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-04d4e474-e83f-451a-ae63-5833c770a4df req-a2226932-bc5b-4ced-8ea2-996755434290 tempest-TestVolumeBootPattern-1467177201 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.649s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:17:54.727126 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-04d4e474-e83f-451a-ae63-5833c770a4df req-a2226932-bc5b-4ced-8ea2-996755434290 tempest-TestVolumeBootPattern-1467177201 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b21bbfe1-fa85-46ed-8145-d66956cae9ee', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'b21bbfe1-fa85-46ed-8145-d66956cae9ee', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:17:54.747005 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-04d4e474-e83f-451a-ae63-5833c770a4df req-a2226932-bc5b-4ced-8ea2-996755434290 tempest-TestVolumeBootPattern-1467177201 None] Connection info returned from driver {'name': 'volumes/volume-b21bbfe1-fa85-46ed-8145-d66956cae9ee', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b21bbfe1-fa85-46ed-8145-d66956cae9ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2e496933-8159-40d1-9863-46ce945ae380'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:17:54.798134 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-04d4e474-e83f-451a-ae63-5833c770a4df req-a2226932-bc5b-4ced-8ea2-996755434290 tempest-TestVolumeBootPattern-1467177201 None] attachment_update completed successfully. Jan 29 21:18:04.292634 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b0ede18f-332e-4174-8f66-19fc59ef1dde req-d4697a10-bc5c-4c8e-896f-641d8317971f tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:18:04.821608 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-b0ede18f-332e-4174-8f66-19fc59ef1dde req-d4697a10-bc5c-4c8e-896f-641d8317971f tempest-TestVolumeBootPattern-1467177201 None] Create snapshot completed successfully Jan 29 21:18:06.937381 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:18:06.941677 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:18:06.942165 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:18:06.970895 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Flow 'volume_create_manager' (34d7fbf7-0fe0-4603-b39b-d45b639d89e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:18:06.978677 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4aa03fc-8bf4-4984-8de3-e6c66e97a247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:18:06.985433 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:18:07.001433 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4aa03fc-8bf4-4984-8de3-e6c66e97a247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:18:07Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=88cd25ca-05cb-43bb-8044-85e6425d9f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849725927e7d4988bff638454bbbe9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ba9d963d-315a-41bc-8649-757d81363501,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:18:07Z,use_quota=True,user_id='caac10c44e2f4ea790e0c008155bcf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:18:07.006918 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e58dc0e-f3d3-4d6f-8d56-cb6676c29ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:18:07.011186 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e58dc0e-f3d3-4d6f-8d56-cb6676c29ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:18:07.017083 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be0c6aa-6ade-4801-8d0f-1f177fc3dbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:18:07.021520 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be0c6aa-6ade-4801-8d0f-1f177fc3dbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '88cd25ca-05cb-43bb-8044-85e6425d9f1c', 'volume_name': 'volume-88cd25ca-05cb-43bb-8044-85e6425d9f1c', 'volume_size': 1, 'snapshot_id': 'ba9d963d-315a-41bc-8649-757d81363501'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:18:07.026626 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833d6100-2003-4b2b-b42f-74d6437a97bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:18:07.030522 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833d6100-2003-4b2b-b42f-74d6437a97bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:18:07.035303 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520f8c55-c024-46d7-b24c-6c5867ebe080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:18:07.036393 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Volume 88cd25ca-05cb-43bb-8044-85e6425d9f1c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-88cd25ca-05cb-43bb-8044-85e6425d9f1c', 'volume_size': 1, 'snapshot_id': 'ba9d963d-315a-41bc-8649-757d81363501'} Jan 29 21:18:07.060141 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] cloning volumes/volume-b21bbfe1-fa85-46ed-8145-d66956cae9ee@snapshot-ba9d963d-315a-41bc-8649-757d81363501 to volume-88cd25ca-05cb-43bb-8044-85e6425d9f1c {{(pid=134283) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 29 21:18:07.061258 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:18:07.154518 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:18:07.339478 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:18:07.339862 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:18:07.358702 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Marking volume 88cd25ca-05cb-43bb-8044-85e6425d9f1c as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 21:18:07.363851 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Copying metadata from snapshot ba9d963d-315a-41bc-8649-757d81363501 to 88cd25ca-05cb-43bb-8044-85e6425d9f1c. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Jan 29 21:18:07.400479 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520f8c55-c024-46d7-b24c-6c5867ebe080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88cd25ca-05cb-43bb-8044-85e6425d9f1c', 'volume_size': 1, 'snapshot_id': 'ba9d963d-315a-41bc-8649-757d81363501'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:18:07.407923 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5006bbfd-a244-44d3-b03f-8d8100626d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:18:07.419702 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Volume volume-88cd25ca-05cb-43bb-8044-85e6425d9f1c (88cd25ca-05cb-43bb-8044-85e6425d9f1c): created successfully Jan 29 21:18:07.424016 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5006bbfd-a244-44d3-b03f-8d8100626d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:18:07.429998 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Flow 'volume_create_manager' (34d7fbf7-0fe0-4603-b39b-d45b639d89e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:18:07.442968 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-770b6fca-301f-4c4a-a4a7-4e6bb9ceba6b tempest-TestVolumeBootPattern-1467177201 None] Created volume successfully. Jan 29 21:18:10.179493 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-4e0f10fa-5ecb-43dd-ae6d-8d41bb6cf51b tempest-TestVolumeBootPattern-1467177201 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:18:10.817618 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-4e0f10fa-5ecb-43dd-ae6d-8d41bb6cf51b tempest-TestVolumeBootPattern-1467177201 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.638s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:18:10.818465 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-4e0f10fa-5ecb-43dd-ae6d-8d41bb6cf51b tempest-TestVolumeBootPattern-1467177201 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-88cd25ca-05cb-43bb-8044-85e6425d9f1c', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '88cd25ca-05cb-43bb-8044-85e6425d9f1c', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:18:10.840535 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-4e0f10fa-5ecb-43dd-ae6d-8d41bb6cf51b tempest-TestVolumeBootPattern-1467177201 None] Connection info returned from driver {'name': 'volumes/volume-88cd25ca-05cb-43bb-8044-85e6425d9f1c', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '88cd25ca-05cb-43bb-8044-85e6425d9f1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4d1ee141-03af-4e41-bb13-adbe56ec8267'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:18:10.884865 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-6c3dc1e9-a762-48c0-a8ee-51302c22481c req-4e0f10fa-5ecb-43dd-ae6d-8d41bb6cf51b tempest-TestVolumeBootPattern-1467177201 None] attachment_update completed successfully. Jan 29 21:18:22.365980 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-afb7b092-00f8-428f-8ae2-7a1c93e42a5b req-827984cf-3213-427f-a1be-9d8256851847 tempest-TestVolumeBootPattern-1467177201 None] Terminate volume connection completed successfully. Jan 29 21:18:22.366575 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-afb7b092-00f8-428f-8ae2-7a1c93e42a5b req-827984cf-3213-427f-a1be-9d8256851847 tempest-TestVolumeBootPattern-1467177201 None] Deleting attachment 4d1ee141-03af-4e41-bb13-adbe56ec8267. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:18:22.490780 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-afb7b092-00f8-428f-8ae2-7a1c93e42a5b req-df7accfc-ef36-4257-b09e-86db3083ee47 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-88cd25ca-05cb-43bb-8044-85e6425d9f1c-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:18:22.531552 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-afb7b092-00f8-428f-8ae2-7a1c93e42a5b req-df7accfc-ef36-4257-b09e-86db3083ee47 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:18:22.622076 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-afb7b092-00f8-428f-8ae2-7a1c93e42a5b req-df7accfc-ef36-4257-b09e-86db3083ee47 tempest-TestVolumeBootPattern-1467177201 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:18:22.637537 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-afb7b092-00f8-428f-8ae2-7a1c93e42a5b req-df7accfc-ef36-4257-b09e-86db3083ee47 tempest-TestVolumeBootPattern-1467177201 None] deleting rbd volume volume-88cd25ca-05cb-43bb-8044-85e6425d9f1c {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:18:22.863636 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [req-afb7b092-00f8-428f-8ae2-7a1c93e42a5b req-df7accfc-ef36-4257-b09e-86db3083ee47 tempest-TestVolumeBootPattern-1467177201 None] Created reservations ['8f1d169a-157f-4980-8b0d-27d1186563f3', 'bd6c8602-2305-4a12-a997-cba06e0fa235', '25929965-33ea-4c7a-8ab1-d8c1c06cefa1', 'ece105cb-a68f-4a0d-bcac-eb12072e7ac5'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:18:22.908337 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-afb7b092-00f8-428f-8ae2-7a1c93e42a5b req-df7accfc-ef36-4257-b09e-86db3083ee47 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:18:22.937747 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-afb7b092-00f8-428f-8ae2-7a1c93e42a5b req-df7accfc-ef36-4257-b09e-86db3083ee47 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:18:22.971619 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [req-afb7b092-00f8-428f-8ae2-7a1c93e42a5b req-df7accfc-ef36-4257-b09e-86db3083ee47 tempest-TestVolumeBootPattern-1467177201 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:18:22.976191 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-afb7b092-00f8-428f-8ae2-7a1c93e42a5b req-df7accfc-ef36-4257-b09e-86db3083ee47 tempest-TestVolumeBootPattern-1467177201 None] Deleted volume successfully. Jan 29 21:18:22.990576 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-afb7b092-00f8-428f-8ae2-7a1c93e42a5b req-df7accfc-ef36-4257-b09e-86db3083ee47 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-88cd25ca-05cb-43bb-8044-85e6425d9f1c-delete_volume'" released by "delete_volume" :: held 0.499s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:18:23.687619 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-4f1711a5-b966-49df-a3ab-2af5ba96ceba tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-ba9d963d-315a-41bc-8649-757d81363501-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:18:23.689226 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4f1711a5-b966-49df-a3ab-2af5ba96ceba tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:18:28.702919 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:18:28.703586 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:18:28.727002 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:18:28.762521 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:18:53.836604 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-4f1711a5-b966-49df-a3ab-2af5ba96ceba tempest-TestVolumeBootPattern-1467177201 None] Created reservations ['d022e9d3-9f13-436b-b6f3-5305595677ce', 'b6cdd6fc-a71c-44fc-ad52-04e80fc37f2f', '0978a4c2-cc3c-4b8e-a38f-19c859668813', '959733db-f1f3-4b67-af3b-fc0ce01c74a2'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:18:53.876197 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4f1711a5-b966-49df-a3ab-2af5ba96ceba tempest-TestVolumeBootPattern-1467177201 None] Delete snapshot completed successfully. Jan 29 21:18:53.880517 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-4f1711a5-b966-49df-a3ab-2af5ba96ceba tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-ba9d963d-315a-41bc-8649-757d81363501-delete_snapshot'" released by "delete_snapshot" :: held 30.193s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:18:56.799135 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-d8e162ef-60fc-4871-b2ba-6382607c482a req-e3d445fa-8ce3-4ea0-b433-f055493eb2e0 tempest-TestVolumeBootPattern-1467177201 None] Terminate volume connection completed successfully. Jan 29 21:18:56.799741 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-d8e162ef-60fc-4871-b2ba-6382607c482a req-e3d445fa-8ce3-4ea0-b433-f055493eb2e0 tempest-TestVolumeBootPattern-1467177201 None] Deleting attachment 2e496933-8159-40d1-9863-46ce945ae380. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:18:56.913785 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-d8e162ef-60fc-4871-b2ba-6382607c482a req-f4481583-ee81-469f-b15a-7e3aa4fbd1f0 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-b21bbfe1-fa85-46ed-8145-d66956cae9ee-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:18:56.947066 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-d8e162ef-60fc-4871-b2ba-6382607c482a req-f4481583-ee81-469f-b15a-7e3aa4fbd1f0 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:18:57.013673 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-d8e162ef-60fc-4871-b2ba-6382607c482a req-f4481583-ee81-469f-b15a-7e3aa4fbd1f0 tempest-TestVolumeBootPattern-1467177201 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:18:57.024415 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-d8e162ef-60fc-4871-b2ba-6382607c482a req-f4481583-ee81-469f-b15a-7e3aa4fbd1f0 tempest-TestVolumeBootPattern-1467177201 None] deleting rbd volume volume-b21bbfe1-fa85-46ed-8145-d66956cae9ee {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:18:57.362423 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-d8e162ef-60fc-4871-b2ba-6382607c482a req-f4481583-ee81-469f-b15a-7e3aa4fbd1f0 tempest-TestVolumeBootPattern-1467177201 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 21:18:57.401536 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-d8e162ef-60fc-4871-b2ba-6382607c482a req-f4481583-ee81-469f-b15a-7e3aa4fbd1f0 tempest-TestVolumeBootPattern-1467177201 None] deleting parent snapshot volume-b21bbfe1-fa85-46ed-8145-d66956cae9ee.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 21:18:58.331029 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [req-d8e162ef-60fc-4871-b2ba-6382607c482a req-f4481583-ee81-469f-b15a-7e3aa4fbd1f0 tempest-TestVolumeBootPattern-1467177201 None] Created reservations ['223d1b6f-61b2-4b1f-a340-47574e592e90', '03dc30c1-0934-4b31-822d-767e6f4b0638', '83e75b81-4377-45ab-90aa-a4e1ee07012c', 'ec95a11d-72a7-4a9a-80d0-d2a2a4a3716a'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:18:58.375165 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-d8e162ef-60fc-4871-b2ba-6382607c482a req-f4481583-ee81-469f-b15a-7e3aa4fbd1f0 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:18:58.402830 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-d8e162ef-60fc-4871-b2ba-6382607c482a req-f4481583-ee81-469f-b15a-7e3aa4fbd1f0 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:18:58.431565 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [req-d8e162ef-60fc-4871-b2ba-6382607c482a req-f4481583-ee81-469f-b15a-7e3aa4fbd1f0 tempest-TestVolumeBootPattern-1467177201 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:18:58.435922 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-d8e162ef-60fc-4871-b2ba-6382607c482a req-f4481583-ee81-469f-b15a-7e3aa4fbd1f0 tempest-TestVolumeBootPattern-1467177201 None] Deleted volume successfully. Jan 29 21:18:58.448898 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-d8e162ef-60fc-4871-b2ba-6382607c482a req-f4481583-ee81-469f-b15a-7e3aa4fbd1f0 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-b21bbfe1-fa85-46ed-8145-d66956cae9ee-delete_volume'" released by "delete_volume" :: held 1.535s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:19:01.493639 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:19:01.497187 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:19:01.497669 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:19:01.517197 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Flow 'volume_create_manager' (aa51a36e-7520-44ba-b82e-b303a184474c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:19:01.524308 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5736c861-875a-4f99-9180-de076b701239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:19:01.530755 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:19:01.547299 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5736c861-875a-4f99-9180-de076b701239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1171086507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=00e00e58-fbcb-40a0-8fd7-a70917090af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849725927e7d4988bff638454bbbe9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:19:01Z,use_quota=True,user_id='caac10c44e2f4ea790e0c008155bcf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:19:01.552862 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc1c747-c7a8-485c-a4d6-9201b4506cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:19:01.557041 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc1c747-c7a8-485c-a4d6-9201b4506cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:19:01.562100 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75f0e25-70b5-4471-8488-cec4638caabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:19:01.638193 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75f0e25-70b5-4471-8488-cec4638caabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '00e00e58-fbcb-40a0-8fd7-a70917090af3', 'volume_name': 'volume-00e00e58-fbcb-40a0-8fd7-a70917090af3', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:19:01.643114 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d968ab6d-66b5-434e-85fe-12fa1ddf50f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:19:01.647116 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d968ab6d-66b5-434e-85fe-12fa1ddf50f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:19:01.652332 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337550a1-fc87-47de-ab2a-f12c735832bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:19:01.653525 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Volume 00e00e58-fbcb-40a0-8fd7-a70917090af3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-00e00e58-fbcb-40a0-8fd7-a70917090af3', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 21:19:01.654085 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Cloning 00e00e58-fbcb-40a0-8fd7-a70917090af3 from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 21:19:01.663904 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:19:01.673647 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 19, 1, 668622)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:19:01.674062 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:19:01.674452 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Found cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 29 21:19:01.678675 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:19:01.679539 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 21:19:01.684660 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 19, 1, 682577)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:19:01.685101 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:19:01.685483 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Creating from source image-volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 29 21:19:01.696347 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:19:01.746321 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] creating snapshot='volume-00e00e58-fbcb-40a0-8fd7-a70917090af3.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 21:19:01.796117 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] cloning 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe@volume-00e00e58-fbcb-40a0-8fd7-a70917090af3.clone_snap' to 'volume-00e00e58-fbcb-40a0-8fd7-a70917090af3' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 21:19:01.921861 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:19:01.922894 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:19:01.923260 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:19:01.939551 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 21:19:01.940157 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Marking volume 00e00e58-fbcb-40a0-8fd7-a70917090af3 as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 21:19:01.948326 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to 00e00e58-fbcb-40a0-8fd7-a70917090af3. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 21:19:01.948751 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Creating volume glance metadata for volume 00e00e58-fbcb-40a0-8fd7-a70917090af3 backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 21:19:01.998559 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337550a1-fc87-47de-ab2a-f12c735832bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e00e58-fbcb-40a0-8fd7-a70917090af3', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:19:02.003433 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10dc618a-3309-449c-b410-e87835eb6b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:19:02.012411 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Volume volume-00e00e58-fbcb-40a0-8fd7-a70917090af3 (00e00e58-fbcb-40a0-8fd7-a70917090af3): created successfully Jan 29 21:19:02.016096 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10dc618a-3309-449c-b410-e87835eb6b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:19:02.021560 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Flow 'volume_create_manager' (aa51a36e-7520-44ba-b82e-b303a184474c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:19:02.029494 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-29ea9f4e-581c-44ee-ace1-25e63c39c07e tempest-TestVolumeBootPattern-1467177201 None] Created volume successfully. Jan 29 21:19:04.727865 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-56f01efd-17b3-452a-a3d7-fb14e76726a3 req-f951d881-0dc7-4a12-b045-44327ce32f25 tempest-TestVolumeBootPattern-1467177201 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:19:05.382125 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-56f01efd-17b3-452a-a3d7-fb14e76726a3 req-f951d881-0dc7-4a12-b045-44327ce32f25 tempest-TestVolumeBootPattern-1467177201 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.653s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:19:05.382992 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-56f01efd-17b3-452a-a3d7-fb14e76726a3 req-f951d881-0dc7-4a12-b045-44327ce32f25 tempest-TestVolumeBootPattern-1467177201 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-00e00e58-fbcb-40a0-8fd7-a70917090af3', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '00e00e58-fbcb-40a0-8fd7-a70917090af3', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:19:05.410441 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-56f01efd-17b3-452a-a3d7-fb14e76726a3 req-f951d881-0dc7-4a12-b045-44327ce32f25 tempest-TestVolumeBootPattern-1467177201 None] Connection info returned from driver {'name': 'volumes/volume-00e00e58-fbcb-40a0-8fd7-a70917090af3', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '00e00e58-fbcb-40a0-8fd7-a70917090af3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '47bad665-63d6-4f53-8a4d-45f8a76dc02f'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:19:05.460078 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-56f01efd-17b3-452a-a3d7-fb14e76726a3 req-f951d881-0dc7-4a12-b045-44327ce32f25 tempest-TestVolumeBootPattern-1467177201 None] attachment_update completed successfully. Jan 29 21:19:22.969550 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-9cd3284c-e284-4816-a748-b4fd011cd220 req-7ff2dac5-93a1-4aa3-a163-532a466ac313 tempest-AttachVolumeShelveTestJSON-1922477119 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:19:23.605914 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-9cd3284c-e284-4816-a748-b4fd011cd220 req-7ff2dac5-93a1-4aa3-a163-532a466ac313 tempest-AttachVolumeShelveTestJSON-1922477119 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.636s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:19:23.606725 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-9cd3284c-e284-4816-a748-b4fd011cd220 req-7ff2dac5-93a1-4aa3-a163-532a466ac313 tempest-AttachVolumeShelveTestJSON-1922477119 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:19:23.630262 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-9cd3284c-e284-4816-a748-b4fd011cd220 req-7ff2dac5-93a1-4aa3-a163-532a466ac313 tempest-AttachVolumeShelveTestJSON-1922477119 None] Connection info returned from driver {'name': 'volumes/volume-ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a10ac418-8503-4a7b-93b5-41000ed641da'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:19:23.675072 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-9cd3284c-e284-4816-a748-b4fd011cd220 req-7ff2dac5-93a1-4aa3-a163-532a466ac313 tempest-AttachVolumeShelveTestJSON-1922477119 None] attachment_update completed successfully. Jan 29 21:19:28.709075 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:19:28.711298 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:19:28.744339 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:19:28.786724 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:20:28.712468 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:20:28.713155 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:20:28.734519 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:20:28.755929 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:20:45.070175 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-635279cc-dfe9-4dd3-a165-cc287212f637 req-5bdb0250-9543-4772-b2b4-ab747dd2d8f4 tempest-AttachVolumeShelveTestJSON-1922477119 None] Terminate volume connection completed successfully. Jan 29 21:20:45.070826 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-635279cc-dfe9-4dd3-a165-cc287212f637 req-5bdb0250-9543-4772-b2b4-ab747dd2d8f4 tempest-AttachVolumeShelveTestJSON-1922477119 None] Deleting attachment a10ac418-8503-4a7b-93b5-41000ed641da. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:21:05.879597 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:21:05.883323 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:21:05.883873 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:21:05.903364 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Flow 'volume_create_manager' (b1f3e6d4-cf0d-4adc-829b-3fd39c175f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:21:05.910466 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1d0698-9ae5-4bec-91c9-63b901ac9285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:21:05.917366 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:21:05.932883 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1d0698-9ae5-4bec-91c9-63b901ac9285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-440502486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c2afaa0a-c749-4424-9ffa-f9b60391ac42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae6f04a79c84770a4886b60cb268966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:21:06Z,use_quota=True,user_id='66b1c193b6654ff9b2e7354a3e058a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:21:05.938397 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb08b80-1a9c-4017-91cd-7d13699d1430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:21:05.942497 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb08b80-1a9c-4017-91cd-7d13699d1430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:21:05.947715 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744a5882-bf49-495a-9667-2d7635f3c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:21:05.951964 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744a5882-bf49-495a-9667-2d7635f3c311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2afaa0a-c749-4424-9ffa-f9b60391ac42', 'volume_name': 'volume-c2afaa0a-c749-4424-9ffa-f9b60391ac42', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:21:05.956833 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3993db2-3861-4893-91ec-ecb9738fc773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:21:05.960832 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3993db2-3861-4893-91ec-ecb9738fc773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:21:05.965516 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8966c47e-acfd-45ee-b278-b3853ce18392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:21:05.966617 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Volume c2afaa0a-c749-4424-9ffa-f9b60391ac42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2afaa0a-c749-4424-9ffa-f9b60391ac42', 'volume_size': 1} Jan 29 21:21:05.967576 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] creating volume 'volume-c2afaa0a-c749-4424-9ffa-f9b60391ac42' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:21:05.968562 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:21:06.032004 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:21:06.032284 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:21:06.036270 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8966c47e-acfd-45ee-b278-b3853ce18392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2afaa0a-c749-4424-9ffa-f9b60391ac42', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:21:06.041630 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d8a0a7-8b37-4675-8cd0-de080b0531ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:21:06.050849 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Volume volume-c2afaa0a-c749-4424-9ffa-f9b60391ac42 (c2afaa0a-c749-4424-9ffa-f9b60391ac42): created successfully Jan 29 21:21:06.055099 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d8a0a7-8b37-4675-8cd0-de080b0531ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:21:06.060950 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Flow 'volume_create_manager' (b1f3e6d4-cf0d-4adc-829b-3fd39c175f89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:21:06.068897 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f5b70e4d-5660-4b81-ad6c-cc558392ad9a tempest-AttachVolumeShelveTestJSON-1922477119 None] Created volume successfully. Jan 29 21:21:25.127200 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-98df47cb-2be6-4da5-89bc-a68a5d7a72e7 req-1be50108-9ab6-4655-9e2f-7dcc7a497bfc tempest-TestVolumeBootPattern-1467177201 None] Terminate volume connection completed successfully. Jan 29 21:21:25.127824 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-98df47cb-2be6-4da5-89bc-a68a5d7a72e7 req-1be50108-9ab6-4655-9e2f-7dcc7a497bfc tempest-TestVolumeBootPattern-1467177201 None] Deleting attachment 47bad665-63d6-4f53-8a4d-45f8a76dc02f. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:21:28.262339 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-12289349-2274-4731-bc46-c73af130b02f req-7ed1f723-0c88-4c3e-8366-361d92f0e821 tempest-TestVolumeBootPattern-1467177201 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:21:28.714255 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:21:28.715575 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:21:28.748753 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:21:28.789674 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:21:28.914094 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-12289349-2274-4731-bc46-c73af130b02f req-7ed1f723-0c88-4c3e-8366-361d92f0e821 tempest-TestVolumeBootPattern-1467177201 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.652s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:21:28.915095 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-12289349-2274-4731-bc46-c73af130b02f req-7ed1f723-0c88-4c3e-8366-361d92f0e821 tempest-TestVolumeBootPattern-1467177201 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-00e00e58-fbcb-40a0-8fd7-a70917090af3', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '00e00e58-fbcb-40a0-8fd7-a70917090af3', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:21:28.939201 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-12289349-2274-4731-bc46-c73af130b02f req-7ed1f723-0c88-4c3e-8366-361d92f0e821 tempest-TestVolumeBootPattern-1467177201 None] Connection info returned from driver {'name': 'volumes/volume-00e00e58-fbcb-40a0-8fd7-a70917090af3', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '00e00e58-fbcb-40a0-8fd7-a70917090af3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f1862dbe-0fef-4758-8fec-553798b1af59'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:21:28.992280 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-12289349-2274-4731-bc46-c73af130b02f req-7ed1f723-0c88-4c3e-8366-361d92f0e821 tempest-TestVolumeBootPattern-1467177201 None] attachment_update completed successfully. Jan 29 21:22:28.717503 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:22:28.718255 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:22:28.759290 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:22:28.789406 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:22:37.882890 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-e609596e-3fe7-4be6-911d-0c71a5426ceb req-4ab7c786-9087-4854-b38c-ccc2c2fdf0e8 tempest-AttachVolumeShelveTestJSON-1922477119 None] No connector for attachment eae8da7a-a815-4e79-b705-61d31121c4e7; skipping storage backend terminate_connection call. {{(pid=134283) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4902}} Jan 29 21:22:37.883618 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-e609596e-3fe7-4be6-911d-0c71a5426ceb req-4ab7c786-9087-4854-b38c-ccc2c2fdf0e8 tempest-AttachVolumeShelveTestJSON-1922477119 None] Deleting attachment eae8da7a-a815-4e79-b705-61d31121c4e7. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:23:17.363595 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-11984644-68c6-443f-b12c-c1d59db44ef4 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:23:18.527213 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-11984644-68c6-443f-b12c-c1d59db44ef4 tempest-TestVolumeBootPattern-1467177201 None] Create snapshot completed successfully Jan 29 21:23:19.763087 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:23:19.767074 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:23:19.767559 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:23:19.794922 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Flow 'volume_create_manager' (63d416ad-cefc-4fb7-94ba-1be6024cc26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:23:19.802153 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27564da-6ac3-4b1a-9db1-dbbfdabd3eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:23:19.808467 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:23:19.822795 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27564da-6ac3-4b1a-9db1-dbbfdabd3eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-632652992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4904d3ce-0b89-4550-9f98-adf6571bc53e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849725927e7d4988bff638454bbbe9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a39f95e-da62-4e5e-a793-e3715deffe4a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:23:20Z,use_quota=True,user_id='caac10c44e2f4ea790e0c008155bcf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:23:19.828845 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ad2f7f-0a36-430d-976f-e50273c50144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:23:19.833076 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ad2f7f-0a36-430d-976f-e50273c50144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:23:19.838178 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27361ef0-771a-4d03-aac4-dd10e3ba1992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:23:19.842344 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27361ef0-771a-4d03-aac4-dd10e3ba1992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4904d3ce-0b89-4550-9f98-adf6571bc53e', 'volume_name': 'volume-4904d3ce-0b89-4550-9f98-adf6571bc53e', 'volume_size': 1, 'snapshot_id': '1a39f95e-da62-4e5e-a793-e3715deffe4a'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:23:19.847279 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bf7648-3c8f-4c00-a786-3c79854f9a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:23:19.851305 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bf7648-3c8f-4c00-a786-3c79854f9a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:23:19.856013 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c020dc6-b9f8-4f17-80e9-661822d2a864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:23:19.857104 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Volume 4904d3ce-0b89-4550-9f98-adf6571bc53e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4904d3ce-0b89-4550-9f98-adf6571bc53e', 'volume_size': 1, 'snapshot_id': '1a39f95e-da62-4e5e-a793-e3715deffe4a'} Jan 29 21:23:19.877651 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] cloning volumes/volume-00e00e58-fbcb-40a0-8fd7-a70917090af3@snapshot-1a39f95e-da62-4e5e-a793-e3715deffe4a to volume-4904d3ce-0b89-4550-9f98-adf6571bc53e {{(pid=134283) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 29 21:23:19.878547 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:23:19.937694 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:23:20.057098 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:23:20.057386 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:23:20.075581 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Marking volume 4904d3ce-0b89-4550-9f98-adf6571bc53e as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 21:23:20.079795 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Copying metadata from snapshot 1a39f95e-da62-4e5e-a793-e3715deffe4a to 4904d3ce-0b89-4550-9f98-adf6571bc53e. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Jan 29 21:23:20.111663 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c020dc6-b9f8-4f17-80e9-661822d2a864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4904d3ce-0b89-4550-9f98-adf6571bc53e', 'volume_size': 1, 'snapshot_id': '1a39f95e-da62-4e5e-a793-e3715deffe4a'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:23:20.116274 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cc7735-d870-4df7-a412-e7bc270dea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:23:20.123754 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Volume volume-4904d3ce-0b89-4550-9f98-adf6571bc53e (4904d3ce-0b89-4550-9f98-adf6571bc53e): created successfully Jan 29 21:23:20.127494 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cc7735-d870-4df7-a412-e7bc270dea7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:23:20.132870 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Flow 'volume_create_manager' (63d416ad-cefc-4fb7-94ba-1be6024cc26a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:23:20.144743 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-7e58233d-fc8f-4c96-8204-489e2bf18fac tempest-TestVolumeBootPattern-1467177201 None] Created volume successfully. Jan 29 21:23:22.557734 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-016a7e59-4978-4246-8798-5835cf468d93 req-8fc6df43-1647-4e93-a283-0b0fa9ca7f10 tempest-TestVolumeBootPattern-1467177201 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:23:23.241103 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-016a7e59-4978-4246-8798-5835cf468d93 req-8fc6df43-1647-4e93-a283-0b0fa9ca7f10 tempest-TestVolumeBootPattern-1467177201 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.683s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:23:23.242212 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-016a7e59-4978-4246-8798-5835cf468d93 req-8fc6df43-1647-4e93-a283-0b0fa9ca7f10 tempest-TestVolumeBootPattern-1467177201 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4904d3ce-0b89-4550-9f98-adf6571bc53e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '4904d3ce-0b89-4550-9f98-adf6571bc53e', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:23:23.266310 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-016a7e59-4978-4246-8798-5835cf468d93 req-8fc6df43-1647-4e93-a283-0b0fa9ca7f10 tempest-TestVolumeBootPattern-1467177201 None] Connection info returned from driver {'name': 'volumes/volume-4904d3ce-0b89-4550-9f98-adf6571bc53e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4904d3ce-0b89-4550-9f98-adf6571bc53e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1635ba87-d09b-438b-860e-dd8682bc7b3f'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:23:23.315915 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-016a7e59-4978-4246-8798-5835cf468d93 req-8fc6df43-1647-4e93-a283-0b0fa9ca7f10 tempest-TestVolumeBootPattern-1467177201 None] attachment_update completed successfully. Jan 29 21:23:28.715145 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:23:28.716502 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:23:28.740553 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:23:28.762893 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:23:59.764033 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-5ce223f4-ed68-4721-b386-652ad094c7de tempest-AttachVolumeShelveTestJSON-1922477119 None] Lock "b'cinder-c2afaa0a-c749-4424-9ffa-f9b60391ac42-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:23:59.800087 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5ce223f4-ed68-4721-b386-652ad094c7de tempest-AttachVolumeShelveTestJSON-1922477119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:23:59.839413 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5ce223f4-ed68-4721-b386-652ad094c7de tempest-AttachVolumeShelveTestJSON-1922477119 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:23:59.840043 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5ce223f4-ed68-4721-b386-652ad094c7de tempest-AttachVolumeShelveTestJSON-1922477119 None] Volume volume-c2afaa0a-c749-4424-9ffa-f9b60391ac42 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:23:59.847449 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5ce223f4-ed68-4721-b386-652ad094c7de tempest-AttachVolumeShelveTestJSON-1922477119 None] deleting rbd volume volume-c2afaa0a-c749-4424-9ffa-f9b60391ac42 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:24:00.096608 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-5ce223f4-ed68-4721-b386-652ad094c7de tempest-AttachVolumeShelveTestJSON-1922477119 None] Created reservations ['ce86b150-705a-4c6d-a728-734382d316d9', '7f7d04b2-3422-4272-a533-677e166989f3', '9b4a5ff0-80e1-445b-91d3-f09dfdaf0c44', '3d74f0ae-acb1-4e63-9586-8c54c23d4e4d'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:24:00.134624 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5ce223f4-ed68-4721-b386-652ad094c7de tempest-AttachVolumeShelveTestJSON-1922477119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:24:00.158205 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-5ce223f4-ed68-4721-b386-652ad094c7de tempest-AttachVolumeShelveTestJSON-1922477119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:24:00.185749 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-5ce223f4-ed68-4721-b386-652ad094c7de tempest-AttachVolumeShelveTestJSON-1922477119 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:24:00.190015 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-5ce223f4-ed68-4721-b386-652ad094c7de tempest-AttachVolumeShelveTestJSON-1922477119 None] Deleted volume successfully. Jan 29 21:24:00.201406 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-5ce223f4-ed68-4721-b386-652ad094c7de tempest-AttachVolumeShelveTestJSON-1922477119 None] Lock "b'cinder-c2afaa0a-c749-4424-9ffa-f9b60391ac42-delete_volume'" released by "delete_volume" :: held 0.437s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:24:00.948036 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-18fe580d-5c59-419e-aca9-6261921dcf9c tempest-AttachVolumeShelveTestJSON-1922477119 None] Lock "b'cinder-ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:24:00.977438 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-18fe580d-5c59-419e-aca9-6261921dcf9c tempest-AttachVolumeShelveTestJSON-1922477119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:24:01.014619 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-18fe580d-5c59-419e-aca9-6261921dcf9c tempest-AttachVolumeShelveTestJSON-1922477119 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:24:01.015041 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-18fe580d-5c59-419e-aca9-6261921dcf9c tempest-AttachVolumeShelveTestJSON-1922477119 None] Volume volume-ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:24:01.022055 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-18fe580d-5c59-419e-aca9-6261921dcf9c tempest-AttachVolumeShelveTestJSON-1922477119 None] deleting rbd volume volume-ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:24:01.220690 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-18fe580d-5c59-419e-aca9-6261921dcf9c tempest-AttachVolumeShelveTestJSON-1922477119 None] Created reservations ['af7e3791-449f-4d07-9615-c469b5ae22cf', '176052c5-874c-42d5-b404-bf41c9ff6298', 'f1c07aad-21be-41d1-be0a-66b041a1833f', 'a6d7a63d-067c-4bac-800e-836211b945f9'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:24:01.258018 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-18fe580d-5c59-419e-aca9-6261921dcf9c tempest-AttachVolumeShelveTestJSON-1922477119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:24:01.279245 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-18fe580d-5c59-419e-aca9-6261921dcf9c tempest-AttachVolumeShelveTestJSON-1922477119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:24:01.303857 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-18fe580d-5c59-419e-aca9-6261921dcf9c tempest-AttachVolumeShelveTestJSON-1922477119 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:24:01.307795 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-18fe580d-5c59-419e-aca9-6261921dcf9c tempest-AttachVolumeShelveTestJSON-1922477119 None] Deleted volume successfully. Jan 29 21:24:01.326231 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-18fe580d-5c59-419e-aca9-6261921dcf9c tempest-AttachVolumeShelveTestJSON-1922477119 None] Lock "b'cinder-ab55244a-8e54-4c7e-8fd3-7e2fbe6cf0b6-delete_volume'" released by "delete_volume" :: held 0.379s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:24:28.718047 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:24:28.718754 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:24:28.742115 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:24:28.764119 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:25:17.511889 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-a77c7a70-2642-45e4-b12c-f4c1883d23a3 req-902e9065-4fc1-452a-b399-d0337e2d50df tempest-TestVolumeBootPattern-1467177201 None] Terminate volume connection completed successfully. Jan 29 21:25:17.512512 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-a77c7a70-2642-45e4-b12c-f4c1883d23a3 req-902e9065-4fc1-452a-b399-d0337e2d50df tempest-TestVolumeBootPattern-1467177201 None] Deleting attachment 1635ba87-d09b-438b-860e-dd8682bc7b3f. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:25:18.958489 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-14e940a3-0e58-44a1-9cb9-ca652f95fb05 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-4904d3ce-0b89-4550-9f98-adf6571bc53e-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:25:18.989204 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-14e940a3-0e58-44a1-9cb9-ca652f95fb05 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:25:19.062532 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-14e940a3-0e58-44a1-9cb9-ca652f95fb05 tempest-TestVolumeBootPattern-1467177201 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:25:19.069477 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-14e940a3-0e58-44a1-9cb9-ca652f95fb05 tempest-TestVolumeBootPattern-1467177201 None] deleting rbd volume volume-4904d3ce-0b89-4550-9f98-adf6571bc53e {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:25:19.305019 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-14e940a3-0e58-44a1-9cb9-ca652f95fb05 tempest-TestVolumeBootPattern-1467177201 None] Created reservations ['ed276d8c-0a26-4fea-8b0c-463cf901e5a9', '848683a2-63d0-4e55-bb6a-701acdd716fd', 'fb1b23b6-9e31-45f9-804a-78722d514047', 'c7d80469-0f22-43c4-9ef0-563f5d9d05ec'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:25:19.344000 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-14e940a3-0e58-44a1-9cb9-ca652f95fb05 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:25:19.366751 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-14e940a3-0e58-44a1-9cb9-ca652f95fb05 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:25:19.388304 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-14e940a3-0e58-44a1-9cb9-ca652f95fb05 tempest-TestVolumeBootPattern-1467177201 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:25:19.392577 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-14e940a3-0e58-44a1-9cb9-ca652f95fb05 tempest-TestVolumeBootPattern-1467177201 None] Deleted volume successfully. Jan 29 21:25:19.403375 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-14e940a3-0e58-44a1-9cb9-ca652f95fb05 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-4904d3ce-0b89-4550-9f98-adf6571bc53e-delete_volume'" released by "delete_volume" :: held 0.445s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:25:20.080567 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-89469b97-8748-4ebe-89ee-4ebebeb791f6 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-1a39f95e-da62-4e5e-a793-e3715deffe4a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:25:20.082167 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-89469b97-8748-4ebe-89ee-4ebebeb791f6 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:25:28.718884 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:25:28.719513 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:25:28.740553 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:25:28.761388 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:25:31.037921 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:25:31.041384 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:25:31.041858 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:25:31.061207 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Flow 'volume_create_manager' (d0fac243-e1fe-49e1-9725-15357f596523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:25:31.067730 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0698930d-32e4-4356-b232-7f39810a13ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:25:31.073982 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:25:31.088039 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0698930d-32e4-4356-b232-7f39810a13ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1555123511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3b58e828-0a9f-4cf2-be3d-4d994fa321f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d23fa2402894228bc06c5f73f23ce7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:25:31Z,use_quota=True,user_id='315a95281a5244fc9110da00ebb9fbe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:25:31.094077 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0e8cb2-92f8-418d-b490-76ed30664165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:25:31.098337 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0e8cb2-92f8-418d-b490-76ed30664165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:25:31.103443 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005ac709-87b4-45cf-92d5-b85c4129e363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:25:31.107626 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005ac709-87b4-45cf-92d5-b85c4129e363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b58e828-0a9f-4cf2-be3d-4d994fa321f2', 'volume_name': 'volume-3b58e828-0a9f-4cf2-be3d-4d994fa321f2', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:25:31.112894 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff06896c-0645-4a5d-924c-419e2ba220bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:25:31.117037 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff06896c-0645-4a5d-924c-419e2ba220bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:25:31.121702 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9472b8-d67e-40ba-aab3-a1901103750c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:25:31.122753 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Volume 3b58e828-0a9f-4cf2-be3d-4d994fa321f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b58e828-0a9f-4cf2-be3d-4d994fa321f2', 'volume_size': 1} Jan 29 21:25:31.123194 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] creating volume 'volume-3b58e828-0a9f-4cf2-be3d-4d994fa321f2' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:25:31.124140 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:25:31.172080 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:25:31.172479 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:25:31.176497 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9472b8-d67e-40ba-aab3-a1901103750c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b58e828-0a9f-4cf2-be3d-4d994fa321f2', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:25:31.181208 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed45945a-922e-4e62-89d4-3c7281e36d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:25:31.190235 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Volume volume-3b58e828-0a9f-4cf2-be3d-4d994fa321f2 (3b58e828-0a9f-4cf2-be3d-4d994fa321f2): created successfully Jan 29 21:25:31.193795 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed45945a-922e-4e62-89d4-3c7281e36d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:25:31.199374 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Flow 'volume_create_manager' (d0fac243-e1fe-49e1-9725-15357f596523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:25:31.207319 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-7a1042b5-55b4-4ff2-b4f5-bdb674012ee3 tempest-AttachVolumeTestJSON-648418794 None] Created volume successfully. Jan 29 21:25:32.433636 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-aa6c8160-f96a-4c4f-9cc6-8b7295e0ca4a req-52872e77-e33b-432b-a37a-41f120639d3d tempest-AttachVolumeTestJSON-648418794 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:25:33.066508 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-aa6c8160-f96a-4c4f-9cc6-8b7295e0ca4a req-52872e77-e33b-432b-a37a-41f120639d3d tempest-AttachVolumeTestJSON-648418794 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.632s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:25:33.067319 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-aa6c8160-f96a-4c4f-9cc6-8b7295e0ca4a req-52872e77-e33b-432b-a37a-41f120639d3d tempest-AttachVolumeTestJSON-648418794 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3b58e828-0a9f-4cf2-be3d-4d994fa321f2', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '3b58e828-0a9f-4cf2-be3d-4d994fa321f2', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:25:33.093443 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-aa6c8160-f96a-4c4f-9cc6-8b7295e0ca4a req-52872e77-e33b-432b-a37a-41f120639d3d tempest-AttachVolumeTestJSON-648418794 None] Connection info returned from driver {'name': 'volumes/volume-3b58e828-0a9f-4cf2-be3d-4d994fa321f2', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3b58e828-0a9f-4cf2-be3d-4d994fa321f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0e902b44-4c9d-4ba7-b544-21828babc83c'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:25:33.135663 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-aa6c8160-f96a-4c4f-9cc6-8b7295e0ca4a req-52872e77-e33b-432b-a37a-41f120639d3d tempest-AttachVolumeTestJSON-648418794 None] attachment_update completed successfully. Jan 29 21:25:50.245033 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-89469b97-8748-4ebe-89ee-4ebebeb791f6 tempest-TestVolumeBootPattern-1467177201 None] Created reservations ['cfe333f8-36b0-486e-9f12-edf964d2bf12', '6851a468-08df-4e85-80d2-76498c3a64fc', '8cdc4b21-4dad-4ca1-b5aa-3f4b25654b44', 'c3f490c1-f967-44b6-95cc-f15ec7635043'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:25:50.283098 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-89469b97-8748-4ebe-89ee-4ebebeb791f6 tempest-TestVolumeBootPattern-1467177201 None] Delete snapshot completed successfully. Jan 29 21:25:50.288117 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-89469b97-8748-4ebe-89ee-4ebebeb791f6 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-1a39f95e-da62-4e5e-a793-e3715deffe4a-delete_snapshot'" released by "delete_snapshot" :: held 30.208s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:25:54.921182 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-f70510cb-685a-4250-8cf4-e59d4d231817 req-0f333084-caa6-4ee5-b537-54445230e527 tempest-TestVolumeBootPattern-1467177201 None] Terminate volume connection completed successfully. Jan 29 21:25:54.921821 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-f70510cb-685a-4250-8cf4-e59d4d231817 req-0f333084-caa6-4ee5-b537-54445230e527 tempest-TestVolumeBootPattern-1467177201 None] Deleting attachment f1862dbe-0fef-4758-8fec-553798b1af59. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:25:56.770912 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-6f0988e6-4b1c-46f1-b55b-d699964c6517 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-00e00e58-fbcb-40a0-8fd7-a70917090af3-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:25:56.801456 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6f0988e6-4b1c-46f1-b55b-d699964c6517 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:25:56.864357 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6f0988e6-4b1c-46f1-b55b-d699964c6517 tempest-TestVolumeBootPattern-1467177201 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:25:56.870738 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6f0988e6-4b1c-46f1-b55b-d699964c6517 tempest-TestVolumeBootPattern-1467177201 None] deleting rbd volume volume-00e00e58-fbcb-40a0-8fd7-a70917090af3 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:25:57.089879 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6f0988e6-4b1c-46f1-b55b-d699964c6517 tempest-TestVolumeBootPattern-1467177201 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 21:25:57.118752 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6f0988e6-4b1c-46f1-b55b-d699964c6517 tempest-TestVolumeBootPattern-1467177201 None] deleting parent snapshot volume-00e00e58-fbcb-40a0-8fd7-a70917090af3.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 21:25:57.935060 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-6f0988e6-4b1c-46f1-b55b-d699964c6517 tempest-TestVolumeBootPattern-1467177201 None] Created reservations ['36e97dbd-7f64-4921-9425-70a32f765fa3', 'f6f52ce9-a7cc-4e0a-87a6-303eb201b2e7', '73cbbbec-6cb4-4290-a8c1-8b28507ccfcb', '83e77f3a-f3a5-414b-a5c6-7a54f81261e9'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:25:57.978348 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6f0988e6-4b1c-46f1-b55b-d699964c6517 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:25:58.001441 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6f0988e6-4b1c-46f1-b55b-d699964c6517 tempest-TestVolumeBootPattern-1467177201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:25:58.024030 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-6f0988e6-4b1c-46f1-b55b-d699964c6517 tempest-TestVolumeBootPattern-1467177201 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:25:58.028284 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6f0988e6-4b1c-46f1-b55b-d699964c6517 tempest-TestVolumeBootPattern-1467177201 None] Deleted volume successfully. Jan 29 21:25:58.040049 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-6f0988e6-4b1c-46f1-b55b-d699964c6517 tempest-TestVolumeBootPattern-1467177201 None] Lock "b'cinder-00e00e58-fbcb-40a0-8fd7-a70917090af3-delete_volume'" released by "delete_volume" :: held 1.269s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:26:28.716964 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:26:28.717636 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:26:28.738729 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:26:28.760480 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:26:44.078115 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-d75cdc8c-54ae-4e5a-843f-4bc324a9d094 req-1a0edef7-de14-4f34-a174-3aeb2431af76 tempest-AttachVolumeTestJSON-648418794 None] Terminate volume connection completed successfully. Jan 29 21:26:44.078749 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-d75cdc8c-54ae-4e5a-843f-4bc324a9d094 req-1a0edef7-de14-4f34-a174-3aeb2431af76 tempest-AttachVolumeTestJSON-648418794 None] Deleting attachment 0e902b44-4c9d-4ba7-b544-21828babc83c. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:27:28.715622 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:27:28.716278 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:27:28.737608 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:27:28.759419 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:28:21.748462 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:28:21.752471 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:28:21.752956 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:28:21.772401 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Flow 'volume_create_manager' (c7cac9e9-8e33-4ae0-9604-78ecfa79e298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:28:21.778980 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7538e8f-4511-4952-ac2b-5efa1f5d5562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:28:21.786455 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:28:21.799859 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7538e8f-4511-4952-ac2b-5efa1f5d5562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-302379412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ba0de2a2-10e1-4085-83a9-e24e4489d58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d23fa2402894228bc06c5f73f23ce7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:28:22Z,use_quota=True,user_id='315a95281a5244fc9110da00ebb9fbe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:28:21.805610 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aaffbbc-8050-4fc9-90da-eb4162f9c544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:28:21.809753 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aaffbbc-8050-4fc9-90da-eb4162f9c544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:28:21.814882 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc8288a-054c-4ce2-8eff-97509a560336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:28:21.819103 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc8288a-054c-4ce2-8eff-97509a560336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba0de2a2-10e1-4085-83a9-e24e4489d58b', 'volume_name': 'volume-ba0de2a2-10e1-4085-83a9-e24e4489d58b', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:28:21.824030 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032d0956-2375-437c-a189-eff7de866aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:28:21.828021 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032d0956-2375-437c-a189-eff7de866aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:28:21.833298 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd0680e-ca60-499e-b74e-ea202d908465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:28:21.834373 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Volume ba0de2a2-10e1-4085-83a9-e24e4489d58b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba0de2a2-10e1-4085-83a9-e24e4489d58b', 'volume_size': 1} Jan 29 21:28:21.834767 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] creating volume 'volume-ba0de2a2-10e1-4085-83a9-e24e4489d58b' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:28:21.835729 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:28:21.887675 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:28:21.888043 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:28:21.892187 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd0680e-ca60-499e-b74e-ea202d908465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba0de2a2-10e1-4085-83a9-e24e4489d58b', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:28:21.897770 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c85d4c0-7ed8-42c9-b7be-5add0cb2b817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:28:21.906978 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Volume volume-ba0de2a2-10e1-4085-83a9-e24e4489d58b (ba0de2a2-10e1-4085-83a9-e24e4489d58b): created successfully Jan 29 21:28:21.910534 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c85d4c0-7ed8-42c9-b7be-5add0cb2b817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:28:21.915958 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Flow 'volume_create_manager' (c7cac9e9-8e33-4ae0-9604-78ecfa79e298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:28:21.922907 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ccd1e69d-6f66-433e-b42a-276c980694dc tempest-AttachVolumeTestJSON-648418794 None] Created volume successfully. Jan 29 21:28:23.141469 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-62a5110e-c674-4e55-a332-1e1eb3950d08 req-01d8922a-c7db-4880-ae0c-c02cb9167598 tempest-AttachVolumeTestJSON-648418794 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:28:23.767550 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-62a5110e-c674-4e55-a332-1e1eb3950d08 req-01d8922a-c7db-4880-ae0c-c02cb9167598 tempest-AttachVolumeTestJSON-648418794 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.626s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:28:23.768500 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-62a5110e-c674-4e55-a332-1e1eb3950d08 req-01d8922a-c7db-4880-ae0c-c02cb9167598 tempest-AttachVolumeTestJSON-648418794 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ba0de2a2-10e1-4085-83a9-e24e4489d58b', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'ba0de2a2-10e1-4085-83a9-e24e4489d58b', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:28:23.792106 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-62a5110e-c674-4e55-a332-1e1eb3950d08 req-01d8922a-c7db-4880-ae0c-c02cb9167598 tempest-AttachVolumeTestJSON-648418794 None] Connection info returned from driver {'name': 'volumes/volume-ba0de2a2-10e1-4085-83a9-e24e4489d58b', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ba0de2a2-10e1-4085-83a9-e24e4489d58b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9528d4b3-d7cf-49ea-92b2-3596e7f6a7bb'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:28:23.834690 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-62a5110e-c674-4e55-a332-1e1eb3950d08 req-01d8922a-c7db-4880-ae0c-c02cb9167598 tempest-AttachVolumeTestJSON-648418794 None] attachment_update completed successfully. Jan 29 21:28:25.580416 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:28:25.584690 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:28:25.585235 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:28:25.605216 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Flow 'volume_create_manager' (11dc4d3d-79c3-46d2-9ec9-3049efc4a53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:28:25.611801 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf2032e-93e2-4f8a-8369-a62742f02a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:28:25.618074 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:28:25.632305 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf2032e-93e2-4f8a-8369-a62742f02a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-619327325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9eced2b3-28cf-4ab4-bf87-b2660e329a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d23fa2402894228bc06c5f73f23ce7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:28:26Z,use_quota=True,user_id='315a95281a5244fc9110da00ebb9fbe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:28:25.637696 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25be3e8-dcff-4968-b5eb-ada0f95b9308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:28:25.641798 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25be3e8-dcff-4968-b5eb-ada0f95b9308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:28:25.647443 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b9e6b9-ffdd-43cd-9d9a-ec297f5ce4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:28:25.651583 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b9e6b9-ffdd-43cd-9d9a-ec297f5ce4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eced2b3-28cf-4ab4-bf87-b2660e329a9b', 'volume_name': 'volume-9eced2b3-28cf-4ab4-bf87-b2660e329a9b', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:28:25.656451 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be5b21f-fb9f-475a-b7ed-887934c0e93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:28:25.660570 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be5b21f-fb9f-475a-b7ed-887934c0e93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:28:25.665270 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad6a4cd-92cc-4125-b8f4-40c62256ce51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:28:25.666325 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Volume 9eced2b3-28cf-4ab4-bf87-b2660e329a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eced2b3-28cf-4ab4-bf87-b2660e329a9b', 'volume_size': 1} Jan 29 21:28:25.666718 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] creating volume 'volume-9eced2b3-28cf-4ab4-bf87-b2660e329a9b' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:28:25.667786 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:28:25.721255 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:28:25.721629 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:28:25.725350 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad6a4cd-92cc-4125-b8f4-40c62256ce51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eced2b3-28cf-4ab4-bf87-b2660e329a9b', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:28:25.729910 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3878b6-af81-432d-aa25-52f1f9dcb075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:28:25.738808 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Volume volume-9eced2b3-28cf-4ab4-bf87-b2660e329a9b (9eced2b3-28cf-4ab4-bf87-b2660e329a9b): created successfully Jan 29 21:28:25.742338 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3878b6-af81-432d-aa25-52f1f9dcb075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:28:25.747717 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Flow 'volume_create_manager' (11dc4d3d-79c3-46d2-9ec9-3049efc4a53a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:28:25.755368 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-2309a6a6-929c-4529-a187-7d3ba03f0bb5 tempest-AttachVolumeTestJSON-648418794 None] Created volume successfully. Jan 29 21:28:26.961274 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-9db3aac0-72b3-4e5f-91bb-83779153c09f req-665b51f9-6671-4309-8359-e7ee400b94f4 tempest-AttachVolumeTestJSON-648418794 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:28:27.595368 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-9db3aac0-72b3-4e5f-91bb-83779153c09f req-665b51f9-6671-4309-8359-e7ee400b94f4 tempest-AttachVolumeTestJSON-648418794 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.634s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:28:27.596218 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-9db3aac0-72b3-4e5f-91bb-83779153c09f req-665b51f9-6671-4309-8359-e7ee400b94f4 tempest-AttachVolumeTestJSON-648418794 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9eced2b3-28cf-4ab4-bf87-b2660e329a9b', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '9eced2b3-28cf-4ab4-bf87-b2660e329a9b', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:28:27.618747 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-9db3aac0-72b3-4e5f-91bb-83779153c09f req-665b51f9-6671-4309-8359-e7ee400b94f4 tempest-AttachVolumeTestJSON-648418794 None] Connection info returned from driver {'name': 'volumes/volume-9eced2b3-28cf-4ab4-bf87-b2660e329a9b', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9eced2b3-28cf-4ab4-bf87-b2660e329a9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b8573241-fd80-420c-8d5a-999bbbc34392'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:28:27.664887 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-9db3aac0-72b3-4e5f-91bb-83779153c09f req-665b51f9-6671-4309-8359-e7ee400b94f4 tempest-AttachVolumeTestJSON-648418794 None] attachment_update completed successfully. Jan 29 21:28:28.714388 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:28:28.715438 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:28:28.739678 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:28:28.762098 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:29:28.717432 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:29:28.718223 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:28.740108 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:28.762261 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:29:30.514638 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-1bfb68db-1208-45d7-8ac0-15f2594786ae req-e4e061a1-4e29-47cb-8cef-39158b34d511 tempest-AttachVolumeTestJSON-648418794 None] Terminate volume connection completed successfully. Jan 29 21:29:30.515229 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-1bfb68db-1208-45d7-8ac0-15f2594786ae req-e4e061a1-4e29-47cb-8cef-39158b34d511 tempest-AttachVolumeTestJSON-648418794 None] Deleting attachment 9528d4b3-d7cf-49ea-92b2-3596e7f6a7bb. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:29:31.741584 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-a83ec1bd-4496-433a-91a8-28000e6c6ac7 req-ac493501-58bd-463f-afea-b19afcf56711 tempest-AttachVolumeTestJSON-648418794 None] Terminate volume connection completed successfully. Jan 29 21:29:31.742199 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-a83ec1bd-4496-433a-91a8-28000e6c6ac7 req-ac493501-58bd-463f-afea-b19afcf56711 tempest-AttachVolumeTestJSON-648418794 None] Deleting attachment b8573241-fd80-420c-8d5a-999bbbc34392. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:29:37.017724 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-0b59bb79-9768-4999-8b53-0a948a3b2d50 tempest-AttachVolumeTestJSON-648418794 None] Lock "b'cinder-9eced2b3-28cf-4ab4-bf87-b2660e329a9b-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:29:37.048285 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0b59bb79-9768-4999-8b53-0a948a3b2d50 tempest-AttachVolumeTestJSON-648418794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:37.084142 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0b59bb79-9768-4999-8b53-0a948a3b2d50 tempest-AttachVolumeTestJSON-648418794 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:29:37.084908 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0b59bb79-9768-4999-8b53-0a948a3b2d50 tempest-AttachVolumeTestJSON-648418794 None] Volume volume-9eced2b3-28cf-4ab4-bf87-b2660e329a9b is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:29:37.089727 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0b59bb79-9768-4999-8b53-0a948a3b2d50 tempest-AttachVolumeTestJSON-648418794 None] deleting rbd volume volume-9eced2b3-28cf-4ab4-bf87-b2660e329a9b {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:29:37.276616 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-0b59bb79-9768-4999-8b53-0a948a3b2d50 tempest-AttachVolumeTestJSON-648418794 None] Created reservations ['bf9f1451-98fe-4b42-b892-5e1a9e99202e', '5ae9ede7-5182-4069-b0bd-c381fd895023', '5c513b66-03e0-4456-915e-1330ab9a039e', '06a0dbb4-febe-49e0-b6ce-d8007e23b6ca'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:29:37.318336 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0b59bb79-9768-4999-8b53-0a948a3b2d50 tempest-AttachVolumeTestJSON-648418794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:37.339900 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0b59bb79-9768-4999-8b53-0a948a3b2d50 tempest-AttachVolumeTestJSON-648418794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:37.362392 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-0b59bb79-9768-4999-8b53-0a948a3b2d50 tempest-AttachVolumeTestJSON-648418794 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:29:37.367866 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-0b59bb79-9768-4999-8b53-0a948a3b2d50 tempest-AttachVolumeTestJSON-648418794 None] Deleted volume successfully. Jan 29 21:29:37.379130 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-0b59bb79-9768-4999-8b53-0a948a3b2d50 tempest-AttachVolumeTestJSON-648418794 None] Lock "b'cinder-9eced2b3-28cf-4ab4-bf87-b2660e329a9b-delete_volume'" released by "delete_volume" :: held 0.361s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:29:38.133344 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e2bbbe6f-ee1a-4dc0-a1f4-d44b0db64b26 tempest-AttachVolumeTestJSON-648418794 None] Lock "b'cinder-ba0de2a2-10e1-4085-83a9-e24e4489d58b-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:29:38.162768 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e2bbbe6f-ee1a-4dc0-a1f4-d44b0db64b26 tempest-AttachVolumeTestJSON-648418794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:38.203295 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e2bbbe6f-ee1a-4dc0-a1f4-d44b0db64b26 tempest-AttachVolumeTestJSON-648418794 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:29:38.203720 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e2bbbe6f-ee1a-4dc0-a1f4-d44b0db64b26 tempest-AttachVolumeTestJSON-648418794 None] Volume volume-ba0de2a2-10e1-4085-83a9-e24e4489d58b is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:29:38.207843 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e2bbbe6f-ee1a-4dc0-a1f4-d44b0db64b26 tempest-AttachVolumeTestJSON-648418794 None] deleting rbd volume volume-ba0de2a2-10e1-4085-83a9-e24e4489d58b {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:29:38.392193 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-e2bbbe6f-ee1a-4dc0-a1f4-d44b0db64b26 tempest-AttachVolumeTestJSON-648418794 None] Created reservations ['5df54efd-2bed-4e88-8cc2-0d8d81ced5ea', '0267567d-7d3d-49a2-862c-6a347a31315a', '49c490c4-4b95-49d0-8c08-c493813612ac', '93353df1-ce23-460d-bddd-cc9bf5efbe03'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:29:38.429506 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e2bbbe6f-ee1a-4dc0-a1f4-d44b0db64b26 tempest-AttachVolumeTestJSON-648418794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:38.452035 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e2bbbe6f-ee1a-4dc0-a1f4-d44b0db64b26 tempest-AttachVolumeTestJSON-648418794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:38.474139 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e2bbbe6f-ee1a-4dc0-a1f4-d44b0db64b26 tempest-AttachVolumeTestJSON-648418794 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:29:38.479977 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e2bbbe6f-ee1a-4dc0-a1f4-d44b0db64b26 tempest-AttachVolumeTestJSON-648418794 None] Deleted volume successfully. Jan 29 21:29:38.491230 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e2bbbe6f-ee1a-4dc0-a1f4-d44b0db64b26 tempest-AttachVolumeTestJSON-648418794 None] Lock "b'cinder-ba0de2a2-10e1-4085-83a9-e24e4489d58b-delete_volume'" released by "delete_volume" :: held 0.358s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:29:39.316933 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-39e1ad5c-ce42-4386-b453-9b495e90d2d3 tempest-AttachVolumeTestJSON-648418794 None] Lock "b'cinder-3b58e828-0a9f-4cf2-be3d-4d994fa321f2-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:29:39.347108 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-39e1ad5c-ce42-4386-b453-9b495e90d2d3 tempest-AttachVolumeTestJSON-648418794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:39.388710 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-39e1ad5c-ce42-4386-b453-9b495e90d2d3 tempest-AttachVolumeTestJSON-648418794 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:29:39.389175 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-39e1ad5c-ce42-4386-b453-9b495e90d2d3 tempest-AttachVolumeTestJSON-648418794 None] Volume volume-3b58e828-0a9f-4cf2-be3d-4d994fa321f2 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:29:39.393835 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-39e1ad5c-ce42-4386-b453-9b495e90d2d3 tempest-AttachVolumeTestJSON-648418794 None] deleting rbd volume volume-3b58e828-0a9f-4cf2-be3d-4d994fa321f2 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:29:39.586210 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-39e1ad5c-ce42-4386-b453-9b495e90d2d3 tempest-AttachVolumeTestJSON-648418794 None] Created reservations ['de38045a-3443-4d91-af94-bc026a76acea', 'a7cdad7c-4dd3-4f4c-ac51-0a69a4efc1d1', '1648dbef-b2b9-4df6-ad83-5045df22194d', 'cda6663d-a664-4ae4-a967-c2e8e71536b3'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:29:39.625839 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-39e1ad5c-ce42-4386-b453-9b495e90d2d3 tempest-AttachVolumeTestJSON-648418794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:39.648253 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-39e1ad5c-ce42-4386-b453-9b495e90d2d3 tempest-AttachVolumeTestJSON-648418794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:39.670601 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-39e1ad5c-ce42-4386-b453-9b495e90d2d3 tempest-AttachVolumeTestJSON-648418794 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:29:39.675318 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-39e1ad5c-ce42-4386-b453-9b495e90d2d3 tempest-AttachVolumeTestJSON-648418794 None] Deleted volume successfully. Jan 29 21:29:39.688153 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-39e1ad5c-ce42-4386-b453-9b495e90d2d3 tempest-AttachVolumeTestJSON-648418794 None] Lock "b'cinder-3b58e828-0a9f-4cf2-be3d-4d994fa321f2-delete_volume'" released by "delete_volume" :: held 0.371s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:29:44.893978 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:29:44.898005 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:29:44.898485 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:29:44.918632 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Flow 'volume_create_manager' (270f60d7-701d-434b-9b2d-55f48609ac7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:29:44.925770 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737ac1d4-1867-4497-9008-a669bfc39f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:44.934735 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:29:44.949346 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737ac1d4-1867-4497-9008-a669bfc39f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-743063628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a31d5e1e-0258-4cba-ab2b-dfeac786dc19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5392bb4df9a347d6b4c2983464654b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:29:45Z,use_quota=True,user_id='255fcb950020475c8e84c1cb3e5c00aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:44.954892 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3273c6-3d8b-4acf-8972-be21ca9dfa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:44.959100 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3273c6-3d8b-4acf-8972-be21ca9dfa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:44.964828 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94596dc2-eb8b-411b-82ac-6e9c3bb5fcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:44.969084 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94596dc2-eb8b-411b-82ac-6e9c3bb5fcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a31d5e1e-0258-4cba-ab2b-dfeac786dc19', 'volume_name': 'volume-a31d5e1e-0258-4cba-ab2b-dfeac786dc19', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:44.974409 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf33c5da-7dfb-4138-911c-7e55948e7310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:44.979158 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf33c5da-7dfb-4138-911c-7e55948e7310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:44.983927 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85d64da-3345-4669-85ee-8e90e049e17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:44.985058 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Volume a31d5e1e-0258-4cba-ab2b-dfeac786dc19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a31d5e1e-0258-4cba-ab2b-dfeac786dc19', 'volume_size': 1} Jan 29 21:29:44.985461 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] creating volume 'volume-a31d5e1e-0258-4cba-ab2b-dfeac786dc19' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:29:44.986429 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:45.036096 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:29:45.036395 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:29:45.040122 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85d64da-3345-4669-85ee-8e90e049e17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a31d5e1e-0258-4cba-ab2b-dfeac786dc19', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:45.044776 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7214cff-245a-4a93-a08f-0f210abf5d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:45.053536 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Volume volume-a31d5e1e-0258-4cba-ab2b-dfeac786dc19 (a31d5e1e-0258-4cba-ab2b-dfeac786dc19): created successfully Jan 29 21:29:45.056978 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7214cff-245a-4a93-a08f-0f210abf5d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:45.062681 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Flow 'volume_create_manager' (270f60d7-701d-434b-9b2d-55f48609ac7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:29:45.069495 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4c456ad4-dfe2-47c7-88f1-4dc18a03d6fa tempest-VolumesTestJSON-1956739924 None] Created volume successfully. Jan 29 21:29:46.229285 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:29:46.232385 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:29:46.232826 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:29:46.252393 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Flow 'volume_create_manager' (3c2c25ba-684f-4033-a501-3d3e8c99a423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:29:46.259934 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550c2c11-48f9-41c1-93c6-8370adb5ef1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:46.266249 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:29:46.280624 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550c2c11-48f9-41c1-93c6-8370adb5ef1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1521010776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9cd39432-5c94-4e73-8a60-10a4f511ece9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5392bb4df9a347d6b4c2983464654b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:29:46Z,use_quota=True,user_id='255fcb950020475c8e84c1cb3e5c00aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:46.286171 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603b2b7d-d6a5-43df-a951-ea9614810e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:46.290425 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603b2b7d-d6a5-43df-a951-ea9614810e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:46.295588 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d70d1d-18fb-40d4-b438-55a13c495585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:46.299780 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d70d1d-18fb-40d4-b438-55a13c495585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd39432-5c94-4e73-8a60-10a4f511ece9', 'volume_name': 'volume-9cd39432-5c94-4e73-8a60-10a4f511ece9', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:46.304703 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512eeb4a-e102-41ae-b067-077791f2b88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:46.309550 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512eeb4a-e102-41ae-b067-077791f2b88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:46.314312 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78510bd9-e39b-4f20-b88e-9869cfe4fa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:46.315379 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Volume 9cd39432-5c94-4e73-8a60-10a4f511ece9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd39432-5c94-4e73-8a60-10a4f511ece9', 'volume_size': 1} Jan 29 21:29:46.315759 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] creating volume 'volume-9cd39432-5c94-4e73-8a60-10a4f511ece9' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:29:46.316720 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:46.364062 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:29:46.364439 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:29:46.368221 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78510bd9-e39b-4f20-b88e-9869cfe4fa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd39432-5c94-4e73-8a60-10a4f511ece9', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:46.373475 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e10e85-75ee-44f5-9c62-2a67826ebbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:46.382320 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Volume volume-9cd39432-5c94-4e73-8a60-10a4f511ece9 (9cd39432-5c94-4e73-8a60-10a4f511ece9): created successfully Jan 29 21:29:46.386509 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e10e85-75ee-44f5-9c62-2a67826ebbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:46.392112 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Flow 'volume_create_manager' (3c2c25ba-684f-4033-a501-3d3e8c99a423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:29:46.399557 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-efdf7888-3644-4acb-8d08-5a865da9c0d0 tempest-VolumesTestJSON-1956739924 None] Created volume successfully. Jan 29 21:29:47.564649 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:29:47.567872 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:29:47.568310 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:29:47.588067 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Flow 'volume_create_manager' (74243ad3-a178-4366-81cd-d7c9d1ea1b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:29:47.594506 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bdc3de4-34e9-43c5-b9ed-faaa4a72740c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:47.600805 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:29:47.614607 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bdc3de4-34e9-43c5-b9ed-faaa4a72740c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-930018557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fd6d435e-0550-4f7f-8b89-c412d516967d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5392bb4df9a347d6b4c2983464654b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:29:48Z,use_quota=True,user_id='255fcb950020475c8e84c1cb3e5c00aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:47.619943 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745449f8-e2b9-464b-8965-802711d77669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:47.624101 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745449f8-e2b9-464b-8965-802711d77669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:47.629192 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0749f1-8074-479d-9aa7-c78aa4aa9fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:47.633319 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0749f1-8074-479d-9aa7-c78aa4aa9fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd6d435e-0550-4f7f-8b89-c412d516967d', 'volume_name': 'volume-fd6d435e-0550-4f7f-8b89-c412d516967d', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:47.638745 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfd47c1-0ff1-4504-83af-0f44fcc0598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:47.642778 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfd47c1-0ff1-4504-83af-0f44fcc0598d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:47.647432 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61459ca-e25d-4361-b7d3-2707ddb7437b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:47.648478 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Volume fd6d435e-0550-4f7f-8b89-c412d516967d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd6d435e-0550-4f7f-8b89-c412d516967d', 'volume_size': 1} Jan 29 21:29:47.648861 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] creating volume 'volume-fd6d435e-0550-4f7f-8b89-c412d516967d' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:29:47.650393 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:47.703352 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:29:47.703726 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:29:47.707505 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61459ca-e25d-4361-b7d3-2707ddb7437b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd6d435e-0550-4f7f-8b89-c412d516967d', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:47.712200 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa155f59-f83d-4a2d-9430-878b11648c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:29:47.721289 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Volume volume-fd6d435e-0550-4f7f-8b89-c412d516967d (fd6d435e-0550-4f7f-8b89-c412d516967d): created successfully Jan 29 21:29:47.724877 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa155f59-f83d-4a2d-9430-878b11648c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:29:47.730306 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Flow 'volume_create_manager' (74243ad3-a178-4366-81cd-d7c9d1ea1b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:29:47.737583 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-cf1249ef-7835-408a-8b1b-bc375a5c356e tempest-VolumesTestJSON-1956739924 None] Created volume successfully. Jan 29 21:29:49.410842 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-bb412d08-91b8-43cf-86fd-597e0ac8ba74 tempest-VolumesTestJSON-1956739924 None] Lock "b'cinder-fd6d435e-0550-4f7f-8b89-c412d516967d-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:29:49.441359 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb412d08-91b8-43cf-86fd-597e0ac8ba74 tempest-VolumesTestJSON-1956739924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:49.477369 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb412d08-91b8-43cf-86fd-597e0ac8ba74 tempest-VolumesTestJSON-1956739924 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:29:49.477790 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb412d08-91b8-43cf-86fd-597e0ac8ba74 tempest-VolumesTestJSON-1956739924 None] Volume volume-fd6d435e-0550-4f7f-8b89-c412d516967d is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:29:49.482586 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb412d08-91b8-43cf-86fd-597e0ac8ba74 tempest-VolumesTestJSON-1956739924 None] deleting rbd volume volume-fd6d435e-0550-4f7f-8b89-c412d516967d {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:29:49.672429 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-bb412d08-91b8-43cf-86fd-597e0ac8ba74 tempest-VolumesTestJSON-1956739924 None] Created reservations ['d629b339-0b9e-4b09-b3a0-854c1584aa12', '01af5331-3b49-4f0c-9a1a-2ab75b505fe1', '038ed265-3479-4594-85bf-938f7bc98629', 'ed50ce27-0700-4f63-a094-ca7f98f07f0b'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:29:49.712755 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb412d08-91b8-43cf-86fd-597e0ac8ba74 tempest-VolumesTestJSON-1956739924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:49.735431 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bb412d08-91b8-43cf-86fd-597e0ac8ba74 tempest-VolumesTestJSON-1956739924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:49.758451 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-bb412d08-91b8-43cf-86fd-597e0ac8ba74 tempest-VolumesTestJSON-1956739924 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:29:49.763027 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-bb412d08-91b8-43cf-86fd-597e0ac8ba74 tempest-VolumesTestJSON-1956739924 None] Deleted volume successfully. Jan 29 21:29:49.775698 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-bb412d08-91b8-43cf-86fd-597e0ac8ba74 tempest-VolumesTestJSON-1956739924 None] Lock "b'cinder-fd6d435e-0550-4f7f-8b89-c412d516967d-delete_volume'" released by "delete_volume" :: held 0.365s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:29:50.526314 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-f0ea3fd8-a233-4636-b787-b4c415c7b007 tempest-VolumesTestJSON-1956739924 None] Lock "b'cinder-9cd39432-5c94-4e73-8a60-10a4f511ece9-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:29:50.555683 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f0ea3fd8-a233-4636-b787-b4c415c7b007 tempest-VolumesTestJSON-1956739924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:50.592059 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f0ea3fd8-a233-4636-b787-b4c415c7b007 tempest-VolumesTestJSON-1956739924 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:29:50.592475 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f0ea3fd8-a233-4636-b787-b4c415c7b007 tempest-VolumesTestJSON-1956739924 None] Volume volume-9cd39432-5c94-4e73-8a60-10a4f511ece9 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:29:50.597078 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f0ea3fd8-a233-4636-b787-b4c415c7b007 tempest-VolumesTestJSON-1956739924 None] deleting rbd volume volume-9cd39432-5c94-4e73-8a60-10a4f511ece9 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:29:50.783045 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-f0ea3fd8-a233-4636-b787-b4c415c7b007 tempest-VolumesTestJSON-1956739924 None] Created reservations ['34913140-728d-42cc-8cd5-17bec684ffd5', '3c7c3c8c-b92e-4e81-818b-df7794a0ad53', 'c4270de6-2a12-4849-b815-d69388432747', '893fe301-2a61-423d-850f-9fa9e69e7930'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:29:50.823824 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f0ea3fd8-a233-4636-b787-b4c415c7b007 tempest-VolumesTestJSON-1956739924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:50.845854 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f0ea3fd8-a233-4636-b787-b4c415c7b007 tempest-VolumesTestJSON-1956739924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:50.867586 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-f0ea3fd8-a233-4636-b787-b4c415c7b007 tempest-VolumesTestJSON-1956739924 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:29:50.872969 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f0ea3fd8-a233-4636-b787-b4c415c7b007 tempest-VolumesTestJSON-1956739924 None] Deleted volume successfully. Jan 29 21:29:50.883874 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-f0ea3fd8-a233-4636-b787-b4c415c7b007 tempest-VolumesTestJSON-1956739924 None] Lock "b'cinder-9cd39432-5c94-4e73-8a60-10a4f511ece9-delete_volume'" released by "delete_volume" :: held 0.358s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:29:51.641718 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-4af29e04-5f65-4d1e-acc8-3190e8c5f0ea tempest-VolumesTestJSON-1956739924 None] Lock "b'cinder-a31d5e1e-0258-4cba-ab2b-dfeac786dc19-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:29:51.673610 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4af29e04-5f65-4d1e-acc8-3190e8c5f0ea tempest-VolumesTestJSON-1956739924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:51.711517 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4af29e04-5f65-4d1e-acc8-3190e8c5f0ea tempest-VolumesTestJSON-1956739924 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:29:51.711938 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4af29e04-5f65-4d1e-acc8-3190e8c5f0ea tempest-VolumesTestJSON-1956739924 None] Volume volume-a31d5e1e-0258-4cba-ab2b-dfeac786dc19 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:29:51.717521 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4af29e04-5f65-4d1e-acc8-3190e8c5f0ea tempest-VolumesTestJSON-1956739924 None] deleting rbd volume volume-a31d5e1e-0258-4cba-ab2b-dfeac786dc19 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:29:51.908593 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-4af29e04-5f65-4d1e-acc8-3190e8c5f0ea tempest-VolumesTestJSON-1956739924 None] Created reservations ['03da3e81-e8c7-4a93-b682-2b0af02a976d', '81864551-6e0b-44d7-8a06-2c1d4e4d4562', '72d413dc-2702-4d87-86d3-f82cba22d45f', 'f3998241-999c-4a47-a07a-dbdda229eb11'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:29:51.947609 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4af29e04-5f65-4d1e-acc8-3190e8c5f0ea tempest-VolumesTestJSON-1956739924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:51.976670 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4af29e04-5f65-4d1e-acc8-3190e8c5f0ea tempest-VolumesTestJSON-1956739924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:29:52.001084 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-4af29e04-5f65-4d1e-acc8-3190e8c5f0ea tempest-VolumesTestJSON-1956739924 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:29:52.004862 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4af29e04-5f65-4d1e-acc8-3190e8c5f0ea tempest-VolumesTestJSON-1956739924 None] Deleted volume successfully. Jan 29 21:29:52.016065 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-4af29e04-5f65-4d1e-acc8-3190e8c5f0ea tempest-VolumesTestJSON-1956739924 None] Lock "b'cinder-a31d5e1e-0258-4cba-ab2b-dfeac786dc19-delete_volume'" released by "delete_volume" :: held 0.375s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:30:28.718465 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:30:28.719886 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:30:28.752843 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:30:28.804472 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:31:03.302737 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:31:03.306160 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:31:03.306596 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:31:03.325250 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Flow 'volume_create_manager' (fd7e1eeb-18bc-48cd-a23d-df74db0d769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:03.332111 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd63828-4a86-427b-9c26-5fcd9ca9370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:03.338689 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:31:03.353455 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd63828-4a86-427b-9c26-5fcd9ca9370b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1739883539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dde92c79-5baa-408b-bcd5-0446a027569d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5498fe7ba6054d08b38dcdf82e006449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:31:03Z,use_quota=True,user_id='bf7f8319e50f42c2a61af17535e2292e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38742982-82f2-4b80-9d94-f2773a1756ab),volume_type_id=38742982-82f2-4b80-9d94-f2773a1756ab)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:03.358777 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60a97c5-e4a9-4b9c-b38b-b6c7e1c7b360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:03.362869 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60a97c5-e4a9-4b9c-b38b-b6c7e1c7b360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:03.367968 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccdf918-4004-4268-955c-93733796cb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:03.372074 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccdf918-4004-4268-955c-93733796cb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde92c79-5baa-408b-bcd5-0446a027569d', 'volume_name': 'volume-dde92c79-5baa-408b-bcd5-0446a027569d', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:03.377040 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823d7400-b6f8-4382-818c-199043062f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:03.380895 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823d7400-b6f8-4382-818c-199043062f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:03.385609 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c85c799-8d2d-4d4f-9b26-a4edd396d316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:03.386648 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Volume dde92c79-5baa-408b-bcd5-0446a027569d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde92c79-5baa-408b-bcd5-0446a027569d', 'volume_size': 1} Jan 29 21:31:03.387031 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] creating volume 'volume-dde92c79-5baa-408b-bcd5-0446a027569d' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:31:03.387969 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:03.436524 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:31:03.436925 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:31:03.440680 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c85c799-8d2d-4d4f-9b26-a4edd396d316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde92c79-5baa-408b-bcd5-0446a027569d', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:03.445412 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b78e734-e80a-4cbb-b930-600b650d7d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:03.455004 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Volume volume-dde92c79-5baa-408b-bcd5-0446a027569d (dde92c79-5baa-408b-bcd5-0446a027569d): created successfully Jan 29 21:31:03.458893 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b78e734-e80a-4cbb-b930-600b650d7d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:03.464526 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Flow 'volume_create_manager' (fd7e1eeb-18bc-48cd-a23d-df74db0d769c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:03.472365 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-b4db7fb4-dbf2-486b-8213-271e443099fc tempest-VolumeTypesTest-1933722982 None] Created volume successfully. Jan 29 21:31:04.553311 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0410bf8c-6507-4ce4-a3bb-e9b137afe42d tempest-VolumeTypesTest-1933722982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:04.574542 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-0410bf8c-6507-4ce4-a3bb-e9b137afe42d tempest-VolumeTypesTest-1933722982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:04.596854 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-0410bf8c-6507-4ce4-a3bb-e9b137afe42d tempest-VolumeTypesTest-1933722982 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:31:04.600904 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-0410bf8c-6507-4ce4-a3bb-e9b137afe42d tempest-VolumeTypesTest-1933722982 None] Retype volume completed successfully. Jan 29 21:31:06.333129 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-d7941752-d60f-4f10-92a7-32db7b0d3148 tempest-VolumeTypesTest-1933722982 None] Lock "b'cinder-dde92c79-5baa-408b-bcd5-0446a027569d-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:31:06.364779 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d7941752-d60f-4f10-92a7-32db7b0d3148 tempest-VolumeTypesTest-1933722982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:06.403393 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d7941752-d60f-4f10-92a7-32db7b0d3148 tempest-VolumeTypesTest-1933722982 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:31:06.403810 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d7941752-d60f-4f10-92a7-32db7b0d3148 tempest-VolumeTypesTest-1933722982 None] Volume volume-dde92c79-5baa-408b-bcd5-0446a027569d is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:31:06.408164 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d7941752-d60f-4f10-92a7-32db7b0d3148 tempest-VolumeTypesTest-1933722982 None] deleting rbd volume volume-dde92c79-5baa-408b-bcd5-0446a027569d {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:31:06.587281 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-d7941752-d60f-4f10-92a7-32db7b0d3148 tempest-VolumeTypesTest-1933722982 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1086103404 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1086103404, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:31:06.587953 ncdv-master-1 cinder-volume[134283]: WARNING cinder.quota [None req-d7941752-d60f-4f10-92a7-32db7b0d3148 tempest-VolumeTypesTest-1933722982 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1086103404 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1086103404, it is now deprecated. Please use the default quota class for default quota. Jan 29 21:31:06.601301 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-d7941752-d60f-4f10-92a7-32db7b0d3148 tempest-VolumeTypesTest-1933722982 None] Created reservations ['95040bb3-0de7-4236-9186-21c6924a7e1d', 'd0144051-cfd3-43af-afe2-1d901e20a262', '7fa41e65-fc3e-4ac7-8e06-f803e83672ba', 'd60c1b51-ec80-467d-ad3d-2df8fbdfeb4a'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:31:06.640498 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d7941752-d60f-4f10-92a7-32db7b0d3148 tempest-VolumeTypesTest-1933722982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:06.667223 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d7941752-d60f-4f10-92a7-32db7b0d3148 tempest-VolumeTypesTest-1933722982 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:06.691956 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-d7941752-d60f-4f10-92a7-32db7b0d3148 tempest-VolumeTypesTest-1933722982 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:31:06.695929 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d7941752-d60f-4f10-92a7-32db7b0d3148 tempest-VolumeTypesTest-1933722982 None] Deleted volume successfully. Jan 29 21:31:06.708329 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-d7941752-d60f-4f10-92a7-32db7b0d3148 tempest-VolumeTypesTest-1933722982 None] Lock "b'cinder-dde92c79-5baa-408b-bcd5-0446a027569d-delete_volume'" released by "delete_volume" :: held 0.375s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:31:10.727230 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:31:10.730496 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:31:10.730877 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:31:10.750010 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Flow 'volume_create_manager' (5cb86530-9163-43e8-afd9-6bde997ae99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:10.756382 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca42343-364e-43ac-8bf4-8e2b4b990cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:10.762470 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:31:10.779184 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca42343-364e-43ac-8bf4-8e2b4b990cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-673781038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a97b2369-9b17-4881-9a4c-a649162e54d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3adfcf5b8f3d44d3aa7ba3d074e18be4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:31:11Z,use_quota=True,user_id='0e81240b23e347e8adf7ff398936f344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:10.784578 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a005a8-e26e-4883-9125-2093adad9049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:10.788778 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a005a8-e26e-4883-9125-2093adad9049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:10.793949 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823890db-1f80-408b-bc44-f6405d28d4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:10.798655 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823890db-1f80-408b-bc44-f6405d28d4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a97b2369-9b17-4881-9a4c-a649162e54d4', 'volume_name': 'volume-a97b2369-9b17-4881-9a4c-a649162e54d4', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:10.803592 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e56f829-838b-495a-91f2-b6b43a582aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:10.807569 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e56f829-838b-495a-91f2-b6b43a582aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:10.813190 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352660e1-5cca-45e4-a262-b9de2491a481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:10.814239 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Volume a97b2369-9b17-4881-9a4c-a649162e54d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a97b2369-9b17-4881-9a4c-a649162e54d4', 'volume_size': 1} Jan 29 21:31:10.814624 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] creating volume 'volume-a97b2369-9b17-4881-9a4c-a649162e54d4' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:31:10.815573 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:10.862851 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:31:10.863219 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:31:10.866924 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352660e1-5cca-45e4-a262-b9de2491a481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a97b2369-9b17-4881-9a4c-a649162e54d4', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:10.871506 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf2f10b-e73e-4ed9-a6de-210d343bc056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:10.880918 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Volume volume-a97b2369-9b17-4881-9a4c-a649162e54d4 (a97b2369-9b17-4881-9a4c-a649162e54d4): created successfully Jan 29 21:31:10.884390 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf2f10b-e73e-4ed9-a6de-210d343bc056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:10.889807 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Flow 'volume_create_manager' (5cb86530-9163-43e8-afd9-6bde997ae99a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:10.897102 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-af398a69-2b64-4c66-836e-4267a969b5c3 tempest-VolumesTransfersTest-555467869 None] Created volume successfully. Jan 29 21:31:12.207665 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-c4a90542-349d-4d13-9a1e-674ffd1261af tempest-VolumesTransfersTest-465215401 None] Transfer volume completed successfully. Jan 29 21:31:12.546147 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-9985df74-1855-4352-81f7-32caf295ede8 tempest-VolumesTransfersTest-1835626680 None] Lock "b'cinder-a97b2369-9b17-4881-9a4c-a649162e54d4-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:31:12.570945 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9985df74-1855-4352-81f7-32caf295ede8 tempest-VolumesTransfersTest-1835626680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:12.607350 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9985df74-1855-4352-81f7-32caf295ede8 tempest-VolumesTransfersTest-1835626680 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:31:12.607774 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9985df74-1855-4352-81f7-32caf295ede8 tempest-VolumesTransfersTest-1835626680 None] Volume volume-a97b2369-9b17-4881-9a4c-a649162e54d4 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:31:12.613165 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9985df74-1855-4352-81f7-32caf295ede8 tempest-VolumesTransfersTest-1835626680 None] deleting rbd volume volume-a97b2369-9b17-4881-9a4c-a649162e54d4 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:31:12.806681 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-9985df74-1855-4352-81f7-32caf295ede8 tempest-VolumesTransfersTest-1835626680 None] Created reservations ['9503ae2f-5d68-497d-8649-18593809b383', 'ec01c21b-179a-489d-9dd4-f7b1cccbc0a2', 'c7ae6caa-8b83-4b4d-98cd-2718027ae4be', '7c1f813e-81f6-49b1-a00e-7d699291c1fd'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:31:12.847521 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9985df74-1855-4352-81f7-32caf295ede8 tempest-VolumesTransfersTest-1835626680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:12.869602 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9985df74-1855-4352-81f7-32caf295ede8 tempest-VolumesTransfersTest-1835626680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:12.892764 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-9985df74-1855-4352-81f7-32caf295ede8 tempest-VolumesTransfersTest-1835626680 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:31:12.897776 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9985df74-1855-4352-81f7-32caf295ede8 tempest-VolumesTransfersTest-1835626680 None] Deleted volume successfully. Jan 29 21:31:12.908655 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-9985df74-1855-4352-81f7-32caf295ede8 tempest-VolumesTransfersTest-1835626680 None] Lock "b'cinder-a97b2369-9b17-4881-9a4c-a649162e54d4-delete_volume'" released by "delete_volume" :: held 0.369s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:31:13.890791 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:31:13.893981 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:31:13.894419 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:31:13.913005 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Flow 'volume_create_manager' (76c9169f-4620-46fe-9c05-7207a366810d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:13.919957 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee8ede5-7be3-45e7-b9dd-999ed3d77201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:13.927054 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:31:13.942579 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee8ede5-7be3-45e7-b9dd-999ed3d77201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-652781129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=92e4d948-ee2d-46f0-854e-756a11a95d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3adfcf5b8f3d44d3aa7ba3d074e18be4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:31:14Z,use_quota=True,user_id='0e81240b23e347e8adf7ff398936f344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:13.948229 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb58b905-3d9c-4469-bfa5-bc1821b18159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:13.952430 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb58b905-3d9c-4469-bfa5-bc1821b18159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:13.957681 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f354e29c-4a7a-46c6-8252-bdfd6f201213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:13.961906 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f354e29c-4a7a-46c6-8252-bdfd6f201213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e4d948-ee2d-46f0-854e-756a11a95d98', 'volume_name': 'volume-92e4d948-ee2d-46f0-854e-756a11a95d98', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:13.966889 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3827c41c-ef6a-4628-a73d-cb502e826456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:13.971186 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3827c41c-ef6a-4628-a73d-cb502e826456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:13.976021 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04620940-dd56-4f86-bb7b-c85caa9d6745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:13.977130 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Volume 92e4d948-ee2d-46f0-854e-756a11a95d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e4d948-ee2d-46f0-854e-756a11a95d98', 'volume_size': 1} Jan 29 21:31:13.977524 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] creating volume 'volume-92e4d948-ee2d-46f0-854e-756a11a95d98' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:31:13.978487 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:14.028013 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:31:14.028385 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:31:14.032765 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04620940-dd56-4f86-bb7b-c85caa9d6745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e4d948-ee2d-46f0-854e-756a11a95d98', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:14.037509 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdd34a5-2142-4202-96df-01e2fea19e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:14.046622 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Volume volume-92e4d948-ee2d-46f0-854e-756a11a95d98 (92e4d948-ee2d-46f0-854e-756a11a95d98): created successfully Jan 29 21:31:14.050115 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdd34a5-2142-4202-96df-01e2fea19e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:14.055665 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Flow 'volume_create_manager' (76c9169f-4620-46fe-9c05-7207a366810d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:14.066153 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e3afa191-d6a8-47ad-9472-ae2a1975a17a tempest-VolumesTransfersTest-555467869 None] Created volume successfully. Jan 29 21:31:15.159457 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-060ccc76-db27-4601-80f8-d2f705aff5b2 tempest-VolumesTransfersTest-1835626680 None] Lock "b'cinder-92e4d948-ee2d-46f0-854e-756a11a95d98-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:31:15.183102 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-060ccc76-db27-4601-80f8-d2f705aff5b2 tempest-VolumesTransfersTest-1835626680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:15.220262 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-060ccc76-db27-4601-80f8-d2f705aff5b2 tempest-VolumesTransfersTest-1835626680 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:31:15.220677 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-060ccc76-db27-4601-80f8-d2f705aff5b2 tempest-VolumesTransfersTest-1835626680 None] Volume volume-92e4d948-ee2d-46f0-854e-756a11a95d98 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:31:15.226123 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-060ccc76-db27-4601-80f8-d2f705aff5b2 tempest-VolumesTransfersTest-1835626680 None] deleting rbd volume volume-92e4d948-ee2d-46f0-854e-756a11a95d98 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:31:15.410675 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-060ccc76-db27-4601-80f8-d2f705aff5b2 tempest-VolumesTransfersTest-1835626680 None] Created reservations ['8e3b0119-d609-44f4-b86e-3cabf2a4f7cc', 'bafc3fa6-8cfe-4b0a-b3cb-87c9b2953e43', '09b8ed97-7351-4b2d-bfa4-53b7c53312e0', '25f2b533-ca2a-4d33-a537-db114484ff9f'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:31:15.448162 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-060ccc76-db27-4601-80f8-d2f705aff5b2 tempest-VolumesTransfersTest-1835626680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:15.471346 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-060ccc76-db27-4601-80f8-d2f705aff5b2 tempest-VolumesTransfersTest-1835626680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:15.493997 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-060ccc76-db27-4601-80f8-d2f705aff5b2 tempest-VolumesTransfersTest-1835626680 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:31:15.497920 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-060ccc76-db27-4601-80f8-d2f705aff5b2 tempest-VolumesTransfersTest-1835626680 None] Deleted volume successfully. Jan 29 21:31:15.509508 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-060ccc76-db27-4601-80f8-d2f705aff5b2 tempest-VolumesTransfersTest-1835626680 None] Lock "b'cinder-92e4d948-ee2d-46f0-854e-756a11a95d98-delete_volume'" released by "delete_volume" :: held 0.350s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:31:18.968094 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:31:18.971224 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:31:18.971710 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:31:18.995888 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Flow 'volume_create_manager' (1a516ebf-4211-4cc1-8dca-4df91810f0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:19.003110 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d1e354-87f6-41d0-8839-cbc4235d37fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:19.009446 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:31:19.023676 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d1e354-87f6-41d0-8839-cbc4235d37fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-571131508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f52a527-db53-4692-976a-b0cb3ae5e2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7f709f5e34425c97b292ca42974978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:31:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:31:19Z,use_quota=True,user_id='c5c0e271fcc5452ea6b2dea048603abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:19.029040 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8274a7c-d393-45dd-a9d0-fdfe2fab5833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:19.033280 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8274a7c-d393-45dd-a9d0-fdfe2fab5833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:19.038371 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843c12ea-f3fc-4260-aef1-9dfa82171607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:19.042625 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843c12ea-f3fc-4260-aef1-9dfa82171607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f52a527-db53-4692-976a-b0cb3ae5e2b8', 'volume_name': 'volume-2f52a527-db53-4692-976a-b0cb3ae5e2b8', 'volume_size': 2}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:19.047664 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe919be-6c61-4e75-af55-964d7521bd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:19.051714 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe919be-6c61-4e75-af55-964d7521bd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:19.056428 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a875284-dfc0-4410-959f-e84a35c8eb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:19.057524 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Volume 2f52a527-db53-4692-976a-b0cb3ae5e2b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f52a527-db53-4692-976a-b0cb3ae5e2b8', 'volume_size': 2} Jan 29 21:31:19.057909 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] creating volume 'volume-2f52a527-db53-4692-976a-b0cb3ae5e2b8' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:31:19.058874 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:19.107531 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:31:19.108438 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:31:19.112160 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a875284-dfc0-4410-959f-e84a35c8eb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f52a527-db53-4692-976a-b0cb3ae5e2b8', 'volume_size': 2}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:19.116755 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb657dbd-d410-4d2c-b441-b49541da45c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:19.125979 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Volume volume-2f52a527-db53-4692-976a-b0cb3ae5e2b8 (2f52a527-db53-4692-976a-b0cb3ae5e2b8): created successfully Jan 29 21:31:19.129609 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb657dbd-d410-4d2c-b441-b49541da45c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:19.134972 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Flow 'volume_create_manager' (1a516ebf-4211-4cc1-8dca-4df91810f0bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:19.142062 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-82d6214e-915c-4758-a5c9-8ddc0ce225a2 tempest-VolumesCloneNegativeTest-460393892 None] Created volume successfully. Jan 29 21:31:20.083232 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-ee45b9d0-637c-44fc-85a3-30fe0e33d39f tempest-VolumesCloneNegativeTest-460393892 None] Lock "b'cinder-2f52a527-db53-4692-976a-b0cb3ae5e2b8-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:31:20.113975 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ee45b9d0-637c-44fc-85a3-30fe0e33d39f tempest-VolumesCloneNegativeTest-460393892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:20.149825 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ee45b9d0-637c-44fc-85a3-30fe0e33d39f tempest-VolumesCloneNegativeTest-460393892 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:31:20.150268 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ee45b9d0-637c-44fc-85a3-30fe0e33d39f tempest-VolumesCloneNegativeTest-460393892 None] Volume volume-2f52a527-db53-4692-976a-b0cb3ae5e2b8 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:31:20.155822 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ee45b9d0-637c-44fc-85a3-30fe0e33d39f tempest-VolumesCloneNegativeTest-460393892 None] deleting rbd volume volume-2f52a527-db53-4692-976a-b0cb3ae5e2b8 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:31:20.340050 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-ee45b9d0-637c-44fc-85a3-30fe0e33d39f tempest-VolumesCloneNegativeTest-460393892 None] Created reservations ['cd90896c-0025-45ff-a873-4b37016bd7d6', '2bdc7a5a-4ec6-4fb6-9205-dc7645f67c55', '6a3355d3-2c1a-4558-990a-696838598633', '973db427-af36-47c5-a4c0-ec3a9500c575'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:31:20.378445 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ee45b9d0-637c-44fc-85a3-30fe0e33d39f tempest-VolumesCloneNegativeTest-460393892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:20.399980 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ee45b9d0-637c-44fc-85a3-30fe0e33d39f tempest-VolumesCloneNegativeTest-460393892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:20.423706 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-ee45b9d0-637c-44fc-85a3-30fe0e33d39f tempest-VolumesCloneNegativeTest-460393892 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:31:20.427968 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ee45b9d0-637c-44fc-85a3-30fe0e33d39f tempest-VolumesCloneNegativeTest-460393892 None] Deleted volume successfully. Jan 29 21:31:20.439956 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-ee45b9d0-637c-44fc-85a3-30fe0e33d39f tempest-VolumesCloneNegativeTest-460393892 None] Lock "b'cinder-2f52a527-db53-4692-976a-b0cb3ae5e2b8-delete_volume'" released by "delete_volume" :: held 0.357s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:31:22.755054 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:31:22.758253 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:31:22.758692 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:31:22.777739 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Flow 'volume_create_manager' (aa9b3166-db2b-4a7d-a8be-37d731412dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:22.784799 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3829372-1a1d-4555-ba06-2e9c7b4fbc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:22.791259 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:31:22.805427 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3829372-1a1d-4555-ba06-2e9c7b4fbc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-929335950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=644efea3-693a-4889-90e7-10b328a00a1b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='470f7c564dde4f4aa79129339df84355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:31:23Z,use_quota=True,user_id='8935c00701424769bcb6a6761a90bb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:22.811688 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (350ac861-eaa8-423e-8644-48252673e0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:22.815887 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (350ac861-eaa8-423e-8644-48252673e0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:22.821017 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25e2785-701e-44a6-aeef-bdfea881c512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:22.825195 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25e2785-701e-44a6-aeef-bdfea881c512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '644efea3-693a-4889-90e7-10b328a00a1b', 'volume_name': 'volume-644efea3-693a-4889-90e7-10b328a00a1b', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:22.830706 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fef6701-793a-437e-b563-6e1179c0e85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:22.834715 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fef6701-793a-437e-b563-6e1179c0e85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:22.839431 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba219548-d2e2-4468-8200-6930f27f0144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:22.840493 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Volume 644efea3-693a-4889-90e7-10b328a00a1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-644efea3-693a-4889-90e7-10b328a00a1b', 'volume_size': 1} Jan 29 21:31:22.840878 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] creating volume 'volume-644efea3-693a-4889-90e7-10b328a00a1b' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:31:22.841866 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:22.891751 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:31:22.892120 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:31:22.895858 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba219548-d2e2-4468-8200-6930f27f0144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-644efea3-693a-4889-90e7-10b328a00a1b', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:22.900391 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107dee77-4365-4d4d-8b1b-88972653ea89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:22.909092 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Volume volume-644efea3-693a-4889-90e7-10b328a00a1b (644efea3-693a-4889-90e7-10b328a00a1b): created successfully Jan 29 21:31:22.912717 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107dee77-4365-4d4d-8b1b-88972653ea89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:22.918626 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Flow 'volume_create_manager' (aa9b3166-db2b-4a7d-a8be-37d731412dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:22.926547 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f0a78880-f689-4309-a3a4-4599ac712308 tempest-VolumesGetTest-1689175831 None] Created volume successfully. Jan 29 21:31:24.225770 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:31:24.229175 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:31:24.229628 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:31:24.249923 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Flow 'volume_create_manager' (da20d799-8200-4409-bd29-4005088f44ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:24.256703 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034435de-2373-454e-ac42-f6a100718e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:24.265221 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:31:24.279996 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034435de-2373-454e-ac42-f6a100718e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:31:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1043214475',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=63dce5f8-7822-4b5b-a410-1604d316502b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f7c564dde4f4aa79129339df84355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:31:24Z,use_quota=True,user_id='8935c00701424769bcb6a6761a90bb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:24.285636 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba6d518-5546-40b5-ab0d-c7d8e16219f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:24.289886 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba6d518-5546-40b5-ab0d-c7d8e16219f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:24.295121 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42008fb3-bf11-41ce-a031-c93fd0717ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:24.299471 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42008fb3-bf11-41ce-a031-c93fd0717ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63dce5f8-7822-4b5b-a410-1604d316502b', 'volume_name': 'volume-63dce5f8-7822-4b5b-a410-1604d316502b', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:24.304458 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d637de6-4eaf-40ab-ae80-885acb84476e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:24.308540 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d637de6-4eaf-40ab-ae80-885acb84476e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:24.313905 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d534da9e-9fa1-4b1d-a7b8-2b4f1df5a3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:24.315009 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Volume 63dce5f8-7822-4b5b-a410-1604d316502b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63dce5f8-7822-4b5b-a410-1604d316502b', 'volume_size': 1} Jan 29 21:31:24.315404 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] creating volume 'volume-63dce5f8-7822-4b5b-a410-1604d316502b' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:31:24.316407 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:24.369041 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:31:24.369507 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:31:24.373229 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d534da9e-9fa1-4b1d-a7b8-2b4f1df5a3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63dce5f8-7822-4b5b-a410-1604d316502b', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:24.378571 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101074fe-087e-4dd6-93fa-b9cf56307958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:24.387356 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Volume volume-63dce5f8-7822-4b5b-a410-1604d316502b (63dce5f8-7822-4b5b-a410-1604d316502b): created successfully Jan 29 21:31:24.391099 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101074fe-087e-4dd6-93fa-b9cf56307958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:24.396482 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Flow 'volume_create_manager' (da20d799-8200-4409-bd29-4005088f44ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:24.405478 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-b3cf8947-2112-4efc-aad3-88d64b848cbc tempest-VolumesGetTest-1689175831 None] Created volume successfully. Jan 29 21:31:25.494736 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-4cd4a717-f948-4764-8bd5-bcf72d16d5d0 tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-63dce5f8-7822-4b5b-a410-1604d316502b-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:31:25.530423 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4cd4a717-f948-4764-8bd5-bcf72d16d5d0 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:25.562112 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4cd4a717-f948-4764-8bd5-bcf72d16d5d0 tempest-VolumesGetTest-1689175831 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:31:25.563782 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4cd4a717-f948-4764-8bd5-bcf72d16d5d0 tempest-VolumesGetTest-1689175831 None] Volume volume-63dce5f8-7822-4b5b-a410-1604d316502b is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:31:25.570482 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4cd4a717-f948-4764-8bd5-bcf72d16d5d0 tempest-VolumesGetTest-1689175831 None] deleting rbd volume volume-63dce5f8-7822-4b5b-a410-1604d316502b {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:31:25.758696 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-4cd4a717-f948-4764-8bd5-bcf72d16d5d0 tempest-VolumesGetTest-1689175831 None] Created reservations ['19df50ef-b707-4f61-93d2-670e3ed07f89', '6349262b-cbd1-469f-9736-226968f0f024', 'f02904ff-0f49-4812-a8d1-d3df159b81b5', 'd5ae7ef5-1ce4-430a-8e65-066aae68cdb8'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:31:25.797324 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4cd4a717-f948-4764-8bd5-bcf72d16d5d0 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:25.819794 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-4cd4a717-f948-4764-8bd5-bcf72d16d5d0 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:25.842438 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-4cd4a717-f948-4764-8bd5-bcf72d16d5d0 tempest-VolumesGetTest-1689175831 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:31:25.846806 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-4cd4a717-f948-4764-8bd5-bcf72d16d5d0 tempest-VolumesGetTest-1689175831 None] Deleted volume successfully. Jan 29 21:31:25.858556 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-4cd4a717-f948-4764-8bd5-bcf72d16d5d0 tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-63dce5f8-7822-4b5b-a410-1604d316502b-delete_volume'" released by "delete_volume" :: held 0.363s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:31:26.620481 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-091cb006-5308-4f45-b8d1-31574abac9f3 tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-644efea3-693a-4889-90e7-10b328a00a1b-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:31:26.661192 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-091cb006-5308-4f45-b8d1-31574abac9f3 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:26.712738 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-091cb006-5308-4f45-b8d1-31574abac9f3 tempest-VolumesGetTest-1689175831 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:31:26.713197 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-091cb006-5308-4f45-b8d1-31574abac9f3 tempest-VolumesGetTest-1689175831 None] Volume volume-644efea3-693a-4889-90e7-10b328a00a1b is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:31:26.719063 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-091cb006-5308-4f45-b8d1-31574abac9f3 tempest-VolumesGetTest-1689175831 None] deleting rbd volume volume-644efea3-693a-4889-90e7-10b328a00a1b {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:31:26.931265 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-091cb006-5308-4f45-b8d1-31574abac9f3 tempest-VolumesGetTest-1689175831 None] Created reservations ['66d628bb-4ea8-491e-a367-0553d42f1cf0', '4c2623c0-7b17-4227-830e-52022dbbf9e8', '35fc473f-3ba7-468e-ad5e-1a28ff6aa891', '2ffdff51-6d1d-45a7-97c5-7b78dcc6ab03'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:31:26.970851 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-091cb006-5308-4f45-b8d1-31574abac9f3 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:26.993668 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-091cb006-5308-4f45-b8d1-31574abac9f3 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:27.016114 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-091cb006-5308-4f45-b8d1-31574abac9f3 tempest-VolumesGetTest-1689175831 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:31:27.021165 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-091cb006-5308-4f45-b8d1-31574abac9f3 tempest-VolumesGetTest-1689175831 None] Deleted volume successfully. Jan 29 21:31:27.033717 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-091cb006-5308-4f45-b8d1-31574abac9f3 tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-644efea3-693a-4889-90e7-10b328a00a1b-delete_volume'" released by "delete_volume" :: held 0.413s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:31:27.983351 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:31:27.986643 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:31:27.987082 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:31:28.007337 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Flow 'volume_create_manager' (571d6c12-4ace-4db1-9606-fa761858a37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:28.013916 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ac1de3-5cf6-425a-8683-94e22a0ab1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:28.020908 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:31:28.035253 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ac1de3-5cf6-425a-8683-94e22a0ab1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1424926800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3c11d478-1ddb-468f-bd2d-a8be60909031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f7c564dde4f4aa79129339df84355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:31:28Z,use_quota=True,user_id='8935c00701424769bcb6a6761a90bb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:28.040694 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb564ac-3da3-4f87-bba7-45ad3f0bd46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:28.044891 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb564ac-3da3-4f87-bba7-45ad3f0bd46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:28.050705 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15420fce-659c-45de-b33d-cbea2b482873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:28.055209 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15420fce-659c-45de-b33d-cbea2b482873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c11d478-1ddb-468f-bd2d-a8be60909031', 'volume_name': 'volume-3c11d478-1ddb-468f-bd2d-a8be60909031', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:28.060243 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b24fc4f-34c6-4a74-b779-36bad7b50cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:28.064582 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b24fc4f-34c6-4a74-b779-36bad7b50cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:28.069364 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f37eb34-b2da-4276-842b-776ead004506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:28.070435 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Volume 3c11d478-1ddb-468f-bd2d-a8be60909031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c11d478-1ddb-468f-bd2d-a8be60909031', 'volume_size': 1} Jan 29 21:31:28.070825 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] creating volume 'volume-3c11d478-1ddb-468f-bd2d-a8be60909031' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:31:28.071793 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:28.120517 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:31:28.120892 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:31:28.124636 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f37eb34-b2da-4276-842b-776ead004506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c11d478-1ddb-468f-bd2d-a8be60909031', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:28.129357 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a37bc0-5fde-46ef-a86f-c8a1462fdda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:28.138352 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Volume volume-3c11d478-1ddb-468f-bd2d-a8be60909031 (3c11d478-1ddb-468f-bd2d-a8be60909031): created successfully Jan 29 21:31:28.142844 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a37bc0-5fde-46ef-a86f-c8a1462fdda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:28.149388 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Flow 'volume_create_manager' (571d6c12-4ace-4db1-9606-fa761858a37b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:28.157230 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6016303e-cac8-45d4-bfb8-e1043233070e tempest-VolumesGetTest-1689175831 None] Created volume successfully. Jan 29 21:31:28.719776 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:31:28.720507 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:28.741377 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:28.762939 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:31:29.310121 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:31:29.313492 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:31:29.313928 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:31:29.340888 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Flow 'volume_create_manager' (d826b3bb-3d68-49a4-977e-0a82db77e4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:29.347904 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5658a1ef-a071-4365-b4d2-c5367ee62b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:29.354347 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:31:29.368823 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5658a1ef-a071-4365-b4d2-c5367ee62b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1197617646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8e67601d-f2f7-4b55-bc50-fbc3b13c8b81,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='470f7c564dde4f4aa79129339df84355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3c11d478-1ddb-468f-bd2d-a8be60909031,status='creating',terminated_at=None,updated_at=2022-01-29T21:31:29Z,use_quota=True,user_id='8935c00701424769bcb6a6761a90bb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:29.374262 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4253a92e-6bcb-4854-ad89-96d1ac3df92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:29.378451 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4253a92e-6bcb-4854-ad89-96d1ac3df92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:29.383585 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980600b1-11e0-404f-a843-d6ab9774fca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:29.397848 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980600b1-11e0-404f-a843-d6ab9774fca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8e67601d-f2f7-4b55-bc50-fbc3b13c8b81', 'volume_name': 'volume-8e67601d-f2f7-4b55-bc50-fbc3b13c8b81', 'volume_size': 1, 'source_volid': '3c11d478-1ddb-468f-bd2d-a8be60909031', 'source_volstatus': 'available'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:29.402837 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4af21cd-3b80-434c-84c9-3f2749c44cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:29.407373 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4af21cd-3b80-434c-84c9-3f2749c44cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:29.412134 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a434d67d-928d-4ca9-a71f-3852b2a21eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:29.413227 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Volume 8e67601d-f2f7-4b55-bc50-fbc3b13c8b81: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8e67601d-f2f7-4b55-bc50-fbc3b13c8b81', 'volume_size': 1, 'source_volid': '3c11d478-1ddb-468f-bd2d-a8be60909031', 'source_volstatus': 'available'} Jan 29 21:31:29.424091 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:29.460110 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] creating snapshot='volume-8e67601d-f2f7-4b55-bc50-fbc3b13c8b81.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 21:31:30.003578 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] cloning 'volume-3c11d478-1ddb-468f-bd2d-a8be60909031@volume-8e67601d-f2f7-4b55-bc50-fbc3b13c8b81.clone_snap' to 'volume-8e67601d-f2f7-4b55-bc50-fbc3b13c8b81' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 21:31:30.089126 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Volume volume-3c11d478-1ddb-468f-bd2d-a8be60909031 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:31:30.090219 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:31:30.090584 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:31:30.105209 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 21:31:30.108917 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a434d67d-928d-4ca9-a71f-3852b2a21eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e67601d-f2f7-4b55-bc50-fbc3b13c8b81', 'volume_size': 1, 'source_volid': '3c11d478-1ddb-468f-bd2d-a8be60909031', 'source_volstatus': 'available'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:30.113520 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6733d73a-452e-4ea8-98d9-0561de3b2edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:30.122060 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Volume volume-8e67601d-f2f7-4b55-bc50-fbc3b13c8b81 (8e67601d-f2f7-4b55-bc50-fbc3b13c8b81): created successfully Jan 29 21:31:30.126050 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6733d73a-452e-4ea8-98d9-0561de3b2edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:30.131472 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Flow 'volume_create_manager' (d826b3bb-3d68-49a4-977e-0a82db77e4d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:30.143463 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-50c154a8-9946-4923-bbd0-0fcac13376e2 tempest-VolumesGetTest-1689175831 None] Created volume successfully. Jan 29 21:31:30.776234 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:31:30.779393 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:31:30.779828 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:31:30.801992 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Flow 'volume_create_manager' (1a452f8b-eb7c-453b-b2b6-f8428ee61ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:30.808572 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ff4868-f8b7-4da4-a994-1f950e0a7343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:30.815221 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:31:30.829009 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ff4868-f8b7-4da4-a994-1f950e0a7343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:31:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1073199731',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=430390e4-d2df-4b72-8aa8-6fdbdfcf1a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f7c564dde4f4aa79129339df84355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:31:31Z,use_quota=True,user_id='8935c00701424769bcb6a6761a90bb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:30.834395 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455c86c1-3a86-403e-bbf4-5a493950da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:30.838804 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455c86c1-3a86-403e-bbf4-5a493950da47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:30.847407 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f325a57c-1e0f-4b05-84f0-a7a42a06e31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:30.851621 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f325a57c-1e0f-4b05-84f0-a7a42a06e31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '430390e4-d2df-4b72-8aa8-6fdbdfcf1a12', 'volume_name': 'volume-430390e4-d2df-4b72-8aa8-6fdbdfcf1a12', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:30.856859 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211eabe7-9923-4ed4-9063-f6b643f77fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:30.861620 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211eabe7-9923-4ed4-9063-f6b643f77fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:30.866327 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b2bc3c-dc21-4caf-b923-2080c266f176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:30.867396 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Volume 430390e4-d2df-4b72-8aa8-6fdbdfcf1a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-430390e4-d2df-4b72-8aa8-6fdbdfcf1a12', 'volume_size': 1} Jan 29 21:31:30.867780 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] creating volume 'volume-430390e4-d2df-4b72-8aa8-6fdbdfcf1a12' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:31:30.868778 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:30.916578 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:31:30.916946 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:31:30.920679 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b2bc3c-dc21-4caf-b923-2080c266f176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-430390e4-d2df-4b72-8aa8-6fdbdfcf1a12', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:30.926009 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85870b83-7bbe-441e-a573-dc9fdbb980f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:30.935041 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Volume volume-430390e4-d2df-4b72-8aa8-6fdbdfcf1a12 (430390e4-d2df-4b72-8aa8-6fdbdfcf1a12): created successfully Jan 29 21:31:30.938289 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85870b83-7bbe-441e-a573-dc9fdbb980f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:30.943682 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Flow 'volume_create_manager' (1a452f8b-eb7c-453b-b2b6-f8428ee61ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:30.950810 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-b746efe2-b199-495e-98c1-7df69f036fd6 tempest-VolumesGetTest-1689175831 None] Created volume successfully. Jan 29 21:31:31.876840 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-439148e4-1396-4e08-bd7b-e73db29e6fb0 tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-430390e4-d2df-4b72-8aa8-6fdbdfcf1a12-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:31:31.912172 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-439148e4-1396-4e08-bd7b-e73db29e6fb0 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:31.943434 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-439148e4-1396-4e08-bd7b-e73db29e6fb0 tempest-VolumesGetTest-1689175831 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:31:31.943856 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-439148e4-1396-4e08-bd7b-e73db29e6fb0 tempest-VolumesGetTest-1689175831 None] Volume volume-430390e4-d2df-4b72-8aa8-6fdbdfcf1a12 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:31:31.947828 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-439148e4-1396-4e08-bd7b-e73db29e6fb0 tempest-VolumesGetTest-1689175831 None] deleting rbd volume volume-430390e4-d2df-4b72-8aa8-6fdbdfcf1a12 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:31:32.139349 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-439148e4-1396-4e08-bd7b-e73db29e6fb0 tempest-VolumesGetTest-1689175831 None] Created reservations ['da1f7d09-651c-4c12-9e3f-165002043a98', '3c18e43b-2f23-4858-a8da-e2c372b908ec', '042f223e-135d-48c0-9836-5681e0e34ff8', 'baaff178-9125-4e67-bca1-522fcd218103'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:31:32.176261 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-439148e4-1396-4e08-bd7b-e73db29e6fb0 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:32.198432 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-439148e4-1396-4e08-bd7b-e73db29e6fb0 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:32.220884 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-439148e4-1396-4e08-bd7b-e73db29e6fb0 tempest-VolumesGetTest-1689175831 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:31:32.224897 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-439148e4-1396-4e08-bd7b-e73db29e6fb0 tempest-VolumesGetTest-1689175831 None] Deleted volume successfully. Jan 29 21:31:32.236448 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-439148e4-1396-4e08-bd7b-e73db29e6fb0 tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-430390e4-d2df-4b72-8aa8-6fdbdfcf1a12-delete_volume'" released by "delete_volume" :: held 0.360s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:31:32.993006 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-58f19094-6898-4b7d-a0b5-ab0fe9c667e4 tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-8e67601d-f2f7-4b55-bc50-fbc3b13c8b81-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:31:33.028123 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-58f19094-6898-4b7d-a0b5-ab0fe9c667e4 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:33.080081 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-58f19094-6898-4b7d-a0b5-ab0fe9c667e4 tempest-VolumesGetTest-1689175831 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:31:33.085714 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-58f19094-6898-4b7d-a0b5-ab0fe9c667e4 tempest-VolumesGetTest-1689175831 None] deleting rbd volume volume-8e67601d-f2f7-4b55-bc50-fbc3b13c8b81 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:31:33.242198 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-58f19094-6898-4b7d-a0b5-ab0fe9c667e4 tempest-VolumesGetTest-1689175831 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 21:31:33.260496 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-58f19094-6898-4b7d-a0b5-ab0fe9c667e4 tempest-VolumesGetTest-1689175831 None] Volume volume-3c11d478-1ddb-468f-bd2d-a8be60909031 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:31:33.261078 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-58f19094-6898-4b7d-a0b5-ab0fe9c667e4 tempest-VolumesGetTest-1689175831 None] deleting parent snapshot volume-8e67601d-f2f7-4b55-bc50-fbc3b13c8b81.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 21:31:34.071198 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-58f19094-6898-4b7d-a0b5-ab0fe9c667e4 tempest-VolumesGetTest-1689175831 None] Created reservations ['ccf1bf7e-3245-4f62-8181-ceb51239cd7c', 'a754310e-f9d6-4554-b772-1c473f14f108', 'eaed7072-dfa4-4f3a-ae2d-65f69f3a4240', 'd5d23bfc-4644-4890-ab6c-b7efdca78199'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:31:34.109694 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-58f19094-6898-4b7d-a0b5-ab0fe9c667e4 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:34.130889 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-58f19094-6898-4b7d-a0b5-ab0fe9c667e4 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:34.153551 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-58f19094-6898-4b7d-a0b5-ab0fe9c667e4 tempest-VolumesGetTest-1689175831 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:31:34.159344 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-58f19094-6898-4b7d-a0b5-ab0fe9c667e4 tempest-VolumesGetTest-1689175831 None] Deleted volume successfully. Jan 29 21:31:34.171787 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-58f19094-6898-4b7d-a0b5-ab0fe9c667e4 tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-8e67601d-f2f7-4b55-bc50-fbc3b13c8b81-delete_volume'" released by "delete_volume" :: held 1.179s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:31:35.526643 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:31:35.529833 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:31:35.530266 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:31:35.550152 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Flow 'volume_create_manager' (ebc5be31-0481-4990-8a0d-0bd33f3db80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:35.556707 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ceffc6c-1244-4899-87b9-5f2eeb802fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:35.563379 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:31:35.578137 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ceffc6c-1244-4899-87b9-5f2eeb802fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1609544410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b6aab0af-0b4a-4171-9178-374e1ee3fc7c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='470f7c564dde4f4aa79129339df84355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:31:35Z,use_quota=True,user_id='8935c00701424769bcb6a6761a90bb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:35.583493 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01b33e3-b69e-441e-b397-86e975394bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:35.587611 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01b33e3-b69e-441e-b397-86e975394bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:35.592666 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf5d801-914a-474f-821f-ed77dd7db75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:35.673592 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf5d801-914a-474f-821f-ed77dd7db75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b6aab0af-0b4a-4171-9178-374e1ee3fc7c', 'volume_name': 'volume-b6aab0af-0b4a-4171-9178-374e1ee3fc7c', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:35.678608 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7567fc91-c1ef-4520-8804-e85c7656fbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:35.682608 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7567fc91-c1ef-4520-8804-e85c7656fbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:35.687538 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ce70ff-9f59-4278-be8e-f8d56d3c3f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:35.688640 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Volume b6aab0af-0b4a-4171-9178-374e1ee3fc7c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b6aab0af-0b4a-4171-9178-374e1ee3fc7c', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 21:31:35.689217 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Cloning b6aab0af-0b4a-4171-9178-374e1ee3fc7c from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 21:31:35.697192 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:31:35.707481 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 31, 35, 701339)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:31:35.707913 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:31:35.708308 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Found cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 29 21:31:35.712489 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:31:35.713412 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 21:31:35.719465 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 31, 35, 716663)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:31:35.719873 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:31:35.720256 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Creating from source image-volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 29 21:31:35.731139 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:35.779797 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] creating snapshot='volume-b6aab0af-0b4a-4171-9178-374e1ee3fc7c.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 21:31:36.040508 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] cloning 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe@volume-b6aab0af-0b4a-4171-9178-374e1ee3fc7c.clone_snap' to 'volume-b6aab0af-0b4a-4171-9178-374e1ee3fc7c' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 21:31:36.159913 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:31:36.161110 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:31:36.161534 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:31:36.177491 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 21:31:36.178103 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Marking volume b6aab0af-0b4a-4171-9178-374e1ee3fc7c as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 21:31:36.186242 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to b6aab0af-0b4a-4171-9178-374e1ee3fc7c. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 21:31:36.187608 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Creating volume glance metadata for volume b6aab0af-0b4a-4171-9178-374e1ee3fc7c backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 21:31:36.237270 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ce70ff-9f59-4278-be8e-f8d56d3c3f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6aab0af-0b4a-4171-9178-374e1ee3fc7c', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:36.241894 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c61fab-4237-4803-bd3c-3cf6436179da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:36.249808 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Volume volume-b6aab0af-0b4a-4171-9178-374e1ee3fc7c (b6aab0af-0b4a-4171-9178-374e1ee3fc7c): created successfully Jan 29 21:31:36.253285 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c61fab-4237-4803-bd3c-3cf6436179da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:36.258796 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Flow 'volume_create_manager' (ebc5be31-0481-4990-8a0d-0bd33f3db80e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:36.266495 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-f7d2f5b0-c130-41b3-9cd3-5c7f428694d7 tempest-VolumesGetTest-1689175831 None] Created volume successfully. Jan 29 21:31:37.006086 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:31:37.009422 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:31:37.009919 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:31:37.028968 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Flow 'volume_create_manager' (165d5c08-b4ca-48d5-b029-3f11d33fb883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:37.035821 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfebd95-b3e2-4f3f-a9de-09d5c75d88e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:37.042123 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:31:37.056736 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfebd95-b3e2-4f3f-a9de-09d5c75d88e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:31:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1879392656',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=08c2dfd9-83a8-4e70-806d-61a0b8ec3a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f7c564dde4f4aa79129339df84355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:31:37Z,use_quota=True,user_id='8935c00701424769bcb6a6761a90bb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:37.063493 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc77edf-08b7-4f71-9db3-37874d5e9d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:37.067650 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc77edf-08b7-4f71-9db3-37874d5e9d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:37.074107 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87a1691-ae17-4b9f-8789-9baa8d520c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:37.078599 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87a1691-ae17-4b9f-8789-9baa8d520c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08c2dfd9-83a8-4e70-806d-61a0b8ec3a57', 'volume_name': 'volume-08c2dfd9-83a8-4e70-806d-61a0b8ec3a57', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:37.083778 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e7862a-7a99-4edc-8a24-0d4d9814722a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:37.087760 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e7862a-7a99-4edc-8a24-0d4d9814722a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:37.093219 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f84e3e6-6946-4cb6-b846-3c163c41e216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:37.094274 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Volume 08c2dfd9-83a8-4e70-806d-61a0b8ec3a57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08c2dfd9-83a8-4e70-806d-61a0b8ec3a57', 'volume_size': 1} Jan 29 21:31:37.094659 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] creating volume 'volume-08c2dfd9-83a8-4e70-806d-61a0b8ec3a57' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:31:37.095608 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:37.144133 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:31:37.144525 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:31:37.148236 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f84e3e6-6946-4cb6-b846-3c163c41e216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08c2dfd9-83a8-4e70-806d-61a0b8ec3a57', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:37.152889 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f93e2b-e87a-47b4-b8c9-8e7a41401d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:37.162166 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Volume volume-08c2dfd9-83a8-4e70-806d-61a0b8ec3a57 (08c2dfd9-83a8-4e70-806d-61a0b8ec3a57): created successfully Jan 29 21:31:37.166049 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f93e2b-e87a-47b4-b8c9-8e7a41401d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:37.172298 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Flow 'volume_create_manager' (165d5c08-b4ca-48d5-b029-3f11d33fb883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:37.180014 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-90b480d2-5a5e-419f-baa2-31662063cafb tempest-VolumesGetTest-1689175831 None] Created volume successfully. Jan 29 21:31:38.106922 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-2b22e9d9-d0fd-4ffa-92a0-17ca209e6f4d tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-08c2dfd9-83a8-4e70-806d-61a0b8ec3a57-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:31:38.135971 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2b22e9d9-d0fd-4ffa-92a0-17ca209e6f4d tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:38.175584 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2b22e9d9-d0fd-4ffa-92a0-17ca209e6f4d tempest-VolumesGetTest-1689175831 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:31:38.176099 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2b22e9d9-d0fd-4ffa-92a0-17ca209e6f4d tempest-VolumesGetTest-1689175831 None] Volume volume-08c2dfd9-83a8-4e70-806d-61a0b8ec3a57 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:31:38.180329 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2b22e9d9-d0fd-4ffa-92a0-17ca209e6f4d tempest-VolumesGetTest-1689175831 None] deleting rbd volume volume-08c2dfd9-83a8-4e70-806d-61a0b8ec3a57 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:31:38.370503 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-2b22e9d9-d0fd-4ffa-92a0-17ca209e6f4d tempest-VolumesGetTest-1689175831 None] Created reservations ['fcba74cf-93d8-450d-8b24-fa12762a8091', '62ba15be-3694-462a-8037-4adbdaa9707b', 'd175b6b0-1c2d-47ce-afe9-c155786285f1', 'be16cf5d-893a-4684-8034-29498077179e'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:31:38.408999 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2b22e9d9-d0fd-4ffa-92a0-17ca209e6f4d tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:38.430400 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2b22e9d9-d0fd-4ffa-92a0-17ca209e6f4d tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:38.453309 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-2b22e9d9-d0fd-4ffa-92a0-17ca209e6f4d tempest-VolumesGetTest-1689175831 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:31:38.457310 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-2b22e9d9-d0fd-4ffa-92a0-17ca209e6f4d tempest-VolumesGetTest-1689175831 None] Deleted volume successfully. Jan 29 21:31:38.468217 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-2b22e9d9-d0fd-4ffa-92a0-17ca209e6f4d tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-08c2dfd9-83a8-4e70-806d-61a0b8ec3a57-delete_volume'" released by "delete_volume" :: held 0.361s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:31:39.220348 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-546b183f-dd7a-483d-99dc-abf0939902b4 tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-b6aab0af-0b4a-4171-9178-374e1ee3fc7c-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:31:39.249942 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-546b183f-dd7a-483d-99dc-abf0939902b4 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:39.311165 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-546b183f-dd7a-483d-99dc-abf0939902b4 tempest-VolumesGetTest-1689175831 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:31:39.318543 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-546b183f-dd7a-483d-99dc-abf0939902b4 tempest-VolumesGetTest-1689175831 None] deleting rbd volume volume-b6aab0af-0b4a-4171-9178-374e1ee3fc7c {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:31:39.474504 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-546b183f-dd7a-483d-99dc-abf0939902b4 tempest-VolumesGetTest-1689175831 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 21:31:39.504102 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-546b183f-dd7a-483d-99dc-abf0939902b4 tempest-VolumesGetTest-1689175831 None] deleting parent snapshot volume-b6aab0af-0b4a-4171-9178-374e1ee3fc7c.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 21:31:39.903695 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-546b183f-dd7a-483d-99dc-abf0939902b4 tempest-VolumesGetTest-1689175831 None] Created reservations ['5c31796b-9cdc-4648-a147-b44d37a8c43d', '3721bb90-c58b-4e5b-98a5-55fd6367aa5c', '9a24be76-99b7-4f16-bb89-e4b98f82fa83', '2132fd46-c63b-4f17-a749-4327689500b0'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:31:39.944081 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-546b183f-dd7a-483d-99dc-abf0939902b4 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:39.966562 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-546b183f-dd7a-483d-99dc-abf0939902b4 tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:39.990694 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-546b183f-dd7a-483d-99dc-abf0939902b4 tempest-VolumesGetTest-1689175831 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:31:39.995491 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-546b183f-dd7a-483d-99dc-abf0939902b4 tempest-VolumesGetTest-1689175831 None] Deleted volume successfully. Jan 29 21:31:40.007555 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-546b183f-dd7a-483d-99dc-abf0939902b4 tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-b6aab0af-0b4a-4171-9178-374e1ee3fc7c-delete_volume'" released by "delete_volume" :: held 0.787s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:31:40.342204 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-dd7f226c-41fb-415c-9ba4-a4334f60c34b tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-3c11d478-1ddb-468f-bd2d-a8be60909031-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:31:40.374633 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dd7f226c-41fb-415c-9ba4-a4334f60c34b tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:40.414233 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dd7f226c-41fb-415c-9ba4-a4334f60c34b tempest-VolumesGetTest-1689175831 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:31:40.415001 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dd7f226c-41fb-415c-9ba4-a4334f60c34b tempest-VolumesGetTest-1689175831 None] Volume volume-3c11d478-1ddb-468f-bd2d-a8be60909031 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:31:40.420407 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dd7f226c-41fb-415c-9ba4-a4334f60c34b tempest-VolumesGetTest-1689175831 None] deleting rbd volume volume-3c11d478-1ddb-468f-bd2d-a8be60909031 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:31:40.614544 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-dd7f226c-41fb-415c-9ba4-a4334f60c34b tempest-VolumesGetTest-1689175831 None] Created reservations ['ac53cdcf-17e8-4a67-b069-1f34b548e4fd', 'ab51cd67-4061-490d-80fe-82c80dd70346', '9c4bd9fd-13cc-42ee-b33c-29bd86b89ab5', 'e5e7286f-2584-4dc2-874b-4ae79cd8c75c'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:31:40.653756 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dd7f226c-41fb-415c-9ba4-a4334f60c34b tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:40.677335 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-dd7f226c-41fb-415c-9ba4-a4334f60c34b tempest-VolumesGetTest-1689175831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:40.699155 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-dd7f226c-41fb-415c-9ba4-a4334f60c34b tempest-VolumesGetTest-1689175831 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:31:40.703270 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-dd7f226c-41fb-415c-9ba4-a4334f60c34b tempest-VolumesGetTest-1689175831 None] Deleted volume successfully. Jan 29 21:31:40.714442 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-dd7f226c-41fb-415c-9ba4-a4334f60c34b tempest-VolumesGetTest-1689175831 None] Lock "b'cinder-3c11d478-1ddb-468f-bd2d-a8be60909031-delete_volume'" released by "delete_volume" :: held 0.372s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:31:43.786545 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:31:43.789686 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:31:43.790105 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:31:43.809577 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Flow 'volume_create_manager' (cb26c634-0955-4bad-80b2-b837718f7295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:43.816904 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a66f05f-d23d-40a4-ab26-408dc969494f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:43.823328 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:31:43.840039 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a66f05f-d23d-40a4-ab26-408dc969494f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-608191513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5e2560b7-72da-4486-9079-99b40ddbdacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e01a7131e04956bdf4310d2d1aa0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:31:44Z,use_quota=True,user_id='ae52d73c7a7746b7ad7f5b1c690fdd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:43.845394 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12ffc54-7e22-47ec-919e-09e1128b7a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:43.849806 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12ffc54-7e22-47ec-919e-09e1128b7a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:43.854829 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b3236c-e9f2-4a73-9316-af39d333c9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:43.860031 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b3236c-e9f2-4a73-9316-af39d333c9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e2560b7-72da-4486-9079-99b40ddbdacd', 'volume_name': 'volume-5e2560b7-72da-4486-9079-99b40ddbdacd', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:43.865108 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478c03a8-cddc-4ad1-be87-d6c8befaa835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:43.869581 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478c03a8-cddc-4ad1-be87-d6c8befaa835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:43.874236 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf9d3d0-99b1-4619-9b57-8c4ce1dc7df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:43.875861 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Volume 5e2560b7-72da-4486-9079-99b40ddbdacd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e2560b7-72da-4486-9079-99b40ddbdacd', 'volume_size': 1} Jan 29 21:31:43.876241 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] creating volume 'volume-5e2560b7-72da-4486-9079-99b40ddbdacd' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:31:43.877209 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:43.926948 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:31:43.927328 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:31:43.931043 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf9d3d0-99b1-4619-9b57-8c4ce1dc7df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2560b7-72da-4486-9079-99b40ddbdacd', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:43.935592 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d285fd-4fbf-4086-a58c-e2b022643eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:31:43.945540 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Volume volume-5e2560b7-72da-4486-9079-99b40ddbdacd (5e2560b7-72da-4486-9079-99b40ddbdacd): created successfully Jan 29 21:31:43.949013 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d285fd-4fbf-4086-a58c-e2b022643eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:31:43.954388 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Flow 'volume_create_manager' (cb26c634-0955-4bad-80b2-b837718f7295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:31:43.961706 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-35a1b683-7f80-4d1b-8f23-01a3d000816d tempest-VolumesSnapshotTestJSON-16764377 None] Created volume successfully. Jan 29 21:31:44.967223 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cb7e08be-13a0-4356-a5d3-b4dcf8549235 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:46.042885 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-cb7e08be-13a0-4356-a5d3-b4dcf8549235 tempest-VolumesSnapshotTestJSON-16764377 None] Create snapshot completed successfully Jan 29 21:31:47.301323 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.driver [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] Creating a new backup for volume volume-5e2560b7-72da-4486-9079-99b40ddbdacd. {{(pid=134283) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1226}} Jan 29 21:31:47.332863 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] cloning volumes/volume-5e2560b7-72da-4486-9079-99b40ddbdacd@snapshot-a129b379-fcaa-45f7-816a-27e0191ce41c to volume-851b7de6-49f5-4b68-9a7e-d8b7e8257d65 {{(pid=134283) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 29 21:31:47.333526 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:47.366328 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:47.463091 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:31:47.463486 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:31:47.492599 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:31:48.122010 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.629s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:31:48.122835 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-851b7de6-49f5-4b68-9a7e-d8b7e8257d65', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '851b7de6-49f5-4b68-9a7e-d8b7e8257d65', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:31:48.137369 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] Initialize volume connection completed successfully. Jan 29 21:31:56.208363 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] Terminate volume connection completed successfully. Jan 29 21:31:56.223829 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] Remove volume export completed successfully. Jan 29 21:31:56.257280 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-851b7de6-49f5-4b68-9a7e-d8b7e8257d65-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:31:56.271982 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:31:56.325137 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:31:56.331048 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] deleting rbd volume volume-851b7de6-49f5-4b68-9a7e-d8b7e8257d65 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:31:56.559513 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] Deleted volume successfully. Jan 29 21:31:56.564488 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-52de1e11-d0df-463f-8943-5d82aae6e76e tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-851b7de6-49f5-4b68-9a7e-d8b7e8257d65-delete_volume'" released by "delete_volume" :: held 0.307s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:32:10.937297 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:32:10.941682 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:32:10.942153 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:32:10.961236 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Flow 'volume_create_manager' (3d8451db-b14e-410e-9a9c-e024f5a51db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:32:10.968107 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a36139b-53e0-4c55-9b6c-141037ec61ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:32:10.974455 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:32:10.988437 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a36139b-53e0-4c55-9b6c-141037ec61ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-213447282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=71d092b4-2239-499a-b8f2-531de07ed05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e01a7131e04956bdf4310d2d1aa0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:32:11Z,use_quota=True,user_id='ae52d73c7a7746b7ad7f5b1c690fdd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:32:10.993847 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c0ed50-9cbd-4cb7-a3b4-038348dfbfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:32:10.997995 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c0ed50-9cbd-4cb7-a3b4-038348dfbfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:32:11.003750 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77408fc5-807c-4619-875d-74cb1f28ad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:32:11.080027 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77408fc5-807c-4619-875d-74cb1f28ad1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '71d092b4-2239-499a-b8f2-531de07ed05f', 'volume_name': 'volume-71d092b4-2239-499a-b8f2-531de07ed05f', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:32:11.085361 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f94ff5-cf5b-4c13-bad3-8b71bacdd0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:32:11.089447 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f94ff5-cf5b-4c13-bad3-8b71bacdd0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:32:11.094239 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244a9c0f-32f9-485f-84d2-d521ea58879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:32:11.095358 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Volume 71d092b4-2239-499a-b8f2-531de07ed05f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-71d092b4-2239-499a-b8f2-531de07ed05f', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 21:32:11.095916 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Cloning 71d092b4-2239-499a-b8f2-531de07ed05f from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 21:32:11.104015 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:32:11.114191 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 32, 11, 108583)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:32:11.114649 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:32:11.115128 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Found cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 29 21:32:11.120043 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:32:11.121072 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 21:32:11.126325 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 21, 32, 11, 124222)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 21:32:11.126726 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 21:32:11.127102 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Creating from source image-volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 29 21:32:11.138177 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:32:11.191836 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] creating snapshot='volume-71d092b4-2239-499a-b8f2-531de07ed05f.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 21:32:11.966754 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] cloning 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe@volume-71d092b4-2239-499a-b8f2-531de07ed05f.clone_snap' to 'volume-71d092b4-2239-499a-b8f2-531de07ed05f' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 21:32:12.094234 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:32:12.095478 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:32:12.095848 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:32:12.111035 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 21:32:12.111724 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Marking volume 71d092b4-2239-499a-b8f2-531de07ed05f as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 21:32:12.118906 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to 71d092b4-2239-499a-b8f2-531de07ed05f. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 21:32:12.119310 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Creating volume glance metadata for volume 71d092b4-2239-499a-b8f2-531de07ed05f backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 21:32:12.165338 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244a9c0f-32f9-485f-84d2-d521ea58879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71d092b4-2239-499a-b8f2-531de07ed05f', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:32:12.169957 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3318f452-3d14-42d1-88c1-4828465fb0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:32:12.177355 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Volume volume-71d092b4-2239-499a-b8f2-531de07ed05f (71d092b4-2239-499a-b8f2-531de07ed05f): created successfully Jan 29 21:32:12.180840 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3318f452-3d14-42d1-88c1-4828465fb0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:32:12.186341 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Flow 'volume_create_manager' (3d8451db-b14e-410e-9a9c-e024f5a51db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:32:12.194714 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-cd2de461-24c7-4ce5-9977-44c94beb6f9a tempest-VolumesSnapshotTestJSON-16764377 None] Created volume successfully. Jan 29 21:32:13.375486 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-e239fa1f-2f53-449b-a07b-3219136ba205 req-cb80d37a-0280-44a3-a706-d94ad7f33ca8 tempest-VolumesSnapshotTestJSON-16764377 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:32:14.061956 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-e239fa1f-2f53-449b-a07b-3219136ba205 req-cb80d37a-0280-44a3-a706-d94ad7f33ca8 tempest-VolumesSnapshotTestJSON-16764377 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.686s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:32:14.063018 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-e239fa1f-2f53-449b-a07b-3219136ba205 req-cb80d37a-0280-44a3-a706-d94ad7f33ca8 tempest-VolumesSnapshotTestJSON-16764377 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-71d092b4-2239-499a-b8f2-531de07ed05f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '71d092b4-2239-499a-b8f2-531de07ed05f', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:32:14.084948 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-e239fa1f-2f53-449b-a07b-3219136ba205 req-cb80d37a-0280-44a3-a706-d94ad7f33ca8 tempest-VolumesSnapshotTestJSON-16764377 None] Connection info returned from driver {'name': 'volumes/volume-71d092b4-2239-499a-b8f2-531de07ed05f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '71d092b4-2239-499a-b8f2-531de07ed05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2659f9cb-d54a-4a7e-b46d-e2d5d353ff97'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:32:14.128688 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-e239fa1f-2f53-449b-a07b-3219136ba205 req-cb80d37a-0280-44a3-a706-d94ad7f33ca8 tempest-VolumesSnapshotTestJSON-16764377 None] attachment_update completed successfully. Jan 29 21:32:16.664569 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-584c8fa0-fc59-47d1-a774-754f50da5209 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:32:17.052493 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-584c8fa0-fc59-47d1-a774-754f50da5209 tempest-VolumesSnapshotTestJSON-16764377 None] Create snapshot completed successfully Jan 29 21:32:17.838020 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9d684452-f917-4276-84c8-946b9ee67812 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:32:18.956590 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9d684452-f917-4276-84c8-946b9ee67812 tempest-VolumesSnapshotTestJSON-16764377 None] Create snapshot completed successfully Jan 29 21:32:20.051946 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d4fc60da-39fd-438c-bc14-16f89351f97f tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:32:21.083046 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d4fc60da-39fd-438c-bc14-16f89351f97f tempest-VolumesSnapshotTestJSON-16764377 None] Create snapshot completed successfully Jan 29 21:32:22.131324 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-a85f4d81-7c16-4811-a6a9-86fcaf4a8164 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-95885265-a5ef-4881-833c-ae4cfb0385bb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:32:22.132874 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a85f4d81-7c16-4811-a6a9-86fcaf4a8164 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:32:28.719493 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:32:28.720325 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:32:28.741322 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:32:28.763483 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:32:52.283045 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-a85f4d81-7c16-4811-a6a9-86fcaf4a8164 tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['add08df9-fed1-401a-bad0-467db850704a', 'ae7d16b7-b45c-45e8-9584-5a4916b82fd6', '43f59e86-36a9-47db-82f8-1816a4e7b4ab', '309b9d6d-46dc-487a-8cbf-fba824492391'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:32:52.317849 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-a85f4d81-7c16-4811-a6a9-86fcaf4a8164 tempest-VolumesSnapshotTestJSON-16764377 None] Delete snapshot completed successfully. Jan 29 21:32:52.322758 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-a85f4d81-7c16-4811-a6a9-86fcaf4a8164 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-95885265-a5ef-4881-833c-ae4cfb0385bb-delete_snapshot'" released by "delete_snapshot" :: held 30.192s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:32:52.954283 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-6654744b-15c9-41d9-bbf5-0d0ee085b856 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-88ec2856-69d4-44c5-bef7-bee88af7b34d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:32:52.956099 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6654744b-15c9-41d9-bbf5-0d0ee085b856 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:33:23.101124 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-6654744b-15c9-41d9-bbf5-0d0ee085b856 tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['3e111e73-4e10-48fc-ae3e-354e604ae03f', '742065df-8be0-451c-9a6c-9e162c1466e4', 'a2f4b5d4-a7ed-4a2b-970c-a555d07d163d', '122e2fe9-0f14-485a-acdf-8794f4077be1'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:33:23.137747 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6654744b-15c9-41d9-bbf5-0d0ee085b856 tempest-VolumesSnapshotTestJSON-16764377 None] Delete snapshot completed successfully. Jan 29 21:33:23.142174 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-6654744b-15c9-41d9-bbf5-0d0ee085b856 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-88ec2856-69d4-44c5-bef7-bee88af7b34d-delete_snapshot'" released by "delete_snapshot" :: held 30.188s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:33:23.780892 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-c3cd2ae8-809a-407f-8047-f97f825ce7fd tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-087065e7-cd7b-4f8b-9c81-6d67393a6e23-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:33:23.783770 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c3cd2ae8-809a-407f-8047-f97f825ce7fd tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:33:28.718119 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:33:28.718850 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:33:28.739545 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:33:28.761764 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:33:53.937526 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-c3cd2ae8-809a-407f-8047-f97f825ce7fd tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['db68f2c5-5391-4d84-b898-dd221d30c548', 'c808030c-be18-4815-8fa8-9198c1bd3dda', 'afaa32be-c634-41ed-8173-17d630c73049', '96d5bfc7-085c-409d-b0a5-64787e835c45'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:33:53.973662 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-c3cd2ae8-809a-407f-8047-f97f825ce7fd tempest-VolumesSnapshotTestJSON-16764377 None] Delete snapshot completed successfully. Jan 29 21:33:53.979153 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-c3cd2ae8-809a-407f-8047-f97f825ce7fd tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-087065e7-cd7b-4f8b-9c81-6d67393a6e23-delete_snapshot'" released by "delete_snapshot" :: held 30.198s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:33:55.372535 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-8474958a-a00c-4b80-a14a-3f061c9ec844 req-0a4fe41c-4073-4df0-ae83-f726a2a578c0 tempest-VolumesSnapshotTestJSON-16764377 None] Terminate volume connection completed successfully. Jan 29 21:33:55.373265 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-8474958a-a00c-4b80-a14a-3f061c9ec844 req-0a4fe41c-4073-4df0-ae83-f726a2a578c0 tempest-VolumesSnapshotTestJSON-16764377 None] Deleting attachment 2659f9cb-d54a-4a7e-b46d-e2d5d353ff97. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:33:59.592476 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-c020c1e4-414d-4ddd-beeb-d9d8d8344d41 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:34:00.078368 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-c020c1e4-414d-4ddd-beeb-d9d8d8344d41 tempest-VolumesSnapshotTestJSON-16764377 None] Create snapshot completed successfully Jan 29 21:34:00.761623 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-041758e2-8d15-44f1-9820-95ce594dff08 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-c024face-159d-4a6d-9c18-ea07ddcd5d29-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:34:00.762982 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-041758e2-8d15-44f1-9820-95ce594dff08 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:34:01.105332 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-041758e2-8d15-44f1-9820-95ce594dff08 tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['584a60aa-5d92-4bd9-ab33-badf4e9c2e68', 'b4d73ad6-96c3-4c32-af51-8492e65a12a8', '0b95e9f3-b78f-42a2-8490-a40f8ee411bc', '34f4afc7-abe6-43b1-bae3-548d35546937'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:34:01.138422 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-041758e2-8d15-44f1-9820-95ce594dff08 tempest-VolumesSnapshotTestJSON-16764377 None] Delete snapshot completed successfully. Jan 29 21:34:01.142899 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-041758e2-8d15-44f1-9820-95ce594dff08 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-c024face-159d-4a6d-9c18-ea07ddcd5d29-delete_snapshot'" released by "delete_snapshot" :: held 0.381s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:34:01.961513 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-20e30269-490f-4128-9e16-1b9bc6285021 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:34:02.114565 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-20e30269-490f-4128-9e16-1b9bc6285021 tempest-VolumesSnapshotTestJSON-16764377 None] Create snapshot completed successfully Jan 29 21:34:14.555977 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-3ffcd7f2-6ee6-4af3-ae97-e3628abde4ef req-86b5bbd6-6bf2-495b-b6f5-c48a865d9a93 tempest-VolumesSnapshotTestJSON-16764377 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:34:15.185464 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-3ffcd7f2-6ee6-4af3-ae97-e3628abde4ef req-86b5bbd6-6bf2-495b-b6f5-c48a865d9a93 tempest-VolumesSnapshotTestJSON-16764377 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.629s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:34:15.186294 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-3ffcd7f2-6ee6-4af3-ae97-e3628abde4ef req-86b5bbd6-6bf2-495b-b6f5-c48a865d9a93 tempest-VolumesSnapshotTestJSON-16764377 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5e2560b7-72da-4486-9079-99b40ddbdacd', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '5e2560b7-72da-4486-9079-99b40ddbdacd', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:34:15.208474 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-3ffcd7f2-6ee6-4af3-ae97-e3628abde4ef req-86b5bbd6-6bf2-495b-b6f5-c48a865d9a93 tempest-VolumesSnapshotTestJSON-16764377 None] Connection info returned from driver {'name': 'volumes/volume-5e2560b7-72da-4486-9079-99b40ddbdacd', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5e2560b7-72da-4486-9079-99b40ddbdacd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ea4cc70b-4f34-4bcf-9a83-7bcb457ce0c9'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:34:15.252109 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-3ffcd7f2-6ee6-4af3-ae97-e3628abde4ef req-86b5bbd6-6bf2-495b-b6f5-c48a865d9a93 tempest-VolumesSnapshotTestJSON-16764377 None] attachment_update completed successfully. Jan 29 21:34:16.739746 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ab87cefb-5e5f-4596-9df8-d57374b78b4c tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:34:17.111387 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ab87cefb-5e5f-4596-9df8-d57374b78b4c tempest-VolumesSnapshotTestJSON-16764377 None] Create snapshot completed successfully Jan 29 21:34:17.916770 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-69087ef8-c286-42b2-ad05-75bf9febd5b8 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:34:18.131084 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-69087ef8-c286-42b2-ad05-75bf9febd5b8 tempest-VolumesSnapshotTestJSON-16764377 None] Create snapshot completed successfully Jan 29 21:34:18.977515 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-6a23c460-b29e-4e99-b911-9c192e202272 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-1c187506-afb9-4c41-ab84-30e31d98f60d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:34:18.978952 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6a23c460-b29e-4e99-b911-9c192e202272 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:34:28.717147 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:34:28.717988 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:34:28.739521 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:34:28.760959 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:34:49.101718 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-6a23c460-b29e-4e99-b911-9c192e202272 tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['5b9fcdf2-642e-45f7-a006-5375c9f2f45a', '7fcadfcb-7d38-4ed3-9c31-238df1b6c61e', '5228519f-7e99-48e5-8858-deb3fe9db5fd', 'c7f507fa-8601-415e-81c6-41b2440e899d'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:34:49.136238 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6a23c460-b29e-4e99-b911-9c192e202272 tempest-VolumesSnapshotTestJSON-16764377 None] Delete snapshot completed successfully. Jan 29 21:34:49.140529 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-6a23c460-b29e-4e99-b911-9c192e202272 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-1c187506-afb9-4c41-ab84-30e31d98f60d-delete_snapshot'" released by "delete_snapshot" :: held 30.163s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:34:49.803052 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-bc837360-7af2-45db-a83f-f7d2eb99e977 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-3b694522-56d7-4951-a185-93102bb64abd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:34:49.804872 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-bc837360-7af2-45db-a83f-f7d2eb99e977 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:35:19.937232 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-bc837360-7af2-45db-a83f-f7d2eb99e977 tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['0f145576-1eeb-4744-8cbd-c183586448fd', 'aa9ac50f-a415-471a-b3f8-68c5ec4ed176', 'ca7c5400-453c-4701-aaf5-ccf26d3055bd', 'd3b6d5be-7079-44dd-8370-26fc147e36d1'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:35:19.970600 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-bc837360-7af2-45db-a83f-f7d2eb99e977 tempest-VolumesSnapshotTestJSON-16764377 None] Delete snapshot completed successfully. Jan 29 21:35:19.975161 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-bc837360-7af2-45db-a83f-f7d2eb99e977 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-3b694522-56d7-4951-a185-93102bb64abd-delete_snapshot'" released by "delete_snapshot" :: held 30.172s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:35:20.620529 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-699052c2-c779-422d-b596-ad2930aa113d tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-bb4cdb09-2e9c-450a-8b3e-f1a842dae4bb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:35:20.622871 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-699052c2-c779-422d-b596-ad2930aa113d tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:35:28.715432 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:35:28.716158 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:35:28.738497 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:35:28.759972 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:35:50.750432 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-699052c2-c779-422d-b596-ad2930aa113d tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['90d14622-ede4-4111-98f5-a00ccf415091', '311ec1f5-7535-4889-8753-5cf65761f8b3', '84a456a4-6e4b-4cf9-927b-d051c3e5e211', '12837718-830f-4e80-8166-70fc1b589510'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:35:50.785257 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-699052c2-c779-422d-b596-ad2930aa113d tempest-VolumesSnapshotTestJSON-16764377 None] Delete snapshot completed successfully. Jan 29 21:35:50.789657 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-699052c2-c779-422d-b596-ad2930aa113d tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-bb4cdb09-2e9c-450a-8b3e-f1a842dae4bb-delete_snapshot'" released by "delete_snapshot" :: held 30.169s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:35:52.222333 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-3f86d23d-97f3-4b43-ae37-c676641fe9bd req-57906438-86ba-46bf-bf38-e0d43bc084e3 tempest-VolumesSnapshotTestJSON-16764377 None] Terminate volume connection completed successfully. Jan 29 21:35:52.222333 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-3f86d23d-97f3-4b43-ae37-c676641fe9bd req-57906438-86ba-46bf-bf38-e0d43bc084e3 tempest-VolumesSnapshotTestJSON-16764377 None] Deleting attachment ea4cc70b-4f34-4bcf-9a83-7bcb457ce0c9. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:35:56.544815 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:35:56.548788 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:35:56.549317 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:35:56.568705 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Flow 'volume_create_manager' (98dd1a55-0220-41c6-8073-e491d21a81a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:35:56.575226 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5560ae25-a04d-456b-bedb-92c4283f7a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:35:56.583136 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:35:56.596925 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5560ae25-a04d-456b-bedb-92c4283f7a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1456636508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f5e1f546-466a-45dc-abbc-3bd8f89f2288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e01a7131e04956bdf4310d2d1aa0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:35:57Z,use_quota=True,user_id='ae52d73c7a7746b7ad7f5b1c690fdd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:35:56.602282 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb97ea4-7626-41e0-a835-c653982aae15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:35:56.607064 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb97ea4-7626-41e0-a835-c653982aae15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:35:56.612132 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e044da6-c9e8-4753-8946-8ed1b27b7e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:35:56.616352 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e044da6-c9e8-4753-8946-8ed1b27b7e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5e1f546-466a-45dc-abbc-3bd8f89f2288', 'volume_name': 'volume-f5e1f546-466a-45dc-abbc-3bd8f89f2288', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:35:56.621226 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1466076-2b6d-47c6-aef0-b8d0bbdbe9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:35:56.625475 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1466076-2b6d-47c6-aef0-b8d0bbdbe9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:35:56.630203 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a3676a-5e63-47e3-b327-a90ed08daf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:35:56.631252 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Volume f5e1f546-466a-45dc-abbc-3bd8f89f2288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5e1f546-466a-45dc-abbc-3bd8f89f2288', 'volume_size': 1} Jan 29 21:35:56.631646 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] creating volume 'volume-f5e1f546-466a-45dc-abbc-3bd8f89f2288' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:35:56.632598 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:35:56.680896 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:35:56.681296 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:35:56.684996 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a3676a-5e63-47e3-b327-a90ed08daf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5e1f546-466a-45dc-abbc-3bd8f89f2288', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:35:56.689575 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2b6622-9d15-4ddf-a6af-a30be17293b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:35:56.698382 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Volume volume-f5e1f546-466a-45dc-abbc-3bd8f89f2288 (f5e1f546-466a-45dc-abbc-3bd8f89f2288): created successfully Jan 29 21:35:56.701912 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2b6622-9d15-4ddf-a6af-a30be17293b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:35:56.707395 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Flow 'volume_create_manager' (98dd1a55-0220-41c6-8073-e491d21a81a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:35:56.714289 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-6cba1c4f-b840-4013-968b-3093be1b2b36 tempest-VolumesSnapshotTestJSON-16764377 None] Created volume successfully. Jan 29 21:35:57.706898 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-710a99e6-ee3c-4be7-bb0a-4036007c103f tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:35:58.228250 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-710a99e6-ee3c-4be7-bb0a-4036007c103f tempest-VolumesSnapshotTestJSON-16764377 None] Create snapshot completed successfully Jan 29 21:35:59.065117 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:35:59.068532 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:35:59.068960 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:35:59.095761 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Flow 'volume_create_manager' (15654c46-31c6-4a76-8629-9f62b9cda496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:35:59.102884 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e17752-a22e-4bea-8371-9a42033e4194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:35:59.109080 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:35:59.123287 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e17752-a22e-4bea-8371-9a42033e4194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1789265025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e55399fc-760c-4f3a-9cf2-19754856d69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e01a7131e04956bdf4310d2d1aa0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:35:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=bda2e284-1a8b-411e-abe8-0e258ce8c411,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:35:59Z,use_quota=True,user_id='ae52d73c7a7746b7ad7f5b1c690fdd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:35:59.129165 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69bcc2d-dd35-42b7-83bc-e12d538abe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:35:59.133268 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69bcc2d-dd35-42b7-83bc-e12d538abe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:35:59.138984 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f26b1e9-a7e2-4cb7-b7c8-642203886303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:35:59.143091 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f26b1e9-a7e2-4cb7-b7c8-642203886303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e55399fc-760c-4f3a-9cf2-19754856d69f', 'volume_name': 'volume-e55399fc-760c-4f3a-9cf2-19754856d69f', 'volume_size': 2, 'snapshot_id': 'bda2e284-1a8b-411e-abe8-0e258ce8c411'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:35:59.147981 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbad85a-9be3-43b1-866f-a8aec40f6fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:35:59.151952 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbad85a-9be3-43b1-866f-a8aec40f6fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:35:59.156620 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3537fdc3-8875-48ed-8737-87dc104eb142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:35:59.157776 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Volume e55399fc-760c-4f3a-9cf2-19754856d69f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e55399fc-760c-4f3a-9cf2-19754856d69f', 'volume_size': 2, 'snapshot_id': 'bda2e284-1a8b-411e-abe8-0e258ce8c411'} Jan 29 21:35:59.175276 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] cloning volumes/volume-f5e1f546-466a-45dc-abbc-3bd8f89f2288@snapshot-bda2e284-1a8b-411e-abe8-0e258ce8c411 to volume-e55399fc-760c-4f3a-9cf2-19754856d69f {{(pid=134283) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 29 21:35:59.176136 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:35:59.211215 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:35:59.306960 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:35:59.307340 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:35:59.311654 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:35:59.407856 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3537fdc3-8875-48ed-8737-87dc104eb142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e55399fc-760c-4f3a-9cf2-19754856d69f', 'volume_size': 2, 'snapshot_id': 'bda2e284-1a8b-411e-abe8-0e258ce8c411'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:35:59.412419 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9cd84a1-d4f6-4a49-b2fd-e63f90c3d80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:35:59.420565 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Volume volume-e55399fc-760c-4f3a-9cf2-19754856d69f (e55399fc-760c-4f3a-9cf2-19754856d69f): created successfully Jan 29 21:35:59.424024 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9cd84a1-d4f6-4a49-b2fd-e63f90c3d80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:35:59.429461 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Flow 'volume_create_manager' (15654c46-31c6-4a76-8629-9f62b9cda496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:35:59.443721 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-da952bc2-2b8e-47fb-b8df-1ef9f85e7b7c tempest-VolumesSnapshotTestJSON-16764377 None] Created volume successfully. Jan 29 21:36:00.162135 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-16e09951-ec7d-4205-9e3c-1c33f4582714 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-e55399fc-760c-4f3a-9cf2-19754856d69f-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:36:00.197189 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-16e09951-ec7d-4205-9e3c-1c33f4582714 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:00.245781 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-16e09951-ec7d-4205-9e3c-1c33f4582714 tempest-VolumesSnapshotTestJSON-16764377 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:36:00.251128 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-16e09951-ec7d-4205-9e3c-1c33f4582714 tempest-VolumesSnapshotTestJSON-16764377 None] deleting rbd volume volume-e55399fc-760c-4f3a-9cf2-19754856d69f {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:36:00.439992 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-16e09951-ec7d-4205-9e3c-1c33f4582714 tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['e3ca90f7-8655-4474-aad0-6e5a79b4ebe9', 'ec9afa91-0e5e-42bc-9758-3b31fec5858b', '2710c50b-60a9-4ae6-8a46-65716fd8b817', 'af1f6f57-ee16-4397-89f2-70c1c6ef9372'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:36:00.477944 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-16e09951-ec7d-4205-9e3c-1c33f4582714 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:00.500247 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-16e09951-ec7d-4205-9e3c-1c33f4582714 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:00.523147 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-16e09951-ec7d-4205-9e3c-1c33f4582714 tempest-VolumesSnapshotTestJSON-16764377 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:36:00.527194 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-16e09951-ec7d-4205-9e3c-1c33f4582714 tempest-VolumesSnapshotTestJSON-16764377 None] Deleted volume successfully. Jan 29 21:36:00.538229 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-16e09951-ec7d-4205-9e3c-1c33f4582714 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-e55399fc-760c-4f3a-9cf2-19754856d69f-delete_volume'" released by "delete_volume" :: held 0.376s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:36:01.506967 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:36:01.510100 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:36:01.510543 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:36:01.530152 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Flow 'volume_create_manager' (6fdc2cef-b7e3-42a3-8a13-aeb1e2da6dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:36:01.536628 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63400ab-c4b4-4159-9da1-ec74f0c50524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:36:01.543084 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:36:01.556855 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63400ab-c4b4-4159-9da1-ec74f0c50524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-787049661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8dca0234-ea61-425b-898a-496f7b1ea57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e01a7131e04956bdf4310d2d1aa0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:36:01Z,use_quota=True,user_id='ae52d73c7a7746b7ad7f5b1c690fdd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:36:01.562402 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bfa021-f293-4b4e-98dc-be9f57b30f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:36:01.566561 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bfa021-f293-4b4e-98dc-be9f57b30f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:36:01.571977 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5f17d1-2f2c-4965-abc1-4c240627bf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:36:01.576696 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5f17d1-2f2c-4965-abc1-4c240627bf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dca0234-ea61-425b-898a-496f7b1ea57d', 'volume_name': 'volume-8dca0234-ea61-425b-898a-496f7b1ea57d', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:36:01.581700 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6164803d-d5d6-4ac7-9be0-16c12af16124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:36:01.585717 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6164803d-d5d6-4ac7-9be0-16c12af16124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:36:01.590499 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27950ba1-298b-412e-95a7-ed6cb322062c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:36:01.592051 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Volume 8dca0234-ea61-425b-898a-496f7b1ea57d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dca0234-ea61-425b-898a-496f7b1ea57d', 'volume_size': 1} Jan 29 21:36:01.592441 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] creating volume 'volume-8dca0234-ea61-425b-898a-496f7b1ea57d' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:36:01.593424 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:01.641808 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:36:01.642208 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:36:01.646621 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27950ba1-298b-412e-95a7-ed6cb322062c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dca0234-ea61-425b-898a-496f7b1ea57d', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:36:01.651301 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01961c2d-84b9-4c0a-9c37-8070203e68e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:36:01.662087 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Volume volume-8dca0234-ea61-425b-898a-496f7b1ea57d (8dca0234-ea61-425b-898a-496f7b1ea57d): created successfully Jan 29 21:36:01.665973 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01961c2d-84b9-4c0a-9c37-8070203e68e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:36:01.671871 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Flow 'volume_create_manager' (6fdc2cef-b7e3-42a3-8a13-aeb1e2da6dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:36:01.680471 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-2320a305-8cf6-469f-a6a8-dedd401be96b tempest-VolumesSnapshotTestJSON-16764377 None] Created volume successfully. Jan 29 21:36:02.676666 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-350400c2-76db-4662-ba95-85bd9766b082 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:03.266394 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-350400c2-76db-4662-ba95-85bd9766b082 tempest-VolumesSnapshotTestJSON-16764377 None] Create snapshot completed successfully Jan 29 21:36:04.024026 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:36:04.027197 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:36:04.027633 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:36:04.054067 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Flow 'volume_create_manager' (b6e944c7-45b1-4400-afa0-ded6fd69988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:36:04.061449 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acb89a6-4d73-4b01-a5c4-ef6a4adea4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:36:04.068145 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:36:04.081934 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acb89a6-4d73-4b01-a5c4-ef6a4adea4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-254467984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d00ab7c-8e19-4157-abb4-a3115b974b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e01a7131e04956bdf4310d2d1aa0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c08be256-ac9f-47fd-aee1-da77a0d20a41,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:36:04Z,use_quota=True,user_id='ae52d73c7a7746b7ad7f5b1c690fdd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:36:04.087354 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506c9cfc-fbba-4957-aacc-7f93d196de8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:36:04.092014 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506c9cfc-fbba-4957-aacc-7f93d196de8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:36:04.097153 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584733f9-5f11-48c8-a471-99a599be3f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:36:04.101301 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584733f9-5f11-48c8-a471-99a599be3f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5d00ab7c-8e19-4157-abb4-a3115b974b7a', 'volume_name': 'volume-5d00ab7c-8e19-4157-abb4-a3115b974b7a', 'volume_size': 1, 'snapshot_id': 'c08be256-ac9f-47fd-aee1-da77a0d20a41'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:36:04.106883 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71026111-5f69-40f4-98f7-06439d67acaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:36:04.110935 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71026111-5f69-40f4-98f7-06439d67acaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:36:04.115882 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1f0d74-038e-4514-82c2-614451e2036c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:36:04.116949 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Volume 5d00ab7c-8e19-4157-abb4-a3115b974b7a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5d00ab7c-8e19-4157-abb4-a3115b974b7a', 'volume_size': 1, 'snapshot_id': 'c08be256-ac9f-47fd-aee1-da77a0d20a41'} Jan 29 21:36:04.136152 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] cloning volumes/volume-8dca0234-ea61-425b-898a-496f7b1ea57d@snapshot-c08be256-ac9f-47fd-aee1-da77a0d20a41 to volume-5d00ab7c-8e19-4157-abb4-a3115b974b7a {{(pid=134283) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 29 21:36:04.137058 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:04.171959 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:04.269275 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:36:04.269650 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:36:04.288602 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1f0d74-038e-4514-82c2-614451e2036c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d00ab7c-8e19-4157-abb4-a3115b974b7a', 'volume_size': 1, 'snapshot_id': 'c08be256-ac9f-47fd-aee1-da77a0d20a41'}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:36:04.293227 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de421ea-e475-4973-a207-96944d3ede16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:36:04.302019 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Volume volume-5d00ab7c-8e19-4157-abb4-a3115b974b7a (5d00ab7c-8e19-4157-abb4-a3115b974b7a): created successfully Jan 29 21:36:04.305692 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de421ea-e475-4973-a207-96944d3ede16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:36:04.311318 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Flow 'volume_create_manager' (b6e944c7-45b1-4400-afa0-ded6fd69988d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:36:04.324270 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e43d1b0b-2729-4703-a716-8268d54b7afe tempest-VolumesSnapshotTestJSON-16764377 None] Created volume successfully. Jan 29 21:36:05.131468 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-73bcba2e-00e1-4bd7-b5f9-8d5b618a262f tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-5d00ab7c-8e19-4157-abb4-a3115b974b7a-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:36:05.162858 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-73bcba2e-00e1-4bd7-b5f9-8d5b618a262f tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:05.212222 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-73bcba2e-00e1-4bd7-b5f9-8d5b618a262f tempest-VolumesSnapshotTestJSON-16764377 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:36:05.218788 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-73bcba2e-00e1-4bd7-b5f9-8d5b618a262f tempest-VolumesSnapshotTestJSON-16764377 None] deleting rbd volume volume-5d00ab7c-8e19-4157-abb4-a3115b974b7a {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:36:05.409927 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-73bcba2e-00e1-4bd7-b5f9-8d5b618a262f tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['8ace21d3-991c-4b15-bc62-45bb0c182015', '0f39e2b5-efe7-4515-907c-a9864f8348ab', 'ace1d061-411e-4a10-88f8-f5fc4d3673b9', 'd522df1d-a185-4593-a99a-245c2eb44ae7'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:36:05.449648 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-73bcba2e-00e1-4bd7-b5f9-8d5b618a262f tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:05.470845 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-73bcba2e-00e1-4bd7-b5f9-8d5b618a262f tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:05.493954 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-73bcba2e-00e1-4bd7-b5f9-8d5b618a262f tempest-VolumesSnapshotTestJSON-16764377 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:36:05.498629 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-73bcba2e-00e1-4bd7-b5f9-8d5b618a262f tempest-VolumesSnapshotTestJSON-16764377 None] Deleted volume successfully. Jan 29 21:36:05.509972 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-73bcba2e-00e1-4bd7-b5f9-8d5b618a262f tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-5d00ab7c-8e19-4157-abb4-a3115b974b7a-delete_volume'" released by "delete_volume" :: held 0.379s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:36:06.263126 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e09a4a2a-857b-4925-bed3-c93770a11a05 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-c08be256-ac9f-47fd-aee1-da77a0d20a41-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:36:06.264626 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e09a4a2a-857b-4925-bed3-c93770a11a05 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:07.313502 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-e09a4a2a-857b-4925-bed3-c93770a11a05 tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['b0d82556-231c-464b-ad00-aaeef7c1a304', '90689405-94bb-4b5c-b97a-98092aae3a65', '5ac24954-0a38-4a6c-b1fd-81889c1c36d4', 'f02ece37-b7d2-4301-9af6-84ac2f78d03c'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:36:07.349267 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e09a4a2a-857b-4925-bed3-c93770a11a05 tempest-VolumesSnapshotTestJSON-16764377 None] Delete snapshot completed successfully. Jan 29 21:36:07.353892 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e09a4a2a-857b-4925-bed3-c93770a11a05 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-c08be256-ac9f-47fd-aee1-da77a0d20a41-delete_snapshot'" released by "delete_snapshot" :: held 1.091s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:36:08.387276 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-a2ab2ff8-eb4b-408d-98c9-5e02f237fdcc tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-8dca0234-ea61-425b-898a-496f7b1ea57d-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:36:08.422135 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a2ab2ff8-eb4b-408d-98c9-5e02f237fdcc tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:08.459044 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a2ab2ff8-eb4b-408d-98c9-5e02f237fdcc tempest-VolumesSnapshotTestJSON-16764377 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:36:08.459481 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a2ab2ff8-eb4b-408d-98c9-5e02f237fdcc tempest-VolumesSnapshotTestJSON-16764377 None] Volume volume-8dca0234-ea61-425b-898a-496f7b1ea57d is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:36:08.464127 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a2ab2ff8-eb4b-408d-98c9-5e02f237fdcc tempest-VolumesSnapshotTestJSON-16764377 None] deleting rbd volume volume-8dca0234-ea61-425b-898a-496f7b1ea57d {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:36:08.652315 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-a2ab2ff8-eb4b-408d-98c9-5e02f237fdcc tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['a63148c2-bde3-4391-9818-b072716f6d5a', 'ab0a6d15-6d2a-438a-9922-5ccf339d49f3', '99a55720-c849-4464-8678-9e8ca0d30afe', '4d60fb57-856f-4da6-8df5-b886d43d52e6'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:36:08.689079 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a2ab2ff8-eb4b-408d-98c9-5e02f237fdcc tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:08.716559 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a2ab2ff8-eb4b-408d-98c9-5e02f237fdcc tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:08.739386 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-a2ab2ff8-eb4b-408d-98c9-5e02f237fdcc tempest-VolumesSnapshotTestJSON-16764377 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:36:08.743505 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-a2ab2ff8-eb4b-408d-98c9-5e02f237fdcc tempest-VolumesSnapshotTestJSON-16764377 None] Deleted volume successfully. Jan 29 21:36:08.754462 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-a2ab2ff8-eb4b-408d-98c9-5e02f237fdcc tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-8dca0234-ea61-425b-898a-496f7b1ea57d-delete_volume'" released by "delete_volume" :: held 0.367s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:36:09.518840 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-9d7d9489-fba4-4d2a-b598-b34ec6e09e4e tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-bda2e284-1a8b-411e-abe8-0e258ce8c411-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:36:09.520331 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-9d7d9489-fba4-4d2a-b598-b34ec6e09e4e tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:10.337398 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-9d7d9489-fba4-4d2a-b598-b34ec6e09e4e tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['000faca0-d229-403f-aaba-9f20f3b8a1d5', '8f53677c-ca2d-43cd-a7d5-3f693aba95c7', 'a9c2a435-1d6f-4fd5-9487-8646fc991bfa', 'b678580b-1fff-4f99-9613-2f2c5ef9797c'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:36:10.371331 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-9d7d9489-fba4-4d2a-b598-b34ec6e09e4e tempest-VolumesSnapshotTestJSON-16764377 None] Delete snapshot completed successfully. Jan 29 21:36:10.377102 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-9d7d9489-fba4-4d2a-b598-b34ec6e09e4e tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-bda2e284-1a8b-411e-abe8-0e258ce8c411-delete_snapshot'" released by "delete_snapshot" :: held 0.858s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:36:10.608210 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-ddb44219-b034-41cb-849f-abf91f288578 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-f5e1f546-466a-45dc-abbc-3bd8f89f2288-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:36:10.638509 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ddb44219-b034-41cb-849f-abf91f288578 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:10.675532 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ddb44219-b034-41cb-849f-abf91f288578 tempest-VolumesSnapshotTestJSON-16764377 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:36:10.676089 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ddb44219-b034-41cb-849f-abf91f288578 tempest-VolumesSnapshotTestJSON-16764377 None] Volume volume-f5e1f546-466a-45dc-abbc-3bd8f89f2288 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:36:10.680347 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ddb44219-b034-41cb-849f-abf91f288578 tempest-VolumesSnapshotTestJSON-16764377 None] deleting rbd volume volume-f5e1f546-466a-45dc-abbc-3bd8f89f2288 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:36:10.869242 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-ddb44219-b034-41cb-849f-abf91f288578 tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['b265810f-6ec4-4077-b4a8-4f3c37cb59f6', '16bc1206-02d6-48c2-a0a6-b5f828316ac0', '4534b43c-f7a9-47e2-b327-dfc9c02ed4be', '0e8ddfdf-19a5-437a-b971-02560826ca25'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:36:10.907291 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ddb44219-b034-41cb-849f-abf91f288578 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:10.928572 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-ddb44219-b034-41cb-849f-abf91f288578 tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:10.951548 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-ddb44219-b034-41cb-849f-abf91f288578 tempest-VolumesSnapshotTestJSON-16764377 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:36:10.956922 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-ddb44219-b034-41cb-849f-abf91f288578 tempest-VolumesSnapshotTestJSON-16764377 None] Deleted volume successfully. Jan 29 21:36:10.968204 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-ddb44219-b034-41cb-849f-abf91f288578 tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-f5e1f546-466a-45dc-abbc-3bd8f89f2288-delete_volume'" released by "delete_volume" :: held 0.360s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:36:11.844454 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-33986cf3-d97f-4e2f-9256-02375168aa8b tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-71d092b4-2239-499a-b8f2-531de07ed05f-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:36:11.880522 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-33986cf3-d97f-4e2f-9256-02375168aa8b tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:11.942016 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-33986cf3-d97f-4e2f-9256-02375168aa8b tempest-VolumesSnapshotTestJSON-16764377 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:36:11.948670 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-33986cf3-d97f-4e2f-9256-02375168aa8b tempest-VolumesSnapshotTestJSON-16764377 None] deleting rbd volume volume-71d092b4-2239-499a-b8f2-531de07ed05f {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:36:12.112245 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-33986cf3-d97f-4e2f-9256-02375168aa8b tempest-VolumesSnapshotTestJSON-16764377 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 21:36:12.144778 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-33986cf3-d97f-4e2f-9256-02375168aa8b tempest-VolumesSnapshotTestJSON-16764377 None] deleting parent snapshot volume-71d092b4-2239-499a-b8f2-531de07ed05f.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 21:36:12.343927 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-33986cf3-d97f-4e2f-9256-02375168aa8b tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['438e39d6-fc55-4036-8eb5-ae01393be16c', '3443bce5-5e77-4726-8467-3ea6916fae1d', '65a50524-7051-46e0-9d4c-89e6a97267d2', '4b16fbe3-92f1-47e1-87a0-f164dd8a4587'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:36:12.383129 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-33986cf3-d97f-4e2f-9256-02375168aa8b tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:12.405453 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-33986cf3-d97f-4e2f-9256-02375168aa8b tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:12.427748 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-33986cf3-d97f-4e2f-9256-02375168aa8b tempest-VolumesSnapshotTestJSON-16764377 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:36:12.431596 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-33986cf3-d97f-4e2f-9256-02375168aa8b tempest-VolumesSnapshotTestJSON-16764377 None] Deleted volume successfully. Jan 29 21:36:12.443570 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-33986cf3-d97f-4e2f-9256-02375168aa8b tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-71d092b4-2239-499a-b8f2-531de07ed05f-delete_volume'" released by "delete_volume" :: held 0.599s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:36:12.953849 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-53cbd8fe-78bd-460e-a3fa-d97a803c3b1c tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-a129b379-fcaa-45f7-816a-27e0191ce41c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:36:12.955315 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-53cbd8fe-78bd-460e-a3fa-d97a803c3b1c tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:13.142201 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-53cbd8fe-78bd-460e-a3fa-d97a803c3b1c tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['c1f09297-9c27-4572-9cee-ccded1e1ea36', '435f3c9e-e442-44e7-a251-d2c2d623433e', '7cfbcf68-fbd1-49d7-97f3-9f1edf568802', '7f0d6b42-49ad-4c9f-abd9-db53d730cb81'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:36:13.173772 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-53cbd8fe-78bd-460e-a3fa-d97a803c3b1c tempest-VolumesSnapshotTestJSON-16764377 None] Delete snapshot completed successfully. Jan 29 21:36:13.178292 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-53cbd8fe-78bd-460e-a3fa-d97a803c3b1c tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-a129b379-fcaa-45f7-816a-27e0191ce41c-delete_snapshot'" released by "delete_snapshot" :: held 0.224s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:36:14.047926 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e698e68d-ee43-4ee3-8ee7-08b3007c0e6d tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-5e2560b7-72da-4486-9079-99b40ddbdacd-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:36:14.080264 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e698e68d-ee43-4ee3-8ee7-08b3007c0e6d tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:14.119820 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e698e68d-ee43-4ee3-8ee7-08b3007c0e6d tempest-VolumesSnapshotTestJSON-16764377 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:36:14.120186 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e698e68d-ee43-4ee3-8ee7-08b3007c0e6d tempest-VolumesSnapshotTestJSON-16764377 None] Volume volume-5e2560b7-72da-4486-9079-99b40ddbdacd is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:36:14.126166 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e698e68d-ee43-4ee3-8ee7-08b3007c0e6d tempest-VolumesSnapshotTestJSON-16764377 None] deleting rbd volume volume-5e2560b7-72da-4486-9079-99b40ddbdacd {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:36:14.318479 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-e698e68d-ee43-4ee3-8ee7-08b3007c0e6d tempest-VolumesSnapshotTestJSON-16764377 None] Created reservations ['d76a3bc5-771d-4254-96a3-12a506330029', '555d8827-eb87-442f-a436-31eefcbeffb8', 'ac4ec6c5-6d8e-4ce0-a6d1-754e87d80091', 'b20a3719-4d29-425a-894e-f4a0f2065bf1'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:36:14.355082 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e698e68d-ee43-4ee3-8ee7-08b3007c0e6d tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:14.377822 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e698e68d-ee43-4ee3-8ee7-08b3007c0e6d tempest-VolumesSnapshotTestJSON-16764377 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:14.399450 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e698e68d-ee43-4ee3-8ee7-08b3007c0e6d tempest-VolumesSnapshotTestJSON-16764377 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:36:14.403345 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-e698e68d-ee43-4ee3-8ee7-08b3007c0e6d tempest-VolumesSnapshotTestJSON-16764377 None] Deleted volume successfully. Jan 29 21:36:14.414591 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-e698e68d-ee43-4ee3-8ee7-08b3007c0e6d tempest-VolumesSnapshotTestJSON-16764377 None] Lock "b'cinder-5e2560b7-72da-4486-9079-99b40ddbdacd-delete_volume'" released by "delete_volume" :: held 0.367s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:36:28.715346 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:36:28.716205 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:28.760825 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:36:28.802334 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:38:28.729761 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:38:28.730426 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:38:28.752727 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:38:28.773942 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:39:28.729209 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:39:28.729926 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:39:28.786275 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:39:28.813604 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:40:28.728854 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:40:28.729944 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:40:28.758393 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:40:28.783425 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:41:28.728528 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:41:28.729292 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:41:28.752064 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:41:28.780094 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:42:28.725604 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:42:28.726279 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:42:28.753891 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:42:28.777159 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:42:43.437433 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:42:43.440597 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:42:43.441073 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:42:43.460453 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Flow 'volume_create_manager' (2c9adf47-32f3-44b9-9cb4-60f0d0fa4612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:42:43.467548 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e303b3-8175-42d7-a951-334872254ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:42:43.473962 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:42:43.488060 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e303b3-8175-42d7-a951-334872254ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1068458073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=635d0b4c-1f18-4627-b307-24fe28e991cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753da2bb46c048c68d0dd786113b9137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:42:43Z,use_quota=True,user_id='96c9b58765dd43d98d81eb645b6e8a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:42:43.494054 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2fdf39-6794-41ff-aafa-43797e0bfbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:42:43.498248 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2fdf39-6794-41ff-aafa-43797e0bfbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:42:43.503361 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72682d1d-fe6d-49f3-ba3a-c6be899b6f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:42:43.507536 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72682d1d-fe6d-49f3-ba3a-c6be899b6f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '635d0b4c-1f18-4627-b307-24fe28e991cb', 'volume_name': 'volume-635d0b4c-1f18-4627-b307-24fe28e991cb', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:42:43.512976 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3fff1d-179e-49b5-b72d-1f3ad8f8d149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:42:43.517213 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3fff1d-179e-49b5-b72d-1f3ad8f8d149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:42:43.521904 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8b4c6f-c97c-4d75-9297-991d949f8f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:42:43.523006 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Volume 635d0b4c-1f18-4627-b307-24fe28e991cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-635d0b4c-1f18-4627-b307-24fe28e991cb', 'volume_size': 1} Jan 29 21:42:43.523391 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] creating volume 'volume-635d0b4c-1f18-4627-b307-24fe28e991cb' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:42:43.524350 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:42:43.577018 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:42:43.577323 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:42:43.581057 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8b4c6f-c97c-4d75-9297-991d949f8f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635d0b4c-1f18-4627-b307-24fe28e991cb', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:42:43.585621 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c650938-3243-422d-9f95-e8e56820c0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:42:43.594803 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Volume volume-635d0b4c-1f18-4627-b307-24fe28e991cb (635d0b4c-1f18-4627-b307-24fe28e991cb): created successfully Jan 29 21:42:43.598649 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c650938-3243-422d-9f95-e8e56820c0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:42:43.604148 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Flow 'volume_create_manager' (2c9adf47-32f3-44b9-9cb4-60f0d0fa4612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:42:43.611426 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-3be54f23-a62e-4d45-a41b-86a469030fb1 tempest-ServerActionsTestJSON-1042019319 None] Created volume successfully. Jan 29 21:42:44.983215 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-2ad2434b-749d-41a3-9f08-55261bc6b021 req-fc806b71-2401-463a-a195-1f5bdd6a176a tempest-ServerActionsTestJSON-1042019319 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:42:45.638288 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-2ad2434b-749d-41a3-9f08-55261bc6b021 req-fc806b71-2401-463a-a195-1f5bdd6a176a tempest-ServerActionsTestJSON-1042019319 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.655s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:42:45.639104 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-2ad2434b-749d-41a3-9f08-55261bc6b021 req-fc806b71-2401-463a-a195-1f5bdd6a176a tempest-ServerActionsTestJSON-1042019319 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-635d0b4c-1f18-4627-b307-24fe28e991cb', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '635d0b4c-1f18-4627-b307-24fe28e991cb', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:42:45.662209 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-2ad2434b-749d-41a3-9f08-55261bc6b021 req-fc806b71-2401-463a-a195-1f5bdd6a176a tempest-ServerActionsTestJSON-1042019319 None] Connection info returned from driver {'name': 'volumes/volume-635d0b4c-1f18-4627-b307-24fe28e991cb', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '635d0b4c-1f18-4627-b307-24fe28e991cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '78fbb985-55e9-4684-9b7a-226a0d63339e'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:42:45.704878 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-2ad2434b-749d-41a3-9f08-55261bc6b021 req-fc806b71-2401-463a-a195-1f5bdd6a176a tempest-ServerActionsTestJSON-1042019319 None] attachment_update completed successfully. Jan 29 21:43:12.571088 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-a85ec8ec-b816-41a3-932d-90da90bca58e req-4000f3c9-f8d7-4703-815b-83b20d5c3c59 tempest-ServerActionsTestJSON-1042019319 None] Terminate volume connection completed successfully. Jan 29 21:43:12.571727 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-a85ec8ec-b816-41a3-932d-90da90bca58e req-4000f3c9-f8d7-4703-815b-83b20d5c3c59 tempest-ServerActionsTestJSON-1042019319 None] Deleting attachment 78fbb985-55e9-4684-9b7a-226a0d63339e. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:43:14.462535 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-a85ec8ec-b816-41a3-932d-90da90bca58e req-05ef93a2-e448-4dfe-9d0a-acf16d75b195 tempest-ServerActionsTestJSON-1042019319 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:43:15.098824 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-a85ec8ec-b816-41a3-932d-90da90bca58e req-05ef93a2-e448-4dfe-9d0a-acf16d75b195 tempest-ServerActionsTestJSON-1042019319 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.636s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:43:15.099992 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-a85ec8ec-b816-41a3-932d-90da90bca58e req-05ef93a2-e448-4dfe-9d0a-acf16d75b195 tempest-ServerActionsTestJSON-1042019319 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-635d0b4c-1f18-4627-b307-24fe28e991cb', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '635d0b4c-1f18-4627-b307-24fe28e991cb', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:43:15.119503 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-a85ec8ec-b816-41a3-932d-90da90bca58e req-05ef93a2-e448-4dfe-9d0a-acf16d75b195 tempest-ServerActionsTestJSON-1042019319 None] Connection info returned from driver {'name': 'volumes/volume-635d0b4c-1f18-4627-b307-24fe28e991cb', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '635d0b4c-1f18-4627-b307-24fe28e991cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd171b0de-6f1d-40cc-88bd-d53fe0eb5ee1'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:43:15.163565 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-a85ec8ec-b816-41a3-932d-90da90bca58e req-05ef93a2-e448-4dfe-9d0a-acf16d75b195 tempest-ServerActionsTestJSON-1042019319 None] attachment_update completed successfully. Jan 29 21:43:23.687217 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-44ad69e4-b3be-472c-b798-9c5a9bdc9c82 req-9ff219e7-a98e-46ac-babc-134edef6b113 tempest-ServerActionsTestJSON-1042019319 None] Terminate volume connection completed successfully. Jan 29 21:43:23.687947 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-44ad69e4-b3be-472c-b798-9c5a9bdc9c82 req-9ff219e7-a98e-46ac-babc-134edef6b113 tempest-ServerActionsTestJSON-1042019319 None] Deleting attachment d171b0de-6f1d-40cc-88bd-d53fe0eb5ee1. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:43:25.820837 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-44ad69e4-b3be-472c-b798-9c5a9bdc9c82 req-50099596-86e8-45b4-924d-0f8a6d725af8 tempest-ServerActionsTestJSON-1042019319 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:43:26.453769 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-44ad69e4-b3be-472c-b798-9c5a9bdc9c82 req-50099596-86e8-45b4-924d-0f8a6d725af8 tempest-ServerActionsTestJSON-1042019319 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.633s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:43:26.454566 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-44ad69e4-b3be-472c-b798-9c5a9bdc9c82 req-50099596-86e8-45b4-924d-0f8a6d725af8 tempest-ServerActionsTestJSON-1042019319 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-635d0b4c-1f18-4627-b307-24fe28e991cb', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '635d0b4c-1f18-4627-b307-24fe28e991cb', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:43:26.477345 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-44ad69e4-b3be-472c-b798-9c5a9bdc9c82 req-50099596-86e8-45b4-924d-0f8a6d725af8 tempest-ServerActionsTestJSON-1042019319 None] Connection info returned from driver {'name': 'volumes/volume-635d0b4c-1f18-4627-b307-24fe28e991cb', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '635d0b4c-1f18-4627-b307-24fe28e991cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a3b3ccfa-10bd-4765-b3df-cc7748cd71f9'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:43:26.523955 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-44ad69e4-b3be-472c-b798-9c5a9bdc9c82 req-50099596-86e8-45b4-924d-0f8a6d725af8 tempest-ServerActionsTestJSON-1042019319 None] attachment_update completed successfully. Jan 29 21:43:28.721921 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:43:28.723022 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:43:28.747773 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:43:28.787130 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:43:34.619668 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-954f3f5f-e441-4263-b6f9-9e071721b230 req-a582bc61-3f83-48ae-90bf-12c9fc799769 tempest-ServerActionsTestJSON-1042019319 None] Terminate volume connection completed successfully. Jan 29 21:43:34.620335 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-954f3f5f-e441-4263-b6f9-9e071721b230 req-a582bc61-3f83-48ae-90bf-12c9fc799769 tempest-ServerActionsTestJSON-1042019319 None] Deleting attachment a3b3ccfa-10bd-4765-b3df-cc7748cd71f9. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:43:35.607943 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-d28cbaa4-e05d-4706-b1b2-d4c4935fc1c7 tempest-ServerActionsTestJSON-1042019319 None] Lock "b'cinder-635d0b4c-1f18-4627-b307-24fe28e991cb-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:43:35.646808 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d28cbaa4-e05d-4706-b1b2-d4c4935fc1c7 tempest-ServerActionsTestJSON-1042019319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:43:35.689125 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d28cbaa4-e05d-4706-b1b2-d4c4935fc1c7 tempest-ServerActionsTestJSON-1042019319 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:43:35.689573 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d28cbaa4-e05d-4706-b1b2-d4c4935fc1c7 tempest-ServerActionsTestJSON-1042019319 None] Volume volume-635d0b4c-1f18-4627-b307-24fe28e991cb is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:43:35.694431 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d28cbaa4-e05d-4706-b1b2-d4c4935fc1c7 tempest-ServerActionsTestJSON-1042019319 None] deleting rbd volume volume-635d0b4c-1f18-4627-b307-24fe28e991cb {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:43:35.919468 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-d28cbaa4-e05d-4706-b1b2-d4c4935fc1c7 tempest-ServerActionsTestJSON-1042019319 None] Created reservations ['77df62bf-7eb1-46d7-924a-a6065ed88a4d', 'b522d0ba-caaa-4e4a-bec8-71e96dd1c8ba', '6c849396-4a5f-49e3-9c90-36d298edee5b', '403995b2-afdb-438e-bb64-35e105bc3469'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:43:35.958424 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d28cbaa4-e05d-4706-b1b2-d4c4935fc1c7 tempest-ServerActionsTestJSON-1042019319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:43:35.981283 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-d28cbaa4-e05d-4706-b1b2-d4c4935fc1c7 tempest-ServerActionsTestJSON-1042019319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:43:36.005407 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-d28cbaa4-e05d-4706-b1b2-d4c4935fc1c7 tempest-ServerActionsTestJSON-1042019319 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:43:36.009462 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-d28cbaa4-e05d-4706-b1b2-d4c4935fc1c7 tempest-ServerActionsTestJSON-1042019319 None] Deleted volume successfully. Jan 29 21:43:36.020182 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-d28cbaa4-e05d-4706-b1b2-d4c4935fc1c7 tempest-ServerActionsTestJSON-1042019319 None] Lock "b'cinder-635d0b4c-1f18-4627-b307-24fe28e991cb-delete_volume'" released by "delete_volume" :: held 0.412s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:44:28.721633 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:44:28.723467 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:44:28.771274 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:44:28.816737 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:45:12.291173 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 21:45:12.295372 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 21:45:12.295848 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 21:45:12.315836 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Flow 'volume_create_manager' (24b106bf-5883-4f66-979d-18bda219f4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:45:12.322451 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af0d2b3-fc6f-4211-8836-4ddeb3bfa634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:45:12.329310 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 21:45:12.344720 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af0d2b3-fc6f-4211-8836-4ddeb3bfa634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T21:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1479931223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0ca69899d94b92b3973c23e7df2526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T21:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T21:45:12Z,use_quota=True,user_id='7aba4332fa854dc1a72848fb916ba6df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:45:12.350103 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55701401-7666-4ee8-abbc-f46402aa48ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:45:12.354244 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55701401-7666-4ee8-abbc-f46402aa48ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:45:12.360018 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b2c576-fa39-4071-aa8b-fde37dd93768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:45:12.364198 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b2c576-fa39-4071-aa8b-fde37dd93768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303', 'volume_name': 'volume-2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:45:12.369178 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f164bf-4116-405c-b117-82eb544e1415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:45:12.373818 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f164bf-4116-405c-b117-82eb544e1415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:45:12.378528 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f99f47b-d2c7-4946-9102-07d8f78c0911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:45:12.379588 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Volume 2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303', 'volume_size': 1} Jan 29 21:45:12.379982 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] creating volume 'volume-2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303' {{(pid=134283) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 29 21:45:12.380935 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:45:12.431800 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 21:45:12.432171 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 21:45:12.436431 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f99f47b-d2c7-4946-9102-07d8f78c0911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303', 'volume_size': 1}' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:45:12.441044 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cfe270-71cb-4c61-b345-b671499018df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 21:45:12.450187 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Volume volume-2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303 (2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303): created successfully Jan 29 21:45:12.453806 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cfe270-71cb-4c61-b345-b671499018df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 21:45:12.459397 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Flow 'volume_create_manager' (24b106bf-5883-4f66-979d-18bda219f4b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 21:45:12.467375 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-8e23b697-702d-47f8-a9b3-8e7f1a58e54c tempest-TestMinimumBasicScenario-44602988 None] Created volume successfully. Jan 29 21:45:13.812522 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-524d5a69-4ddb-48ba-9bd9-c905331ab2d0 req-3b140ec9-db22-45d2-946c-a9e8919f4a58 tempest-TestMinimumBasicScenario-44602988 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 21:45:14.479233 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-524d5a69-4ddb-48ba-9bd9-c905331ab2d0 req-3b140ec9-db22-45d2-946c-a9e8919f4a58 tempest-TestMinimumBasicScenario-44602988 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.666s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 21:45:14.479989 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-524d5a69-4ddb-48ba-9bd9-c905331ab2d0 req-3b140ec9-db22-45d2-946c-a9e8919f4a58 tempest-TestMinimumBasicScenario-44602988 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': '2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 21:45:14.502292 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-524d5a69-4ddb-48ba-9bd9-c905331ab2d0 req-3b140ec9-db22-45d2-946c-a9e8919f4a58 tempest-TestMinimumBasicScenario-44602988 None] Connection info returned from driver {'name': 'volumes/volume-2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e6707217-4712-4a22-97fd-4804d92db73d'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 21:45:14.547355 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-524d5a69-4ddb-48ba-9bd9-c905331ab2d0 req-3b140ec9-db22-45d2-946c-a9e8919f4a58 tempest-TestMinimumBasicScenario-44602988 None] attachment_update completed successfully. Jan 29 21:45:28.724637 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:45:28.725728 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:45:28.748660 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:45:28.771003 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:46:28.725647 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:46:28.726335 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:46:28.747843 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:46:28.769711 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:47:28.725264 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:47:28.726374 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:47:28.746924 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:47:28.768343 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:47:39.391792 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-350b8d7f-53f8-471b-b22a-33b2ba48a595 req-a3fe75c4-bee2-4743-a38a-7ec8184f360c tempest-TestMinimumBasicScenario-44602988 None] Terminate volume connection completed successfully. Jan 29 21:47:39.392404 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-350b8d7f-53f8-471b-b22a-33b2ba48a595 req-a3fe75c4-bee2-4743-a38a-7ec8184f360c tempest-TestMinimumBasicScenario-44602988 None] Deleting attachment e6707217-4712-4a22-97fd-4804d92db73d. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 21:47:39.979814 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-3d0df6fb-e0dd-415a-8d8b-aae2b78b53db tempest-TestMinimumBasicScenario-44602988 None] Lock "b'cinder-2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 21:47:40.010717 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3d0df6fb-e0dd-415a-8d8b-aae2b78b53db tempest-TestMinimumBasicScenario-44602988 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:47:40.049533 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3d0df6fb-e0dd-415a-8d8b-aae2b78b53db tempest-TestMinimumBasicScenario-44602988 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 21:47:40.049919 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3d0df6fb-e0dd-415a-8d8b-aae2b78b53db tempest-TestMinimumBasicScenario-44602988 None] Volume volume-2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303 is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 21:47:40.054740 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3d0df6fb-e0dd-415a-8d8b-aae2b78b53db tempest-TestMinimumBasicScenario-44602988 None] deleting rbd volume volume-2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 21:47:40.264873 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [None req-3d0df6fb-e0dd-415a-8d8b-aae2b78b53db tempest-TestMinimumBasicScenario-44602988 None] Created reservations ['972b9a26-0154-47ac-8210-24bd75ad42e9', 'aff2c56d-25bd-4b5f-8faa-4eaec381bade', 'a92ded7d-ce3a-4945-b665-3ff7917ea1e0', '855ed468-1a8e-4c50-8d2f-717b89df01e1'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 21:47:40.303260 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3d0df6fb-e0dd-415a-8d8b-aae2b78b53db tempest-TestMinimumBasicScenario-44602988 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:47:40.325888 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-3d0df6fb-e0dd-415a-8d8b-aae2b78b53db tempest-TestMinimumBasicScenario-44602988 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:47:40.348309 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-3d0df6fb-e0dd-415a-8d8b-aae2b78b53db tempest-TestMinimumBasicScenario-44602988 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:47:40.352601 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-3d0df6fb-e0dd-415a-8d8b-aae2b78b53db tempest-TestMinimumBasicScenario-44602988 None] Deleted volume successfully. Jan 29 21:47:40.363586 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-3d0df6fb-e0dd-415a-8d8b-aae2b78b53db tempest-TestMinimumBasicScenario-44602988 None] Lock "b'cinder-2fa36cc0-8010-49b6-b6d3-9d1f0c9c7303-delete_volume'" released by "delete_volume" :: held 0.384s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 21:48:28.724368 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:48:28.725169 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:48:28.746645 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:48:28.768318 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:49:28.723779 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:49:28.724542 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:49:28.748061 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:49:28.776265 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:50:28.720780 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:50:28.721482 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:50:28.745029 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:50:28.768743 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:51:28.723563 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:51:28.724247 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:51:28.746036 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:51:28.767474 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:52:28.721873 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:52:28.723487 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:52:28.768444 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:52:28.804009 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:53:28.719901 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:53:28.720579 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:53:28.742202 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:53:28.764515 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:54:28.719198 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:54:28.719892 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:54:28.741410 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:54:28.763239 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:55:28.718302 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:55:28.718996 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:55:28.741528 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:55:28.763126 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:56:28.718654 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:56:28.719352 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:56:28.739640 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:56:28.761591 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:57:28.715719 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:57:28.716389 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:57:28.739166 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:57:28.763488 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:58:28.718583 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:58:28.719229 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:58:28.740632 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:58:28.762108 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 21:59:28.716270 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 21:59:28.716915 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:59:28.738976 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 21:59:28.760439 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:00:28.716508 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:00:28.717220 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:00:28.737964 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:00:28.762541 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:01:28.717572 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:01:28.718792 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:01:28.739095 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:01:28.761085 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:02:28.717106 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:02:28.718326 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:02:28.739365 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:02:28.760332 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:03:28.716592 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:03:28.717372 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:03:28.738538 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:03:28.759413 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:04:28.716613 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:04:28.717372 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:04:28.738408 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:04:28.759382 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:04:49.882111 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134283) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 29 22:04:49.885631 ncdv-master-1 cinder-volume[134283]: WARNING stevedore.named [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 29 22:04:49.886107 ncdv-master-1 cinder-volume[134283]: WARNING castellan.key_manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 29 22:04:49.906594 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Flow 'volume_create_manager' (a78e552d-88b8-4a38-abae-010364686727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 22:04:49.913159 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8b7be3-b7ae-4db8-a38d-efaa67fccad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 22:04:49.920305 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_db.sqlalchemy.engines [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 29 22:04:49.934955 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8b7be3-b7ae-4db8-a38d-efaa67fccad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-29T22:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-581091479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c67b06c0-6f82-48ec-a2ca-52b8c5a21631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfd44ab95bc4137b93be22a0c5ac76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-29T22:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-29T22:04:50Z,use_quota=True,user_id='c0cf6134807a40b8a827427bae388ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b4c3582-289d-40dd-a858-34e3868bf0dc),volume_type_id=2b4c3582-289d-40dd-a858-34e3868bf0dc)' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 22:04:49.940418 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d423dfbb-9000-45e2-9ce2-a8a5662a3191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 22:04:49.944643 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d423dfbb-9000-45e2-9ce2-a8a5662a3191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 22:04:49.949763 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44eef8a-4a48-4b5c-a750-ee05b421279c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 22:04:50.027860 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44eef8a-4a48-4b5c-a750-ee05b421279c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c67b06c0-6f82-48ec-a2ca-52b8c5a21631', 'volume_name': 'volume-c67b06c0-6f82-48ec-a2ca-52b8c5a21631', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 22:04:50.033591 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc4bbd5-0512-4a28-a753-de20c07b2d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 22:04:50.037679 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc4bbd5-0512-4a28-a753-de20c07b2d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 22:04:50.042376 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d344aac-2e3f-45ef-b5dc-2228187cb5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 22:04:50.043490 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Volume c67b06c0-6f82-48ec-a2ca-52b8c5a21631: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c67b06c0-6f82-48ec-a2ca-52b8c5a21631', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 29 22:04:50.044053 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Cloning c67b06c0-6f82-48ec-a2ca-52b8c5a21631 from image 2d84033c-0eee-4684-85d5-5f7610b2b616 at location (None, None). {{(pid=134283) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 29 22:04:50.051710 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 22:04:50.061739 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 22, 4, 50, 56267)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 22:04:50.062287 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 22:04:50.062718 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Found cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 29 22:04:50.067418 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Lock "b'cinder-2d84033c-0eee-4684-85d5-5f7610b2b616'" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 22:04:50.068317 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Attempting to retrieve cache entry for image = 2d84033c-0eee-4684-85d5-5f7610b2b616 on host ncdv-master-1@ceph#ceph. {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 29 22:04:50.073781 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Found image-volume cache entry: {'id': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'volume_id': '0404edc2-cca2-48a4-afe8-a1f41b283dbe', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2), 'last_used': datetime.datetime(2022, 1, 29, 22, 4, 50, 71647)}. {{(pid=134283) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 29 22:04:50.074187 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.image.cache [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Image-volume cache entry image_update_at = 2022-01-29 20:38:02+00:00, requested image updated_at = 2022-01-29 20:38:02+00:00. {{(pid=134283) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 29 22:04:50.074597 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Creating from source image-volume 0404edc2-cca2-48a4-afe8-a1f41b283dbe {{(pid=134283) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 29 22:04:50.086338 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:04:50.153438 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] creating snapshot='volume-c67b06c0-6f82-48ec-a2ca-52b8c5a21631.clone_snap' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 29 22:04:50.705291 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] cloning 'volume-0404edc2-cca2-48a4-afe8-a1f41b283dbe@volume-c67b06c0-6f82-48ec-a2ca-52b8c5a21631.clone_snap' to 'volume-c67b06c0-6f82-48ec-a2ca-52b8c5a21631' {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 29 22:04:50.831351 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Volume volume-3751bb46-9a8b-4302-9c63-b2bed6fccd8d.deleted is not a clone. {{(pid=134283) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 29 22:04:50.834042 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 29 22:04:50.834042 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134283) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 29 22:04:50.853371 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] clone created successfully {{(pid=134283) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 29 22:04:50.853992 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.volume_utils [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Marking volume c67b06c0-6f82-48ec-a2ca-52b8c5a21631 as bootable. {{(pid=134283) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 29 22:04:50.862186 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Copying metadata from image 2d84033c-0eee-4684-85d5-5f7610b2b616 to c67b06c0-6f82-48ec-a2ca-52b8c5a21631. {{(pid=134283) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 29 22:04:50.862687 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Creating volume glance metadata for volume c67b06c0-6f82-48ec-a2ca-52b8c5a21631 backed by image 2d84033c-0eee-4684-85d5-5f7610b2b616 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134283) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 29 22:04:50.912508 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d344aac-2e3f-45ef-b5dc-2228187cb5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67b06c0-6f82-48ec-a2ca-52b8c5a21631', 'volume_size': 1, 'image_id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6fcb5888256d47719003de548d95a059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '2d84033c-0eee-4684-85d5-5f7610b2b616', 'created_at': datetime.datetime(2022, 1, 29, 20, 37, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 29, 20, 38, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d84033c-0eee-4684-85d5-5f7610b2b616/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 22:04:50.917228 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df6488d-b512-4831-a5e1-3ba0749bced0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 29 22:04:50.926446 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.flows.manager.create_volume [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Volume volume-c67b06c0-6f82-48ec-a2ca-52b8c5a21631 (c67b06c0-6f82-48ec-a2ca-52b8c5a21631): created successfully Jan 29 22:04:50.930008 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df6488d-b512-4831-a5e1-3ba0749bced0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134283) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 29 22:04:50.935739 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Flow 'volume_create_manager' (a78e552d-88b8-4a38-abae-010364686727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134283) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 29 22:04:50.943580 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [None req-a6ff3851-39d1-4145-af71-a719a4d9a34f tempest-TestShelveInstance-1031991644 None] Created volume successfully. Jan 29 22:04:53.715980 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-4396ed95-c50d-495b-88d8-70a64813a14b req-5adb179d-37f4-4550-b559-261dacf61b07 tempest-TestShelveInstance-1031991644 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 22:04:54.398220 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-4396ed95-c50d-495b-88d8-70a64813a14b req-5adb179d-37f4-4550-b559-261dacf61b07 tempest-TestShelveInstance-1031991644 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.682s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 22:04:54.399307 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-4396ed95-c50d-495b-88d8-70a64813a14b req-5adb179d-37f4-4550-b559-261dacf61b07 tempest-TestShelveInstance-1031991644 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c67b06c0-6f82-48ec-a2ca-52b8c5a21631', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'c67b06c0-6f82-48ec-a2ca-52b8c5a21631', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 22:04:54.424976 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-4396ed95-c50d-495b-88d8-70a64813a14b req-5adb179d-37f4-4550-b559-261dacf61b07 tempest-TestShelveInstance-1031991644 None] Connection info returned from driver {'name': 'volumes/volume-c67b06c0-6f82-48ec-a2ca-52b8c5a21631', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c67b06c0-6f82-48ec-a2ca-52b8c5a21631', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '127bb674-feba-4a4d-819a-389a3c20e5e2'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 22:04:54.478158 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-4396ed95-c50d-495b-88d8-70a64813a14b req-5adb179d-37f4-4550-b559-261dacf61b07 tempest-TestShelveInstance-1031991644 None] attachment_update completed successfully. Jan 29 22:05:28.715554 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:05:28.716761 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:05:28.743751 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:05:28.768554 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:06:28.714530 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:06:28.715244 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:06:28.736616 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:06:28.757411 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:07:23.734242 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-038e3d79-7f50-4cbb-bc42-f4c628cb025d req-2c0aeb9a-cdae-4ecf-8f3e-c7dcbebfe9ce tempest-TestShelveInstance-1031991644 None] Terminate volume connection completed successfully. Jan 29 22:07:23.734866 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-038e3d79-7f50-4cbb-bc42-f4c628cb025d req-2c0aeb9a-cdae-4ecf-8f3e-c7dcbebfe9ce tempest-TestShelveInstance-1031991644 None] Deleting attachment 127bb674-feba-4a4d-819a-389a3c20e5e2. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 22:07:28.715311 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:07:28.715990 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:07:28.744826 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:07:28.768178 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:07:29.773508 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-28e123d4-72c9-4aee-9d42-4c0f001ff0e1 req-3862d2d8-2db7-4eea-8d7e-23295a2b4d57 tempest-TestShelveInstance-1031991644 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 29 22:07:30.414301 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_concurrency.processutils [req-28e123d4-72c9-4aee-9d42-4c0f001ff0e1 req-3862d2d8-2db7-4eea-8d7e-23295a2b4d57 tempest-TestShelveInstance-1031991644 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.640s {{(pid=134283) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 29 22:07:30.415105 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-28e123d4-72c9-4aee-9d42-4c0f001ff0e1 req-3862d2d8-2db7-4eea-8d7e-23295a2b4d57 tempest-TestShelveInstance-1031991644 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c67b06c0-6f82-48ec-a2ca-52b8c5a21631', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '06567dee-8a50-4d7b-8f19-020a28eac1ad', 'volume_id': 'c67b06c0-6f82-48ec-a2ca-52b8c5a21631', 'discard': True}} {{(pid=134283) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 29 22:07:30.437493 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-28e123d4-72c9-4aee-9d42-4c0f001ff0e1 req-3862d2d8-2db7-4eea-8d7e-23295a2b4d57 tempest-TestShelveInstance-1031991644 None] Connection info returned from driver {'name': 'volumes/volume-c67b06c0-6f82-48ec-a2ca-52b8c5a21631', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c67b06c0-6f82-48ec-a2ca-52b8c5a21631', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7a9bf60c-861e-467a-951a-91cf2e325f6e'} {{(pid=134283) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4811}} Jan 29 22:07:30.497135 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-28e123d4-72c9-4aee-9d42-4c0f001ff0e1 req-3862d2d8-2db7-4eea-8d7e-23295a2b4d57 tempest-TestShelveInstance-1031991644 None] attachment_update completed successfully. Jan 29 22:08:28.713787 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:08:28.714650 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:08:28.737189 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:08:28.760119 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:09:09.629445 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-b0524669-d5f8-40c0-96fb-6e2477ac1d5f req-28475694-0097-4ab5-a25a-5c8d71da86c8 tempest-TestShelveInstance-1031991644 None] Terminate volume connection completed successfully. Jan 29 22:09:09.630101 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.manager [req-b0524669-d5f8-40c0-96fb-6e2477ac1d5f req-28475694-0097-4ab5-a25a-5c8d71da86c8 tempest-TestShelveInstance-1031991644 None] Deleting attachment 7a9bf60c-861e-467a-951a-91cf2e325f6e. {{(pid=134283) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4947}} Jan 29 22:09:09.748419 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-b0524669-d5f8-40c0-96fb-6e2477ac1d5f req-ca8da76c-929a-427d-a46b-79e4775bec8c tempest-TestShelveInstance-1031991644 None] Lock "b'cinder-c67b06c0-6f82-48ec-a2ca-52b8c5a21631-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 29 22:09:09.781842 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b0524669-d5f8-40c0-96fb-6e2477ac1d5f req-ca8da76c-929a-427d-a46b-79e4775bec8c tempest-TestShelveInstance-1031991644 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:09:09.851898 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b0524669-d5f8-40c0-96fb-6e2477ac1d5f req-ca8da76c-929a-427d-a46b-79e4775bec8c tempest-TestShelveInstance-1031991644 None] volume has no backup snaps {{(pid=134283) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 29 22:09:09.858629 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b0524669-d5f8-40c0-96fb-6e2477ac1d5f req-ca8da76c-929a-427d-a46b-79e4775bec8c tempest-TestShelveInstance-1031991644 None] deleting rbd volume volume-c67b06c0-6f82-48ec-a2ca-52b8c5a21631 {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 29 22:09:10.159380 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b0524669-d5f8-40c0-96fb-6e2477ac1d5f req-ca8da76c-929a-427d-a46b-79e4775bec8c tempest-TestShelveInstance-1031991644 None] volume is a clone so cleaning references {{(pid=134283) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 29 22:09:10.193611 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b0524669-d5f8-40c0-96fb-6e2477ac1d5f req-ca8da76c-929a-427d-a46b-79e4775bec8c tempest-TestShelveInstance-1031991644 None] deleting parent snapshot volume-c67b06c0-6f82-48ec-a2ca-52b8c5a21631.clone_snap {{(pid=134283) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 29 22:09:10.782296 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.quota [req-b0524669-d5f8-40c0-96fb-6e2477ac1d5f req-ca8da76c-929a-427d-a46b-79e4775bec8c tempest-TestShelveInstance-1031991644 None] Created reservations ['d38076e9-3ddb-4a3c-b40d-859da06865f9', '20843ca4-51b5-4ca2-80c0-f8b3a2573fa4', 'bd94fa4a-dddb-40cb-98c7-dc1b00a13fee', '467d2e9c-1e01-4f72-b772-2720f9028f4f'] {{(pid=134283) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 29 22:09:10.823427 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b0524669-d5f8-40c0-96fb-6e2477ac1d5f req-ca8da76c-929a-427d-a46b-79e4775bec8c tempest-TestShelveInstance-1031991644 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:09:10.845780 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [req-b0524669-d5f8-40c0-96fb-6e2477ac1d5f req-ca8da76c-929a-427d-a46b-79e4775bec8c tempest-TestShelveInstance-1031991644 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:09:10.867999 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [req-b0524669-d5f8-40c0-96fb-6e2477ac1d5f req-ca8da76c-929a-427d-a46b-79e4775bec8c tempest-TestShelveInstance-1031991644 None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:09:10.872148 ncdv-master-1 cinder-volume[134283]: INFO cinder.volume.manager [req-b0524669-d5f8-40c0-96fb-6e2477ac1d5f req-ca8da76c-929a-427d-a46b-79e4775bec8c tempest-TestShelveInstance-1031991644 None] Deleted volume successfully. Jan 29 22:09:10.884179 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.coordination [req-b0524669-d5f8-40c0-96fb-6e2477ac1d5f req-ca8da76c-929a-427d-a46b-79e4775bec8c tempest-TestShelveInstance-1031991644 None] Lock "b'cinder-c67b06c0-6f82-48ec-a2ca-52b8c5a21631-delete_volume'" released by "delete_volume" :: held 1.136s {{(pid=134283) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 29 22:09:28.715179 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:09:28.716636 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:09:28.749931 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:09:28.793525 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:10:28.719579 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:10:28.720270 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:10:28.741675 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:10:28.763379 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:11:28.719307 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:11:28.719988 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:11:28.741486 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:11:28.762950 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:12:28.720196 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:12:28.720840 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:12:28.743415 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:12:28.767941 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:13:28.724846 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:13:28.725703 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:13:28.782170 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:13:28.806386 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:14:28.727661 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:14:28.728864 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:14:28.750203 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:14:28.772582 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:15:28.728762 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:15:28.729560 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:15:28.756316 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:15:28.792376 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:16:28.730764 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:16:28.732005 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:16:28.752888 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:16:28.775091 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:17:28.730788 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:17:28.731431 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:17:28.752172 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:17:28.774063 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:18:28.729990 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:18:28.731164 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:18:28.753140 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:18:28.774974 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:19:28.731618 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:19:28.732243 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:19:28.753717 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:19:28.775767 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:20:28.731934 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:20:28.733175 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:20:28.754443 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:20:28.780312 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:21:28.736496 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:21:28.737227 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:21:28.757836 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:21:28.779914 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:22:28.736243 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:22:28.736950 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:22:28.757723 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:22:28.779651 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 29 22:23:28.736077 ncdv-master-1 cinder-volume[134283]: DEBUG oslo_service.periodic_task [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134283) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 29 22:23:28.736806 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:23:28.758330 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.volume.drivers.rbd [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134283) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 29 22:23:28.780475 ncdv-master-1 cinder-volume[134283]: DEBUG cinder.manager [None req-e82c3274-a0c9-48d6-904f-52183dcb7920 None None] Notifying Schedulers of capabilities ... {{(pid=134283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}